Jul 27 15:48:17.203791 ip-10-0-141-146 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 15:48:17.615187 ip-10-0-141-146 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 15:48:17.615187 ip-10-0-141-146 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 15:48:17.615187 ip-10-0-141-146 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 15:48:17.615187 ip-10-0-141-146 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 15:48:17.615187 ip-10-0-141-146 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 15:48:17.617331 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.617244    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 15:48:17.622397 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622369    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:17.622397 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622392    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:17.622397 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622398    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:17.622397 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622401    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622404    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622407    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622410    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622413    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622415    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622418    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622421    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622423    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622426    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622430    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622434    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622437    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622440    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622443    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622445    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622448    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622451    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622454    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622457    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:17.622562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622459    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622462    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622464    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622467    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622469    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622472    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622478    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622481    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622483    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622486    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622489    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622491    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622507    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622510    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622514    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622516    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622519    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622521    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622524    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:17.623028 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622528    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622532    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622535    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622538    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622541    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622543    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622546    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622548    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622550    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622554    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622558    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622560    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622563    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622566    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622569    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622573    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622576    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622579    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622581    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:17.623469 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622584    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622587    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622589    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622592    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622594    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622596    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622599    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622601    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622605    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622608    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622610    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622613    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622616    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622618    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622620    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622623    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622625    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622628    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622630    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622633    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:17.623961 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622635    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622638    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622642    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622644    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622647    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622649    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622651    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622654    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622656    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622659    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622661    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622664    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622666    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622669    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622671    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622673    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622676    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.622678    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623350    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623355    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:17.624440 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623359    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623362    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623365    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623368    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623370    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623373    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623375    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623378    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623380    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623383    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623386    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623388    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623391    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623393    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623396    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623399    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623402    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623406    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623411    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:17.624928 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623415    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623419    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623422    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623424    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623427    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623430    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623432    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623434    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623437    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623439    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623442    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623444    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623447    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623450    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623453    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623456    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623458    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623461    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623463    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623466    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:17.625385 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623468    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623471    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623484    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623487    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623490    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623508    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623531    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623536    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623541    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623545    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623548    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623551    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623553    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623556    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623558    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623561    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623563    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623566    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623568    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623571    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:17.625877 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623573    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623576    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623578    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623581    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623583    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623586    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623589    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623592    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623595    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623597    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623600    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623603    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623605    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623608    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623611    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623613    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623616    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623619    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623621    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623624    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:17.626358 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623627    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623629    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623632    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623635    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623638    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623640    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623642    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623645    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623648    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623650    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623653    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623655    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623658    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623660    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623663    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623665    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623669    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.623673    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624037    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:17.626861 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624042    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624046    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624049    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624052    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624055    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624058    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624061    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624063    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624066    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624069    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624071    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624074    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624076    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624079    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624082    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624085    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624088    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624091    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624093    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:17.627311 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624096    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624099    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624102    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624104    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624107    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624110    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624113    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624115    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624118    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624120    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624123    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624126    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624130    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624134    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624136    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624139    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624142    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624145    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624147    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624150    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:17.627811 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624152    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624155    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624157    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624160    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624162    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624165    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624167    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624170    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624172    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624181    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624184    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624187    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624189    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624192    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624197    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624199    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624202    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624205    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624207    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624209    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:17.628284 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624212    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624215    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624217    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624220    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624222    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624225    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624227    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624230    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624233    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624236    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624238    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624241    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624243    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624246    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624248    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624251    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624254    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624256    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624261    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:17.628788 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624265    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624267    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624270    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624274    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624277    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624280    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624283    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624287    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624289    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624292    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624295    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624298    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624300    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624303    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624306    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624308    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624311    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624314    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624316    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.624319    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624390    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 15:48:17.629255 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624398    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624405    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624410    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624414    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624417    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624421    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624425    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624428    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624431    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624434    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624438    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624440    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624444    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624447    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624450    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624456    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624459    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624463    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624467    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624470    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624473    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624476    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624480    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 15:48:17.629754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624483    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624486    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624489    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624505    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624508    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624511    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624514    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624517    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624521    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624526    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624529    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624532    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624535    2579 flags.go:64] FLAG: --enable-server="true"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624538    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624543    2579 flags.go:64] FLAG: --event-burst="100"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624546    2579 flags.go:64] FLAG: --event-qps="50"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624549    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624552    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624555    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624558    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624561    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624564    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624567    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624570    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624573    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 15:48:17.630307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624577    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624580    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624585    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624588    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624591    2579 flags.go:64] FLAG: --feature-gates=""
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624594    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624597    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624600    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624603    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624606    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624609    2579 flags.go:64] FLAG: --help="false"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624612    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-141-146.ec2.internal"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624615    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624618    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624621    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624624    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624629    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624632    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624635    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624638    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624641    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624643    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624646    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624649    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 27 15:48:17.630912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624652    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624655    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624658    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624660    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624663    2579 flags.go:64] FLAG: --lock-file=""
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624666    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624669    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624672    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624677    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624680    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624687    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624690    2579 flags.go:64] FLAG: --logging-format="text"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624692    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624696    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624698    2579 flags.go:64] FLAG: --manifest-url=""
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624701    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624705    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624708    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624712    2579 flags.go:64] FLAG: --max-pods="110"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624715    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624718    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624721    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624737    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624740    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624744    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 15:48:17.631471 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624746    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624754    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624757    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624760    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624763    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624765    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624770    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624773    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624775    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624778    2579 flags.go:64] FLAG: --port="10250"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624781    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624784    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c77a4f47c604da80"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624787    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624790    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624793    2579 flags.go:64] FLAG: --register-node="true"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624796    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624799    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624803    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624807    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624809    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624813    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624816    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624819    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624822    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624825    2579 flags.go:64] FLAG: --runonce="false"
Jul 27 15:48:17.632453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624827    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624830    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624833    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624836    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624839    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624842    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624848    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624851    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624854    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624857    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624860    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624862    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624865    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624868    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624871    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624876    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624879    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624881    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624885    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624887    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624890    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624893    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624895    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624898    2579 flags.go:64] FLAG: --v="2"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624902    2579 flags.go:64] FLAG: --version="false"
Jul 27 15:48:17.633524 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624908    2579 flags.go:64] FLAG: --vmodule=""
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624911    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.624915    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625022    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625026    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625029    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625032    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625034    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625039    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625042    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625045    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625048    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625051    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625055    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625058    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625060    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625063    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625066    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625069    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:17.634388 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625071    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625074    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625076    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625080    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625083    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625086    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625088    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625090    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625093    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625095    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625098    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625100    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625103    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625106    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625109    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625113    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625117    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625119    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625122    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:17.634896 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625125    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625128    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625130    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625133    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625135    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625138    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625141    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625145    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625148    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625150    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625153    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625155    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625158    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625160    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625163    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625165    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625167    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625170    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625172    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625175    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:17.635329 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625177    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625180    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625182    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625185    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625187    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625189    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625193    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625196    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625199    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625202    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625204    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625207    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625209    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625212    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625214    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625217    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625219    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625221    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625224    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625228    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:17.635848 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625230    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625232    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625235    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625237    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625240    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625242    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625245    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625247    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625250    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625252    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625255    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625258    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625260    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625263    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625265    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625267    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625270    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625272    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625276    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625278    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:17.636334 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625281    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625284    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625286    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.625289    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.626088    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.634078    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.634097    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.636697    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.636713    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636834    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636841    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636847    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636851    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636855    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636861    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:17.637057 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636866    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636871    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636876    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636880    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636884    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636889    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636893    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636898    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636902    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636906    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636910    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636917    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636923    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636927    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636932    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636936    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636940    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636944    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:17.637711 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636948    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636952    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636957    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636962    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636966    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636979    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636984    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636988    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636992    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.636997    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637001    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637005    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637009    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637013    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637017    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637022    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637026    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637030    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637034    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637038    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:17.638405 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637042    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637046    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637050    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637054    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637058    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637062    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637065    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637069    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637073    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637078    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637085    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637091    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637097    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637101    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637106    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637111    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637115    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637119    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637134    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637139    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:17.638941 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637143    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637147    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637151    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637155    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637159    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637164    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637168    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637172    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637176    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637180    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637184    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637188    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637192    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637196    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637201    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637205    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637209    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637213    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637217    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637222    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:17.639789 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637226    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637230    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637234    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637238    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637244    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637249    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637254    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637258    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637263    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637268    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637272    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637283    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637288    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637291    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637295    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:17.640562 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.637303    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637537    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637544    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637550    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637554    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637559    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637563    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637567    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637571    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637575    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637579    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637584    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637588    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637592    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637596    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637600    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637605    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637611    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637616    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 15:48:17.640951 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637620    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637624    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637628    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637632    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637636    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637640    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637644    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637648    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637653    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637657    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637668    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637672    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637677    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637681    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637685    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637689    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637693    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637697    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637703    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637708    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 15:48:17.641630 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637713    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637717    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637721    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637725    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637729    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637733    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637737    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637741    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637746    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637750    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637754    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637758    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637762    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637766    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637770    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637774    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637778    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637782    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637786    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637790    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 15:48:17.642102 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637795    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637799    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637803    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637814    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637819    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637823    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637827    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637831    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637835    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637839    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637843    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637847    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637851    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637855    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637859    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637866    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637872    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637877    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637882    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 15:48:17.642609 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637886    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637891    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637895    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637899    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637903    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637907    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637911    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637915    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637920    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637924    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637928    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637932    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637936    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637941    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637945    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637949    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637953    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637964    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637969    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637973    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 15:48:17.643037 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637977    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 15:48:17.643585 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:17.637981    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 15:48:17.643585 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.637988    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 15:48:17.643585 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.638176    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 15:48:17.643585 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.641021    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 15:48:17.643585 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.643385    2579 server.go:1019] "Starting client certificate rotation"
Jul 27 15:48:17.643585 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.643527    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 15:48:17.643585 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.643564    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 15:48:17.648113 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.648098    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 15:48:17.651393 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.651373    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 15:48:17.668087 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.668069    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 27 15:48:17.670734 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.670721    2579 log.go:25] "Validated CRI v1 image API"
Jul 27 15:48:17.671555 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.671539    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 15:48:17.674221 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.674205    2579 fs.go:135] Filesystem UUIDs: map[403047a1-57ae-4039-a23e-94aa60e5ae5e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 afa6bb22-8357-4c63-a0bd-7d44378a6a62:/dev/nvme0n1p3]
Jul 27 15:48:17.674275 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.674222    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 15:48:17.679358 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.679252    2579 manager.go:216] Machine: {Timestamp:2026-07-27 15:48:17.677999576 +0000 UTC m=+0.359063995 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3154837 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dbe4243a55eabfbb7693121362c0f SystemUUID:ec2dbe42-43a5-5eab-fbb7-693121362c0f BootID:7d1aa354-5f2e-468a-8bff-bfd808cef787 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ca:c5:01:81:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ca:c5:01:81:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:52:22:1e:57:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 15:48:17.679358 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.679356    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 15:48:17.679465 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.679430    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 15:48:17.681344 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.681328    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 15:48:17.682629 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.682608    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 15:48:17.682807 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.682632    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 15:48:17.683505 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.683486    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 15:48:17.683553 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.683509    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 15:48:17.683553 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.683516    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 15:48:17.683553 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.683548    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 15:48:17.687249 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.687239    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 15:48:17.690820 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.690809    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 15:48:17.690992 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.690983    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 15:48:17.691023 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.691013    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 15:48:17.691056 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.691026    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 15:48:17.691088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.691057    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 15:48:17.691088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.691068    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 27 15:48:17.691151 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.691120    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 15:48:17.691515 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.691488    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 15:48:17.691571 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.691532    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 15:48:17.696347 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.696332    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 15:48:17.698352 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.698337    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 15:48:17.698410 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.698366    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 15:48:17.699948 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.699935    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 15:48:17.699948 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.699952    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 15:48:17.700039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.699958    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 15:48:17.700039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.699964    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 15:48:17.700039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.699972    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 15:48:17.700039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.699983    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 15:48:17.700039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.699995    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 15:48:17.700039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.700000    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 15:48:17.700039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.700007    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 15:48:17.700039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.700012    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 15:48:17.700039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.700025    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 15:48:17.700039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.700030    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 15:48:17.700752 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.700741    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 15:48:17.700787 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.700755    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 15:48:17.703367 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.703344    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 15:48:17.703457 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.703389    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 15:48:17.703686 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.703624    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 15:48:17.706169 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.706151    2579 server.go:1268] "Started kubelet"
Jul 27 15:48:17.706383 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.706324    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 15:48:17.706452 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.706434    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 15:48:17.706612 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.706588    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 15:48:17.707197 ip-10-0-141-146 systemd[1]: Started Kubernetes Kubelet.
Jul 27 15:48:17.708009 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.707837    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 15:48:17.708296 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.708246    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 15:48:17.712545 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.712524    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 15:48:17.715941 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.715070    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-146.ec2.internal.18c63032f46ab159  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-146.ec2.internal,UID:ip-10-0-141-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-146.ec2.internal,},FirstTimestamp:2026-07-27 15:48:17.706111321 +0000 UTC m=+0.387175741,LastTimestamp:2026-07-27 15:48:17.706111321 +0000 UTC m=+0.387175741,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-146.ec2.internal,}"
Jul 27 15:48:17.716530 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.716509    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 15:48:17.716625 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.716517    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 15:48:17.716625 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.716602    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 27 15:48:17.717342 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717321    2579 factory.go:55] Registering systemd factory
Jul 27 15:48:17.717431 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717347    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 27 15:48:17.717483 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717439    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 15:48:17.717483 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717454    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 15:48:17.717579 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717440    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 15:48:17.717579 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717567    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 15:48:17.717579 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717575    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 15:48:17.717713 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717604    2579 factory.go:153] Registering CRI-O factory
Jul 27 15:48:17.717713 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717615    2579 factory.go:223] Registration of the crio container factory successfully
Jul 27 15:48:17.717713 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717668    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 15:48:17.717713 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717691    2579 factory.go:103] Registering Raw factory
Jul 27 15:48:17.717713 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.717708    2579 manager.go:1196] Started watching for new ooms in manager
Jul 27 15:48:17.718037 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.718025    2579 manager.go:349] Starting recovery of all containers
Jul 27 15:48:17.727361 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.727334    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 27 15:48:17.727451 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.727425    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 27 15:48:17.728264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.728250    2579 manager.go:354] Recovery completed
Jul 27 15:48:17.732376 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.732363    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:17.733987 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.733965    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:17.734032 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.734000    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:17.734032 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.734011    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:17.734457 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.734443    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 15:48:17.734563 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.734459    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:17.734563 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.734459    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 15:48:17.734563 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.734509    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 15:48:17.735081 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.735068    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:17.735141 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.735091    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:17.735141 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.735099    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:17.736301 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.736289    2579 policy_none.go:49] "None policy: Start"
Jul 27 15:48:17.736342 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.736305    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 15:48:17.736342 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.736315    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 15:48:17.737504 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.737484    2579 policy_none.go:47] "Start"
Jul 27 15:48:17.738671 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.738651    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zzgzd"
Jul 27 15:48:17.743736 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.743460    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-146.ec2.internal.18c63032f6140e0e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-146.ec2.internal,UID:ip-10-0-141-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-146.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-146.ec2.internal,},FirstTimestamp:2026-07-27 15:48:17.733987854 +0000 UTC m=+0.415052277,LastTimestamp:2026-07-27 15:48:17.733987854 +0000 UTC m=+0.415052277,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-146.ec2.internal,}"
Jul 27 15:48:17.746280 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.746266    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zzgzd"
Jul 27 15:48:17.783839 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.783825    2579 manager.go:337] "Starting Device Plugin manager"
Jul 27 15:48:17.783903 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.783856    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 15:48:17.783903 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.783866    2579 server.go:87] "Starting device plugin registration server"
Jul 27 15:48:17.784081 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.784069    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 15:48:17.784138 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.784082    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 15:48:17.784189 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.784163    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 15:48:17.784271 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.784254    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 15:48:17.784271 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.784268    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 15:48:17.784816 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.784797    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 15:48:17.784894 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.784852    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 27 15:48:17.884709 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.884688    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:17.896569 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.885692    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:17.896569 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.885716    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:17.896569 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.885726    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:17.896569 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.885755    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-146.ec2.internal"
Jul 27 15:48:17.896569 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.894969    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-146.ec2.internal"
Jul 27 15:48:17.896569 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.894988    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-146.ec2.internal\": node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 27 15:48:17.919438 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.919418    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 27 15:48:17.922644 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.922616    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 15:48:17.923830 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.923813    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 15:48:17.923900 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.923858    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 15:48:17.923900 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.923881    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 15:48:17.923981 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:17.923920    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 15:48:17.926526 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:17.926483    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:18.022110 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.022070    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 27 15:48:18.024400 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.024380    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"]
Jul 27 15:48:18.024450 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.024441    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:18.026007 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.025990    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:18.026103 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.026018    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:18.026103 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.026029    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:18.027355 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.027341    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:18.027462 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.027448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.027498 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.027478    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:18.028099 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.028081    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:18.028254 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.028103    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:18.028254 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.028113    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:18.028254 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.028157    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:18.028254 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.028196    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:18.028254 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.028212    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:18.029482 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.029465    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.029594 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.029492    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 15:48:18.030203 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.030188    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 15:48:18.030282 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.030212    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 15:48:18.030282 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.030222    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeHasSufficientPID"
Jul 27 15:48:18.048221 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.048196    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-146.ec2.internal\" not found" node="ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.051696 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.051679    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-146.ec2.internal\" not found" node="ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.122289 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.122257    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 27 15:48:18.122403 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.122328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d95d964f6f5196d055ec9fd47d5b92d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-146.ec2.internal\" (UID: \"4d95d964f6f5196d055ec9fd47d5b92d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.122403 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.122355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.122403 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.122375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.222432 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.222355    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 27 15:48:18.222549 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.222446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d95d964f6f5196d055ec9fd47d5b92d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-146.ec2.internal\" (UID: \"4d95d964f6f5196d055ec9fd47d5b92d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.222549 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.222468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.222549 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.222485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.222664 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.222557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d95d964f6f5196d055ec9fd47d5b92d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-146.ec2.internal\" (UID: \"4d95d964f6f5196d055ec9fd47d5b92d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.222664 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.222557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.222664 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.222583    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d91a83fc84345123f3da435634f47e28-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal\" (UID: \"d91a83fc84345123f3da435634f47e28\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.324468 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.324429    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 27 15:48:18.350301 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.350276    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.356406 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.356384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.425607 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.425560    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-146.ec2.internal\" not found"
Jul 27 15:48:18.514988 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.514920    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:18.517088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.517073    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.589160 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.589135    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 15:48:18.591207 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.591193    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.642328 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.642300    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 15:48:18.642776 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.642453    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 15:48:18.642776 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.642462    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 15:48:18.642776 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.642495    2579 kubelet.go:3250] "Failed creating a mirror pod" err="Post \"https://aaceb46e3dfdf41d588334da8c4f8c53-c3efe3f5d5230e67.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.141.146:57018->44.217.168.231:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal"
Jul 27 15:48:18.694548 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.694528    2579 apiserver.go:52] "Watching apiserver"
Jul 27 15:48:18.709912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.709458    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 15:48:18.711306 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.711277    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-ksdlr","openshift-multus/multus-t8qz8","openshift-network-operator/iptables-alerter-4r989","openshift-ovn-kubernetes/ovnkube-node-shnx2","kube-system/global-pull-secret-syncer-44z5d","kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal","openshift-cluster-node-tuning-operator/tuned-jb55w","openshift-dns/node-resolver-zls2z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal","openshift-multus/multus-additional-cni-plugins-s8gfr","openshift-multus/network-metrics-daemon-sng2j","openshift-network-diagnostics/network-check-target-bssgv","kube-system/konnectivity-agent-5htdh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"]
Jul 27 15:48:18.713232 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.713211    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.714291 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.714272    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:18.715895 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.715868    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4r989"
Jul 27 15:48:18.715991 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.715907    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-t4shq\""
Jul 27 15:48:18.716314 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.716299    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:48:18.716362 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.716340    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 15:48:18.717115 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.717098    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 15:48:18.717454 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.717439    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v822k\""
Jul 27 15:48:18.717454 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.717453    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.718541 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.718522    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 15:48:18.718718 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.718703    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:48:18.718773 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.718723    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 15:48:18.718819 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.718790    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 15:48:18.718858 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.718829    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 15:48:18.718911 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.718897    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:18.718977 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.718957    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:18.719048 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.719031    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r8k6z\""
Jul 27 15:48:18.720264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.720248    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.721779 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.721764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ksdlr"
Jul 27 15:48:18.723115 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.723100    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.723383 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.723212    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 15:48:18.723383 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.723358    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 15:48:18.723659 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.723638    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 15:48:18.723781 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.723658    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 15:48:18.723781 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.723668    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 15:48:18.723781 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.723714    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 15:48:18.723781 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.723668    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 15:48:18.723781 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.723661    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qvrlv\""
Jul 27 15:48:18.724113 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.723914    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 15:48:18.724113 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.723975    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 15:48:18.724113 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.724007    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8lbtx\""
Jul 27 15:48:18.724635 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.724614    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.724978 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.724958    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 15:48:18.725270 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.725247    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 15:48:18.726414 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726232    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 15:48:18.726414 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726265    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 15:48:18.726414 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726290    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 15:48:18.726414 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726300    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lsq2h\""
Jul 27 15:48:18.726414 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726235    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5knh4\""
Jul 27 15:48:18.726414 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726269    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 15:48:18.726756 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726540    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:18.726756 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726560    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 15:48:18.726756 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.726602    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:18.726874 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-kubelet\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.726874 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.726874 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726829    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab803008-f703-40f8-bacc-d3c05417c3de-env-overrides\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.726874 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726854    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-sysctl-d\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.727266 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.726891    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-systemd\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.727361 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-run\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.727361 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-host\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.727530 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e7129b6-77d1-43c3-b929-21cfe9158de6-iptables-alerter-script\") pod \"iptables-alerter-4r989\" (UID: \"6e7129b6-77d1-43c3-b929-21cfe9158de6\") " pod="openshift-network-operator/iptables-alerter-4r989"
Jul 27 15:48:18.727530 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727396    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v47lw\" (UniqueName: \"kubernetes.io/projected/6e7129b6-77d1-43c3-b929-21cfe9158de6-kube-api-access-v47lw\") pod \"iptables-alerter-4r989\" (UID: \"6e7129b6-77d1-43c3-b929-21cfe9158de6\") " pod="openshift-network-operator/iptables-alerter-4r989"
Jul 27 15:48:18.727530 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727485    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7fhkl\""
Jul 27 15:48:18.727690 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727530    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 15:48:18.727690 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727601    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 15:48:18.727809 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727791    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-run-ovn\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.727865 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab803008-f703-40f8-bacc-d3c05417c3de-ovn-node-metrics-cert\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.727932 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3fb0452e-1b06-406d-8a5b-3b07372c12ff-agent-certs\") pod \"konnectivity-agent-5htdh\" (UID: \"3fb0452e-1b06-406d-8a5b-3b07372c12ff\") " pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:18.727932 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e7129b6-77d1-43c3-b929-21cfe9158de6-host-slash\") pod \"iptables-alerter-4r989\" (UID: \"6e7129b6-77d1-43c3-b929-21cfe9158de6\") " pod="openshift-network-operator/iptables-alerter-4r989"
Jul 27 15:48:18.728034 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-systemd-units\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.728034 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znnjf\" (UniqueName: \"kubernetes.io/projected/ab803008-f703-40f8-bacc-d3c05417c3de-kube-api-access-znnjf\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.728034 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.727998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:18.728188 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.728022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-sys\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.728188 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.728067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-tuned\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.728188 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.728100    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3fb0452e-1b06-406d-8a5b-3b07372c12ff-konnectivity-ca\") pod \"konnectivity-agent-5htdh\" (UID: \"3fb0452e-1b06-406d-8a5b-3b07372c12ff\") " pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:18.728188 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.728128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-cni-bin\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.728188 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.728158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab803008-f703-40f8-bacc-d3c05417c3de-ovnkube-script-lib\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.728188 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.728186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-run-netns\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.728515 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.728227    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-modprobe-d\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.728515 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.728259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-sysconfig\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.728853 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.728829    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-node-log\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.728927 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.728870    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-log-socket\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.729161 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-run-ovn-kubernetes\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.729228 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729204    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3b7a762-4b09-4df3-878f-304637a41ed9-dbus\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:18.729289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-kubernetes\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.729339 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-sysctl-conf\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.729401 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-slash\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.729496 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab803008-f703-40f8-bacc-d3c05417c3de-ovnkube-config\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.729496 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729447    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-cni-netd\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.729496 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3b7a762-4b09-4df3-878f-304637a41ed9-kubelet-config\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:18.729697 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-lib-modules\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.729697 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-run-systemd\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.729697 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-etc-openvswitch\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.729697 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-run-openvswitch\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.729886 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-var-lib-openvswitch\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.729886 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-var-lib-kubelet\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.729886 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38b5f95-84d6-42fa-bce4-d5299a02b549-tmp\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.729886 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.729850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft8fk\" (UniqueName: \"kubernetes.io/projected/d38b5f95-84d6-42fa-bce4-d5299a02b549-kube-api-access-ft8fk\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.730640 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.730085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:18.730640 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.730154    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:18.731187 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.731168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zls2z"
Jul 27 15:48:18.736872 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.736845    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 15:48:18.736956 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.736844    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fz2mj\""
Jul 27 15:48:18.737078 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.737060    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 15:48:18.750329 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.750292    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 15:43:18 +0000 UTC" deadline="2028-01-15 18:18:46.422025261 +0000 UTC"
Jul 27 15:48:18.750329 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.750327    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12890h30m27.671701095s"
Jul 27 15:48:18.750650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.750631    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 15:48:18.775643 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.775621    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c8z4f"
Jul 27 15:48:18.789380 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.789360    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c8z4f"
Jul 27 15:48:18.819000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.818982    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 15:48:18.830386 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-kubelet\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.830478 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab803008-f703-40f8-bacc-d3c05417c3de-env-overrides\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.830478 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-var-lib-kubelet\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.830587 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-kubelet\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.830587 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-etc-kubernetes\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.830698 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-sysctl-d\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.830698 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-host\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.830698 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v47lw\" (UniqueName: \"kubernetes.io/projected/6e7129b6-77d1-43c3-b929-21cfe9158de6-kube-api-access-v47lw\") pod \"iptables-alerter-4r989\" (UID: \"6e7129b6-77d1-43c3-b929-21cfe9158de6\") " pod="openshift-network-operator/iptables-alerter-4r989"
Jul 27 15:48:18.830698 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830686    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-run-ovn\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.830895 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830711    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab803008-f703-40f8-bacc-d3c05417c3de-ovn-node-metrics-cert\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.830895 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-host\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.830895 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znnjf\" (UniqueName: \"kubernetes.io/projected/ab803008-f703-40f8-bacc-d3c05417c3de-kube-api-access-znnjf\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.830895 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830743    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-sysctl-d\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.830895 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-run-ovn\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.830895 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-socket-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.830895 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-registration-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.830895 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3fb0452e-1b06-406d-8a5b-3b07372c12ff-agent-certs\") pod \"konnectivity-agent-5htdh\" (UID: \"3fb0452e-1b06-406d-8a5b-3b07372c12ff\") " pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:18.830895 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-systemd-units\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830926    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-systemd-units\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830951    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc65e853-284c-47b7-a0f6-022fa31d1a0d-hosts-file\") pod \"node-resolver-zls2z\" (UID: \"fc65e853-284c-47b7-a0f6-022fa31d1a0d\") " pod="openshift-dns/node-resolver-zls2z"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab803008-f703-40f8-bacc-d3c05417c3de-env-overrides\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.830974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-device-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.830996    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-run-netns\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831028    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-sys\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.831062    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret podName:d3b7a762-4b09-4df3-878f-304637a41ed9 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:19.331046275 +0000 UTC m=+2.012110713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret") pod "global-pull-secret-syncer-44z5d" (UID: "d3b7a762-4b09-4df3-878f-304637a41ed9") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831067    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-tuned\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831090    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-sys\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3fb0452e-1b06-406d-8a5b-3b07372c12ff-konnectivity-ca\") pod \"konnectivity-agent-5htdh\" (UID: \"3fb0452e-1b06-406d-8a5b-3b07372c12ff\") " pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831137    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-cni-bin\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-hostroot\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831194    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndt44\" (UniqueName: \"kubernetes.io/projected/c0990436-6f55-4b52-93c6-64e871ee4661-kube-api-access-ndt44\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.831289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-sysconfig\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-log-socket\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-run-ovn-kubernetes\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-sysconfig\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ca7316b-79a1-488e-9f95-7afaf9e1e775-serviceca\") pod \"node-ca-ksdlr\" (UID: \"2ca7316b-79a1-488e-9f95-7afaf9e1e775\") " pod="openshift-image-registry/node-ca-ksdlr"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-slash\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab803008-f703-40f8-bacc-d3c05417c3de-ovnkube-config\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc65e853-284c-47b7-a0f6-022fa31d1a0d-tmp-dir\") pod \"node-resolver-zls2z\" (UID: \"fc65e853-284c-47b7-a0f6-022fa31d1a0d\") " pod="openshift-dns/node-resolver-zls2z"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-run-multus-certs\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-cni-netd\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-os-release\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831626    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-slash\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-run-k8s-cni-cncf-io\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3fb0452e-1b06-406d-8a5b-3b07372c12ff-konnectivity-ca\") pod \"konnectivity-agent-5htdh\" (UID: \"3fb0452e-1b06-406d-8a5b-3b07372c12ff\") " pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmqdh\" (UniqueName: \"kubernetes.io/projected/223cd87a-faae-4f56-88f2-14d5284a2c14-kube-api-access-xmqdh\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.832047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831715    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-cni-bin\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831730    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-run-systemd\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-log-socket\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831759    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-run-openvswitch\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831792    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0990436-6f55-4b52-93c6-64e871ee4661-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831842    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-run-systemd\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831844    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-run-ovn-kubernetes\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831854    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-daemon-config\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-run-openvswitch\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-var-lib-openvswitch\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38b5f95-84d6-42fa-bce4-d5299a02b549-tmp\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831935    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-cni-netd\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft8fk\" (UniqueName: \"kubernetes.io/projected/d38b5f95-84d6-42fa-bce4-d5299a02b549-kube-api-access-ft8fk\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.831992    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-var-lib-openvswitch\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832067    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab803008-f703-40f8-bacc-d3c05417c3de-ovnkube-config\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.832952 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab803008-f703-40f8-bacc-d3c05417c3de-ovnkube-script-lib\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832090    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832134    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-conf-dir\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-systemd\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-run\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e7129b6-77d1-43c3-b929-21cfe9158de6-iptables-alerter-script\") pod \"iptables-alerter-4r989\" (UID: \"6e7129b6-77d1-43c3-b929-21cfe9158de6\") " pod="openshift-network-operator/iptables-alerter-4r989"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0990436-6f55-4b52-93c6-64e871ee4661-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntq4\" (UniqueName: \"kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4\") pod \"network-check-target-bssgv\" (UID: \"93946ad2-a0c3-48e2-bf21-958ca87b1703\") " pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h686\" (UniqueName: \"kubernetes.io/projected/2ed3eff9-8de6-4a1e-af19-52e140aa4952-kube-api-access-8h686\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ca7316b-79a1-488e-9f95-7afaf9e1e775-host\") pod \"node-ca-ksdlr\" (UID: \"2ca7316b-79a1-488e-9f95-7afaf9e1e775\") " pod="openshift-image-registry/node-ca-ksdlr"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832539    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-socket-dir-parent\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e7129b6-77d1-43c3-b929-21cfe9158de6-host-slash\") pod \"iptables-alerter-4r989\" (UID: \"6e7129b6-77d1-43c3-b929-21cfe9158de6\") " pod="openshift-network-operator/iptables-alerter-4r989"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832592    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-var-lib-cni-multus\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-system-cni-dir\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832648    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kw2t\" (UniqueName: \"kubernetes.io/projected/d2b4d804-902a-462c-9597-6201391cd658-kube-api-access-2kw2t\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-etc-selinux\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.834000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-sys-fs\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832724    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab803008-f703-40f8-bacc-d3c05417c3de-ovnkube-script-lib\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832803    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e7129b6-77d1-43c3-b929-21cfe9158de6-host-slash\") pod \"iptables-alerter-4r989\" (UID: \"6e7129b6-77d1-43c3-b929-21cfe9158de6\") " pod="openshift-network-operator/iptables-alerter-4r989"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-run-netns\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-modprobe-d\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-node-log\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3b7a762-4b09-4df3-878f-304637a41ed9-dbus\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.832993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-system-cni-dir\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-kubernetes\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833110    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-sysctl-conf\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-cnibin\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph4b7\" (UniqueName: \"kubernetes.io/projected/fc65e853-284c-47b7-a0f6-022fa31d1a0d-kube-api-access-ph4b7\") pod \"node-resolver-zls2z\" (UID: \"fc65e853-284c-47b7-a0f6-022fa31d1a0d\") " pod="openshift-dns/node-resolver-zls2z"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/223cd87a-faae-4f56-88f2-14d5284a2c14-cni-binary-copy\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3b7a762-4b09-4df3-878f-304637a41ed9-kubelet-config\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-os-release\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0990436-6f55-4b52-93c6-64e871ee4661-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833304    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-cni-dir\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.834772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-cnibin\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833443    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-var-lib-cni-bin\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-lib-modules\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-etc-openvswitch\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm84p\" (UniqueName: \"kubernetes.io/projected/2ca7316b-79a1-488e-9f95-7afaf9e1e775-kube-api-access-rm84p\") pod \"node-ca-ksdlr\" (UID: \"2ca7316b-79a1-488e-9f95-7afaf9e1e775\") " pod="openshift-image-registry/node-ca-ksdlr"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-var-lib-kubelet\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833974    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3b7a762-4b09-4df3-878f-304637a41ed9-dbus\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833759    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-host-run-netns\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833857    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-modprobe-d\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833875    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e7129b6-77d1-43c3-b929-21cfe9158de6-iptables-alerter-script\") pod \"iptables-alerter-4r989\" (UID: \"6e7129b6-77d1-43c3-b929-21cfe9158de6\") " pod="openshift-network-operator/iptables-alerter-4r989"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-node-log\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833926    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-systemd\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.833715    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-run\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.834061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3b7a762-4b09-4df3-878f-304637a41ed9-kubelet-config\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.834093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-kubernetes\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.834143    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-var-lib-kubelet\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.834195    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab803008-f703-40f8-bacc-d3c05417c3de-etc-openvswitch\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.834217    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-sysctl-conf\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.835264 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.834308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d38b5f95-84d6-42fa-bce4-d5299a02b549-lib-modules\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.835848 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.834702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d38b5f95-84d6-42fa-bce4-d5299a02b549-tmp\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.835848 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.834847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d38b5f95-84d6-42fa-bce4-d5299a02b549-etc-tuned\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.835848 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.834939    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab803008-f703-40f8-bacc-d3c05417c3de-ovn-node-metrics-cert\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.835848 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.834971    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3fb0452e-1b06-406d-8a5b-3b07372c12ff-agent-certs\") pod \"konnectivity-agent-5htdh\" (UID: \"3fb0452e-1b06-406d-8a5b-3b07372c12ff\") " pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:18.839857 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.839836    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znnjf\" (UniqueName: \"kubernetes.io/projected/ab803008-f703-40f8-bacc-d3c05417c3de-kube-api-access-znnjf\") pod \"ovnkube-node-shnx2\" (UID: \"ab803008-f703-40f8-bacc-d3c05417c3de\") " pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:18.843577 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.843558    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v47lw\" (UniqueName: \"kubernetes.io/projected/6e7129b6-77d1-43c3-b929-21cfe9158de6-kube-api-access-v47lw\") pod \"iptables-alerter-4r989\" (UID: \"6e7129b6-77d1-43c3-b929-21cfe9158de6\") " pod="openshift-network-operator/iptables-alerter-4r989"
Jul 27 15:48:18.843966 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.843946    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft8fk\" (UniqueName: \"kubernetes.io/projected/d38b5f95-84d6-42fa-bce4-d5299a02b549-kube-api-access-ft8fk\") pod \"tuned-jb55w\" (UID: \"d38b5f95-84d6-42fa-bce4-d5299a02b549\") " pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:18.934414 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934426    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc65e853-284c-47b7-a0f6-022fa31d1a0d-tmp-dir\") pod \"node-resolver-zls2z\" (UID: \"fc65e853-284c-47b7-a0f6-022fa31d1a0d\") " pod="openshift-dns/node-resolver-zls2z"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-run-multus-certs\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-os-release\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-run-k8s-cni-cncf-io\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmqdh\" (UniqueName: \"kubernetes.io/projected/223cd87a-faae-4f56-88f2-14d5284a2c14-kube-api-access-xmqdh\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0990436-6f55-4b52-93c6-64e871ee4661-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934590    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-daemon-config\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-conf-dir\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934650    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-run-k8s-cni-cncf-io\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.934686 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0990436-6f55-4b52-93c6-64e871ee4661-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934714    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-run-multus-certs\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntq4\" (UniqueName: \"kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4\") pod \"network-check-target-bssgv\" (UID: \"93946ad2-a0c3-48e2-bf21-958ca87b1703\") " pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h686\" (UniqueName: \"kubernetes.io/projected/2ed3eff9-8de6-4a1e-af19-52e140aa4952-kube-api-access-8h686\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ca7316b-79a1-488e-9f95-7afaf9e1e775-host\") pod \"node-ca-ksdlr\" (UID: \"2ca7316b-79a1-488e-9f95-7afaf9e1e775\") " pod="openshift-image-registry/node-ca-ksdlr"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934816    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc65e853-284c-47b7-a0f6-022fa31d1a0d-tmp-dir\") pod \"node-resolver-zls2z\" (UID: \"fc65e853-284c-47b7-a0f6-022fa31d1a0d\") " pod="openshift-dns/node-resolver-zls2z"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-socket-dir-parent\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-var-lib-cni-multus\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-system-cni-dir\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kw2t\" (UniqueName: \"kubernetes.io/projected/d2b4d804-902a-462c-9597-6201391cd658-kube-api-access-2kw2t\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.934916    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-etc-selinux\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.934972    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs podName:d2b4d804-902a-462c-9597-6201391cd658 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:19.434952082 +0000 UTC m=+2.116016509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs") pod "network-metrics-daemon-sng2j" (UID: "d2b4d804-902a-462c-9597-6201391cd658") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.934992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-sys-fs\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-system-cni-dir\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-etc-selinux\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935089    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-os-release\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.935302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-cnibin\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph4b7\" (UniqueName: \"kubernetes.io/projected/fc65e853-284c-47b7-a0f6-022fa31d1a0d-kube-api-access-ph4b7\") pod \"node-resolver-zls2z\" (UID: \"fc65e853-284c-47b7-a0f6-022fa31d1a0d\") " pod="openshift-dns/node-resolver-zls2z"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/223cd87a-faae-4f56-88f2-14d5284a2c14-cni-binary-copy\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-os-release\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935199    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0990436-6f55-4b52-93c6-64e871ee4661-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935243    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-conf-dir\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935257    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0990436-6f55-4b52-93c6-64e871ee4661-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0990436-6f55-4b52-93c6-64e871ee4661-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-sys-fs\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-daemon-config\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-cni-dir\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-cnibin\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-system-cni-dir\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-var-lib-cni-bin\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935416    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-cni-dir\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935430    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-cnibin\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm84p\" (UniqueName: \"kubernetes.io/projected/2ca7316b-79a1-488e-9f95-7afaf9e1e775-kube-api-access-rm84p\") pod \"node-ca-ksdlr\" (UID: \"2ca7316b-79a1-488e-9f95-7afaf9e1e775\") " pod="openshift-image-registry/node-ca-ksdlr"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935463    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2ca7316b-79a1-488e-9f95-7afaf9e1e775-host\") pod \"node-ca-ksdlr\" (UID: \"2ca7316b-79a1-488e-9f95-7afaf9e1e775\") " pod="openshift-image-registry/node-ca-ksdlr"
Jul 27 15:48:18.936178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-var-lib-kubelet\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-etc-kubernetes\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-socket-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-registration-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935632    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-multus-socket-dir-parent\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc65e853-284c-47b7-a0f6-022fa31d1a0d-hosts-file\") pod \"node-resolver-zls2z\" (UID: \"fc65e853-284c-47b7-a0f6-022fa31d1a0d\") " pod="openshift-dns/node-resolver-zls2z"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-system-cni-dir\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-cnibin\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-device-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935730    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-run-netns\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935748    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-etc-kubernetes\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-hostroot\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935804    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndt44\" (UniqueName: \"kubernetes.io/projected/c0990436-6f55-4b52-93c6-64e871ee4661-kube-api-access-ndt44\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ca7316b-79a1-488e-9f95-7afaf9e1e775-serviceca\") pod \"node-ca-ksdlr\" (UID: \"2ca7316b-79a1-488e-9f95-7afaf9e1e775\") " pod="openshift-image-registry/node-ca-ksdlr"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935875    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-socket-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935888    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0990436-6f55-4b52-93c6-64e871ee4661-os-release\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.936855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-var-lib-cni-bin\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.937375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935937    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-var-lib-cni-multus\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.937375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935984    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-device-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.937375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.936029    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-hostroot\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.937375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.935506    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-var-lib-kubelet\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.937375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.936074    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/223cd87a-faae-4f56-88f2-14d5284a2c14-host-run-netns\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.937375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.936096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/223cd87a-faae-4f56-88f2-14d5284a2c14-cni-binary-copy\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.937375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.936122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.937375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.936122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fc65e853-284c-47b7-a0f6-022fa31d1a0d-hosts-file\") pod \"node-resolver-zls2z\" (UID: \"fc65e853-284c-47b7-a0f6-022fa31d1a0d\") " pod="openshift-dns/node-resolver-zls2z"
Jul 27 15:48:18.937375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.936138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2ed3eff9-8de6-4a1e-af19-52e140aa4952-registration-dir\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.937375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.936366    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2ca7316b-79a1-488e-9f95-7afaf9e1e775-serviceca\") pod \"node-ca-ksdlr\" (UID: \"2ca7316b-79a1-488e-9f95-7afaf9e1e775\") " pod="openshift-image-registry/node-ca-ksdlr"
Jul 27 15:48:18.938324 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.938304    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0990436-6f55-4b52-93c6-64e871ee4661-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.942752 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.942730    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:18.942752 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.942753    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:18.942918 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.942766    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rntq4 for pod openshift-network-diagnostics/network-check-target-bssgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:18.942918 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:18.942840    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4 podName:93946ad2-a0c3-48e2-bf21-958ca87b1703 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:19.442822636 +0000 UTC m=+2.123887068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rntq4" (UniqueName: "kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4") pod "network-check-target-bssgv" (UID: "93946ad2-a0c3-48e2-bf21-958ca87b1703") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:18.944770 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.944724    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph4b7\" (UniqueName: \"kubernetes.io/projected/fc65e853-284c-47b7-a0f6-022fa31d1a0d-kube-api-access-ph4b7\") pod \"node-resolver-zls2z\" (UID: \"fc65e853-284c-47b7-a0f6-022fa31d1a0d\") " pod="openshift-dns/node-resolver-zls2z"
Jul 27 15:48:18.945029 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.944977    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmqdh\" (UniqueName: \"kubernetes.io/projected/223cd87a-faae-4f56-88f2-14d5284a2c14-kube-api-access-xmqdh\") pod \"multus-t8qz8\" (UID: \"223cd87a-faae-4f56-88f2-14d5284a2c14\") " pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:18.945356 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.945330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kw2t\" (UniqueName: \"kubernetes.io/projected/d2b4d804-902a-462c-9597-6201391cd658-kube-api-access-2kw2t\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:18.945467 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.945449    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h686\" (UniqueName: \"kubernetes.io/projected/2ed3eff9-8de6-4a1e-af19-52e140aa4952-kube-api-access-8h686\") pod \"aws-ebs-csi-driver-node-hq64t\" (UID: \"2ed3eff9-8de6-4a1e-af19-52e140aa4952\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:18.945857 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.945838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndt44\" (UniqueName: \"kubernetes.io/projected/c0990436-6f55-4b52-93c6-64e871ee4661-kube-api-access-ndt44\") pod \"multus-additional-cni-plugins-s8gfr\" (UID: \"c0990436-6f55-4b52-93c6-64e871ee4661\") " pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:18.946462 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.946438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm84p\" (UniqueName: \"kubernetes.io/projected/2ca7316b-79a1-488e-9f95-7afaf9e1e775-kube-api-access-rm84p\") pod \"node-ca-ksdlr\" (UID: \"2ca7316b-79a1-488e-9f95-7afaf9e1e775\") " pod="openshift-image-registry/node-ca-ksdlr"
Jul 27 15:48:18.985979 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:18.985942    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d95d964f6f5196d055ec9fd47d5b92d.slice/crio-0d4f940ec0ed447845992c153abd3e57a40262461ffd218b66f5889a1898c115 WatchSource:0}: Error finding container 0d4f940ec0ed447845992c153abd3e57a40262461ffd218b66f5889a1898c115: Status 404 returned error can't find the container with id 0d4f940ec0ed447845992c153abd3e57a40262461ffd218b66f5889a1898c115
Jul 27 15:48:18.986400 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:18.986376    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91a83fc84345123f3da435634f47e28.slice/crio-c0f4ac6d38a9203336fa0f3166bb8c61b0a4324870f1d2c4da1d83136ab59f9d WatchSource:0}: Error finding container c0f4ac6d38a9203336fa0f3166bb8c61b0a4324870f1d2c4da1d83136ab59f9d: Status 404 returned error can't find the container with id c0f4ac6d38a9203336fa0f3166bb8c61b0a4324870f1d2c4da1d83136ab59f9d
Jul 27 15:48:18.992215 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:18.992200    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 15:48:19.034830 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.032837    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:19.035610 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.035580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jb55w"
Jul 27 15:48:19.041986 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.041970    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:19.044289 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:19.044267    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38b5f95_84d6_42fa_bce4_d5299a02b549.slice/crio-e15c7aba32ad655c456ab8f79759cf4a2dfe6c0f0ae1537e98ba2b94ae142506 WatchSource:0}: Error finding container e15c7aba32ad655c456ab8f79759cf4a2dfe6c0f0ae1537e98ba2b94ae142506: Status 404 returned error can't find the container with id e15c7aba32ad655c456ab8f79759cf4a2dfe6c0f0ae1537e98ba2b94ae142506
Jul 27 15:48:19.050163 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:19.050144    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb0452e_1b06_406d_8a5b_3b07372c12ff.slice/crio-e1eb0bb78411ca56fb9975558bd6ee589f2df92b5000ec24ec99f4ce1deecdaf WatchSource:0}: Error finding container e1eb0bb78411ca56fb9975558bd6ee589f2df92b5000ec24ec99f4ce1deecdaf: Status 404 returned error can't find the container with id e1eb0bb78411ca56fb9975558bd6ee589f2df92b5000ec24ec99f4ce1deecdaf
Jul 27 15:48:19.070473 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.070453    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4r989"
Jul 27 15:48:19.078244 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:19.078221    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7129b6_77d1_43c3_b929_21cfe9158de6.slice/crio-083e19e24a5c162f40a02b8b7c6b4ee44a518076ca5891dfd12807715af671bb WatchSource:0}: Error finding container 083e19e24a5c162f40a02b8b7c6b4ee44a518076ca5891dfd12807715af671bb: Status 404 returned error can't find the container with id 083e19e24a5c162f40a02b8b7c6b4ee44a518076ca5891dfd12807715af671bb
Jul 27 15:48:19.082591 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.082571    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:19.091425 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:19.091407    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab803008_f703_40f8_bacc_d3c05417c3de.slice/crio-f1a350274f722ea66b8fab74d227eba2f4efe387f23c0f0998081a5305551ee7 WatchSource:0}: Error finding container f1a350274f722ea66b8fab74d227eba2f4efe387f23c0f0998081a5305551ee7: Status 404 returned error can't find the container with id f1a350274f722ea66b8fab74d227eba2f4efe387f23c0f0998081a5305551ee7
Jul 27 15:48:19.097731 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.097713    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:19.104149 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.104131    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t"
Jul 27 15:48:19.110935 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:19.110914    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed3eff9_8de6_4a1e_af19_52e140aa4952.slice/crio-ac3e58dc8aa3e302873b588407e99d2f4c1104a80fb24f19883bbce4f59fd8df WatchSource:0}: Error finding container ac3e58dc8aa3e302873b588407e99d2f4c1104a80fb24f19883bbce4f59fd8df: Status 404 returned error can't find the container with id ac3e58dc8aa3e302873b588407e99d2f4c1104a80fb24f19883bbce4f59fd8df
Jul 27 15:48:19.119825 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.119809    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ksdlr"
Jul 27 15:48:19.126619 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:19.126599    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca7316b_79a1_488e_9f95_7afaf9e1e775.slice/crio-38ef7ed4ba37028336a36abe5ad6df9aa6734950fab42843cc6ef9938775997e WatchSource:0}: Error finding container 38ef7ed4ba37028336a36abe5ad6df9aa6734950fab42843cc6ef9938775997e: Status 404 returned error can't find the container with id 38ef7ed4ba37028336a36abe5ad6df9aa6734950fab42843cc6ef9938775997e
Jul 27 15:48:19.136722 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.136700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t8qz8"
Jul 27 15:48:19.143461 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:19.143430    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223cd87a_faae_4f56_88f2_14d5284a2c14.slice/crio-2f46709fe676f20146bf620298dc50d67343ff2a1dbdc74fe0c31ecb3e687e10 WatchSource:0}: Error finding container 2f46709fe676f20146bf620298dc50d67343ff2a1dbdc74fe0c31ecb3e687e10: Status 404 returned error can't find the container with id 2f46709fe676f20146bf620298dc50d67343ff2a1dbdc74fe0c31ecb3e687e10
Jul 27 15:48:19.162268 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.162242    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s8gfr"
Jul 27 15:48:19.169304 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:19.169283    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0990436_6f55_4b52_93c6_64e871ee4661.slice/crio-aa21a6441b8519a4483f592cb3ba9c210a0dcd3fa70ee6947f392944d5dbc203 WatchSource:0}: Error finding container aa21a6441b8519a4483f592cb3ba9c210a0dcd3fa70ee6947f392944d5dbc203: Status 404 returned error can't find the container with id aa21a6441b8519a4483f592cb3ba9c210a0dcd3fa70ee6947f392944d5dbc203
Jul 27 15:48:19.169861 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.169842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zls2z"
Jul 27 15:48:19.177782 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:19.177762    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc65e853_284c_47b7_a0f6_022fa31d1a0d.slice/crio-9bb6734778be7408924f9d057646374668f7ecf7b87274a33a576410d50a0288 WatchSource:0}: Error finding container 9bb6734778be7408924f9d057646374668f7ecf7b87274a33a576410d50a0288: Status 404 returned error can't find the container with id 9bb6734778be7408924f9d057646374668f7ecf7b87274a33a576410d50a0288
Jul 27 15:48:19.179325 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.179306    2579 kuberuntime_manager.go:1459] "Unhandled Error" err="container dns-node-resolver start failed in pod node-resolver-zls2z_openshift-dns(fc65e853-284c-47b7-a0f6-022fa31d1a0d): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 27 15:48:19.179371 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.179337    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-dns/node-resolver-zls2z" podUID="fc65e853-284c-47b7-a0f6-022fa31d1a0d"
Jul 27 15:48:19.337936 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.337862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:19.338043 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.338001    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:19.338106 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.338067    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret podName:d3b7a762-4b09-4df3-878f-304637a41ed9 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:20.338047721 +0000 UTC m=+3.019112150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret") pod "global-pull-secret-syncer-44z5d" (UID: "d3b7a762-4b09-4df3-878f-304637a41ed9") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:19.438313 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.438285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:19.438409 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.438401    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:19.438465 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.438454    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs podName:d2b4d804-902a-462c-9597-6201391cd658 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:20.438440041 +0000 UTC m=+3.119504450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs") pod "network-metrics-daemon-sng2j" (UID: "d2b4d804-902a-462c-9597-6201391cd658") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:19.538994 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.538968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntq4\" (UniqueName: \"kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4\") pod \"network-check-target-bssgv\" (UID: \"93946ad2-a0c3-48e2-bf21-958ca87b1703\") " pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:19.539163 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.539095    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:19.539163 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.539108    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:19.539163 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.539117    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rntq4 for pod openshift-network-diagnostics/network-check-target-bssgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:19.539163 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.539171    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4 podName:93946ad2-a0c3-48e2-bf21-958ca87b1703 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:20.539158336 +0000 UTC m=+3.220222746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rntq4" (UniqueName: "kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4") pod "network-check-target-bssgv" (UID: "93946ad2-a0c3-48e2-bf21-958ca87b1703") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:19.791197 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.791021    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 15:43:19 +0000 UTC" deadline="2028-03-19 14:10:52.662548564 +0000 UTC"
Jul 27 15:48:19.791197 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.791085    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14422h22m32.871468019s"
Jul 27 15:48:19.799203 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.798992    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:19.926856 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.924645    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:19.926856 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.924785    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:19.926856 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.925202    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:19.926856 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.925312    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:19.932712 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.932657    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8gfr" event={"ID":"c0990436-6f55-4b52-93c6-64e871ee4661","Type":"ContainerStarted","Data":"aa21a6441b8519a4483f592cb3ba9c210a0dcd3fa70ee6947f392944d5dbc203"}
Jul 27 15:48:19.939136 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.939107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t" event={"ID":"2ed3eff9-8de6-4a1e-af19-52e140aa4952","Type":"ContainerStarted","Data":"ac3e58dc8aa3e302873b588407e99d2f4c1104a80fb24f19883bbce4f59fd8df"}
Jul 27 15:48:19.946116 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.946085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5htdh" event={"ID":"3fb0452e-1b06-406d-8a5b-3b07372c12ff","Type":"ContainerStarted","Data":"e1eb0bb78411ca56fb9975558bd6ee589f2df92b5000ec24ec99f4ce1deecdaf"}
Jul 27 15:48:19.951313 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.951243    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal" event={"ID":"d91a83fc84345123f3da435634f47e28","Type":"ContainerStarted","Data":"c0f4ac6d38a9203336fa0f3166bb8c61b0a4324870f1d2c4da1d83136ab59f9d"}
Jul 27 15:48:19.958199 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.957882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t8qz8" event={"ID":"223cd87a-faae-4f56-88f2-14d5284a2c14","Type":"ContainerStarted","Data":"2f46709fe676f20146bf620298dc50d67343ff2a1dbdc74fe0c31ecb3e687e10"}
Jul 27 15:48:19.960951 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.960883    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ksdlr" event={"ID":"2ca7316b-79a1-488e-9f95-7afaf9e1e775","Type":"ContainerStarted","Data":"38ef7ed4ba37028336a36abe5ad6df9aa6734950fab42843cc6ef9938775997e"}
Jul 27 15:48:19.963226 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.963113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2" event={"ID":"ab803008-f703-40f8-bacc-d3c05417c3de","Type":"ContainerStarted","Data":"f1a350274f722ea66b8fab74d227eba2f4efe387f23c0f0998081a5305551ee7"}
Jul 27 15:48:19.966820 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.966793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4r989" event={"ID":"6e7129b6-77d1-43c3-b929-21cfe9158de6","Type":"ContainerStarted","Data":"083e19e24a5c162f40a02b8b7c6b4ee44a518076ca5891dfd12807715af671bb"}
Jul 27 15:48:19.970099 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.970035    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jb55w" event={"ID":"d38b5f95-84d6-42fa-bce4-d5299a02b549","Type":"ContainerStarted","Data":"e15c7aba32ad655c456ab8f79759cf4a2dfe6c0f0ae1537e98ba2b94ae142506"}
Jul 27 15:48:19.972405 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.972379    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal" event={"ID":"4d95d964f6f5196d055ec9fd47d5b92d","Type":"ContainerStarted","Data":"0d4f940ec0ed447845992c153abd3e57a40262461ffd218b66f5889a1898c115"}
Jul 27 15:48:19.974319 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:19.974296    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zls2z" event={"ID":"fc65e853-284c-47b7-a0f6-022fa31d1a0d","Type":"ContainerStarted","Data":"9bb6734778be7408924f9d057646374668f7ecf7b87274a33a576410d50a0288"}
Jul 27 15:48:19.975933 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:19.975905    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dns-node-resolver\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:233b9dfa42a292bdae9563a0cfb304f006bf4cf1f75229e9b3147c1019c74859\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-dns/node-resolver-zls2z" podUID="fc65e853-284c-47b7-a0f6-022fa31d1a0d"
Jul 27 15:48:20.346007 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:20.345896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:20.346244 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:20.346102    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:20.346244 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:20.346167    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret podName:d3b7a762-4b09-4df3-878f-304637a41ed9 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:22.346147683 +0000 UTC m=+5.027212116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret") pod "global-pull-secret-syncer-44z5d" (UID: "d3b7a762-4b09-4df3-878f-304637a41ed9") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:20.447213 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:20.447181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:20.447390 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:20.447355    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:20.447465 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:20.447427    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs podName:d2b4d804-902a-462c-9597-6201391cd658 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:22.447405851 +0000 UTC m=+5.128470267 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs") pod "network-metrics-daemon-sng2j" (UID: "d2b4d804-902a-462c-9597-6201391cd658") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:20.548388 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:20.548349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntq4\" (UniqueName: \"kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4\") pod \"network-check-target-bssgv\" (UID: \"93946ad2-a0c3-48e2-bf21-958ca87b1703\") " pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:20.548584 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:20.548559    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:20.548584 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:20.548583    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:20.548708 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:20.548597    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rntq4 for pod openshift-network-diagnostics/network-check-target-bssgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:20.548708 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:20.548663    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4 podName:93946ad2-a0c3-48e2-bf21-958ca87b1703 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:22.548640526 +0000 UTC m=+5.229704954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rntq4" (UniqueName: "kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4") pod "network-check-target-bssgv" (UID: "93946ad2-a0c3-48e2-bf21-958ca87b1703") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:20.791847 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:20.791752    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 15:43:19 +0000 UTC" deadline="2028-01-30 08:34:16.78705671 +0000 UTC"
Jul 27 15:48:20.791847 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:20.791800    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13240h45m55.995262555s"
Jul 27 15:48:20.924528 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:20.924478    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:20.924723 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:20.924623    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:21.741730 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:21.741480    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 15:48:21.927390 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:21.927282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:21.927909 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:21.927423    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:21.927909 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:21.927847    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:21.928053 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:21.927942    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:22.378199 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:22.378107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:22.378450 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:22.378355    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:22.378534 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:22.378466    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret podName:d3b7a762-4b09-4df3-878f-304637a41ed9 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:26.378447105 +0000 UTC m=+9.059511521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret") pod "global-pull-secret-syncer-44z5d" (UID: "d3b7a762-4b09-4df3-878f-304637a41ed9") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:22.479141 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:22.479104    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:22.479304 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:22.479283    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:22.479385 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:22.479349    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs podName:d2b4d804-902a-462c-9597-6201391cd658 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:26.479329027 +0000 UTC m=+9.160393443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs") pod "network-metrics-daemon-sng2j" (UID: "d2b4d804-902a-462c-9597-6201391cd658") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:22.580865 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:22.580316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntq4\" (UniqueName: \"kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4\") pod \"network-check-target-bssgv\" (UID: \"93946ad2-a0c3-48e2-bf21-958ca87b1703\") " pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:22.580865 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:22.580542    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:22.580865 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:22.580570    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:22.580865 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:22.580585    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rntq4 for pod openshift-network-diagnostics/network-check-target-bssgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:22.580865 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:22.580682    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4 podName:93946ad2-a0c3-48e2-bf21-958ca87b1703 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:26.580642314 +0000 UTC m=+9.261706747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rntq4" (UniqueName: "kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4") pod "network-check-target-bssgv" (UID: "93946ad2-a0c3-48e2-bf21-958ca87b1703") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:22.924476 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:22.924442    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:22.924708 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:22.924607    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:23.925063 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:23.925025    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:23.925609 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:23.925165    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:23.925609 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:23.925538    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:23.925742 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:23.925670    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:24.924330 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:24.924289    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:24.924546 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:24.924435    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:25.928217 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:25.928147    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:25.928217 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:25.928182    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:25.928725 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:25.928264    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:25.928725 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:25.928361    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:26.414805 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:26.414650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:26.414970 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:26.414815    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:26.414970 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:26.414886    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret podName:d3b7a762-4b09-4df3-878f-304637a41ed9 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:34.414866402 +0000 UTC m=+17.095930814 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret") pod "global-pull-secret-syncer-44z5d" (UID: "d3b7a762-4b09-4df3-878f-304637a41ed9") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:26.516291 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:26.515768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:26.516291 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:26.515914    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:26.516291 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:26.515973    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs podName:d2b4d804-902a-462c-9597-6201391cd658 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:34.515955058 +0000 UTC m=+17.197019487 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs") pod "network-metrics-daemon-sng2j" (UID: "d2b4d804-902a-462c-9597-6201391cd658") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:26.617179 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:26.616910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntq4\" (UniqueName: \"kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4\") pod \"network-check-target-bssgv\" (UID: \"93946ad2-a0c3-48e2-bf21-958ca87b1703\") " pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:26.617179 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:26.617078    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:26.617179 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:26.617103    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:26.617179 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:26.617117    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rntq4 for pod openshift-network-diagnostics/network-check-target-bssgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:26.617179 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:26.617174    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4 podName:93946ad2-a0c3-48e2-bf21-958ca87b1703 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:34.617153527 +0000 UTC m=+17.298217939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rntq4" (UniqueName: "kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4") pod "network-check-target-bssgv" (UID: "93946ad2-a0c3-48e2-bf21-958ca87b1703") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:26.924643 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:26.924607    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:26.924832 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:26.924744    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:27.926035 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:27.925993    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:27.926522 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:27.926153    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:27.926522 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:27.926229    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:27.926522 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:27.926312    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:28.924378 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:28.924341    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:28.924586 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:28.924510    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:29.927675 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:29.927645    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:29.928087 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:29.927773    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:29.928087 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:29.927835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:29.928087 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:29.927962    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:30.924256 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:30.924224    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:30.924409 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:30.924360    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:31.928540 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:31.928491    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:31.928540 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:31.928539    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:31.929073 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:31.928629    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:31.929073 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:31.928732    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:32.924900 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:32.924871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:32.925088 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:32.924983    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:33.924592 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:33.924520    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:33.924988 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:33.924521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:33.924988 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:33.924640    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:33.924988 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:33.924739    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:34.468810 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:34.468770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:34.469107 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:34.468940    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:34.469107 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:34.469043    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret podName:d3b7a762-4b09-4df3-878f-304637a41ed9 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:50.469022181 +0000 UTC m=+33.150086592 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret") pod "global-pull-secret-syncer-44z5d" (UID: "d3b7a762-4b09-4df3-878f-304637a41ed9") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:34.570020 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:34.569984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:34.570170 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:34.570153    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:34.570242 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:34.570232    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs podName:d2b4d804-902a-462c-9597-6201391cd658 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:50.570200864 +0000 UTC m=+33.251265280 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs") pod "network-metrics-daemon-sng2j" (UID: "d2b4d804-902a-462c-9597-6201391cd658") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:34.671371 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:34.671333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntq4\" (UniqueName: \"kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4\") pod \"network-check-target-bssgv\" (UID: \"93946ad2-a0c3-48e2-bf21-958ca87b1703\") " pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:34.671572 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:34.671488    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:34.671572 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:34.671522    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:34.671572 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:34.671533    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rntq4 for pod openshift-network-diagnostics/network-check-target-bssgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:34.671694 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:34.671593    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4 podName:93946ad2-a0c3-48e2-bf21-958ca87b1703 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:50.671574508 +0000 UTC m=+33.352638922 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rntq4" (UniqueName: "kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4") pod "network-check-target-bssgv" (UID: "93946ad2-a0c3-48e2-bf21-958ca87b1703") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:34.924135 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:34.924058    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:34.924301 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:34.924190    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:35.924833 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:35.924590    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:35.925302 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:35.924946    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:35.925302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:35.924649    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:35.925302 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:35.925122    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:36.924320 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:36.924285    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:36.924510 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:36.924399    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:37.925008 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:37.924950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:37.925441 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:37.925086    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:37.925441 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:37.925147    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:37.925441 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:37.925248    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:38.924962 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:38.924800    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:38.925078 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:38.925061    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:39.015267 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.015207    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zls2z" event={"ID":"fc65e853-284c-47b7-a0f6-022fa31d1a0d","Type":"ContainerStarted","Data":"88d3a568894540357949449d9f2eae480070147241c86f4def61628cc2b56df4"}
Jul 27 15:48:39.016633 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.016608    2579 generic.go:356] "Generic (PLEG): container finished" podID="c0990436-6f55-4b52-93c6-64e871ee4661" containerID="2edffa70f41e6f6859e52d2841bcbe2b4ed75e76b03828a57c13e043e914e354" exitCode=0
Jul 27 15:48:39.016744 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.016676    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8gfr" event={"ID":"c0990436-6f55-4b52-93c6-64e871ee4661","Type":"ContainerDied","Data":"2edffa70f41e6f6859e52d2841bcbe2b4ed75e76b03828a57c13e043e914e354"}
Jul 27 15:48:39.018335 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.018314    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t" event={"ID":"2ed3eff9-8de6-4a1e-af19-52e140aa4952","Type":"ContainerStarted","Data":"f4e4dfd6c8782708b412f0a391bd74a39b4892a241e191ebcc749c481b0537dc"}
Jul 27 15:48:39.019586 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.019559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5htdh" event={"ID":"3fb0452e-1b06-406d-8a5b-3b07372c12ff","Type":"ContainerStarted","Data":"77ca822f8632ffd02409b87e5ee72bebfe9d2f91764f8308280fa0527fb0c768"}
Jul 27 15:48:39.020817 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.020798    2579 generic.go:356] "Generic (PLEG): container finished" podID="d91a83fc84345123f3da435634f47e28" containerID="95b2814bc8504522592704fccf025188f83c73419b92881d31e357347e8fb95c" exitCode=0
Jul 27 15:48:39.020886 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.020860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal" event={"ID":"d91a83fc84345123f3da435634f47e28","Type":"ContainerDied","Data":"95b2814bc8504522592704fccf025188f83c73419b92881d31e357347e8fb95c"}
Jul 27 15:48:39.022326 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.022304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t8qz8" event={"ID":"223cd87a-faae-4f56-88f2-14d5284a2c14","Type":"ContainerStarted","Data":"ca318a2859306f41d0b627ebcf6f5c71f46e3cdbf8c7e26f5975e2ecc712be2b"}
Jul 27 15:48:39.023772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.023752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ksdlr" event={"ID":"2ca7316b-79a1-488e-9f95-7afaf9e1e775","Type":"ContainerStarted","Data":"c9391220494399d48fb0d9edcad19ba6fdd41ebc07ee52edea80f6c41072bc31"}
Jul 27 15:48:39.026791 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.026771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2" event={"ID":"ab803008-f703-40f8-bacc-d3c05417c3de","Type":"ContainerStarted","Data":"409e08fa509e3d6a36e94813e383fd18f8dc2533ff52d06e51a90fc8d888209a"}
Jul 27 15:48:39.026864 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.026824    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2" event={"ID":"ab803008-f703-40f8-bacc-d3c05417c3de","Type":"ContainerStarted","Data":"db2f1ac93db5824d8196d624caac1131f95356e25d7670b6fb36342d9c5b8e72"}
Jul 27 15:48:39.026902 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.026861    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2" event={"ID":"ab803008-f703-40f8-bacc-d3c05417c3de","Type":"ContainerStarted","Data":"155676cc1236aee6a17eace6b5b0eaba14b345d893d108ed17ce0e3ace6db424"}
Jul 27 15:48:39.026934 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.026914    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2" event={"ID":"ab803008-f703-40f8-bacc-d3c05417c3de","Type":"ContainerStarted","Data":"3f236c9cddbad625beeed584066fa028c748ee0aa05b5f1f11a1f5e25699a949"}
Jul 27 15:48:39.026964 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.026950    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2" event={"ID":"ab803008-f703-40f8-bacc-d3c05417c3de","Type":"ContainerStarted","Data":"91f60bf7926a32d4cee02fcf84734e34670703daf5653f3268227868bbebedca"}
Jul 27 15:48:39.027014 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.026978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2" event={"ID":"ab803008-f703-40f8-bacc-d3c05417c3de","Type":"ContainerStarted","Data":"6234a1466288ef6efce15982076a0ba1c57304a6cfcd05e6900a0f1758a509dc"}
Jul 27 15:48:39.028106 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.028087    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jb55w" event={"ID":"d38b5f95-84d6-42fa-bce4-d5299a02b549","Type":"ContainerStarted","Data":"51f378021b85ecf6c0e64bc4840f19d706977a70393eba899f0f7883e9e90611"}
Jul 27 15:48:39.029576 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.029552    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal" event={"ID":"4d95d964f6f5196d055ec9fd47d5b92d","Type":"ContainerStarted","Data":"b430aa96955fabf2d93c742ea39909830e699c60bf6b8eaa173cf4060a2247e9"}
Jul 27 15:48:39.030819 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.030774    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zls2z" podStartSLOduration=21.030760608 podStartE2EDuration="21.030760608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-27 15:48:39.030127688 +0000 UTC m=+21.711192119" watchObservedRunningTime="2026-07-27 15:48:39.030760608 +0000 UTC m=+21.711825038"
Jul 27 15:48:39.044535 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.044468    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jb55w" podStartSLOduration=1.770344234 podStartE2EDuration="21.044459718s" totalImagesPullingTime="19.274115484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:39.044423072 +0000 UTC m=+21.725487502" watchObservedRunningTime="2026-07-27 15:48:39.044459718 +0000 UTC m=+21.725524144"
Jul 27 15:48:39.058156 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.057993    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5htdh" podStartSLOduration=1.834656189 podStartE2EDuration="21.057981486s" totalImagesPullingTime="19.223325297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:39.057780142 +0000 UTC m=+21.738844572" watchObservedRunningTime="2026-07-27 15:48:39.057981486 +0000 UTC m=+21.739045916"
Jul 27 15:48:39.097244 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.097202    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ksdlr" podStartSLOduration=1.950542829 podStartE2EDuration="21.097187978s" totalImagesPullingTime="19.146645149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:39.096753813 +0000 UTC m=+21.777818239" watchObservedRunningTime="2026-07-27 15:48:39.097187978 +0000 UTC m=+21.778252409"
Jul 27 15:48:39.112366 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.112325    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t8qz8" podStartSLOduration=1.927344065 podStartE2EDuration="21.112310672s" totalImagesPullingTime="19.184966607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:39.112282231 +0000 UTC m=+21.793346660" watchObservedRunningTime="2026-07-27 15:48:39.112310672 +0000 UTC m=+21.793375101"
Jul 27 15:48:39.148804 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.148758    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-146.ec2.internal" podStartSLOduration=21.148744907 podStartE2EDuration="21.148744907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:39.148451397 +0000 UTC m=+21.829515825" watchObservedRunningTime="2026-07-27 15:48:39.148744907 +0000 UTC m=+21.829809335"
Jul 27 15:48:39.925180 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.925149    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:39.925638 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:39.925116    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:39.925638 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:39.925275    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:39.925638 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:39.925365    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:40.033404 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:40.033367    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4r989" event={"ID":"6e7129b6-77d1-43c3-b929-21cfe9158de6","Type":"ContainerStarted","Data":"0c497ab4494fe024d2a74ec1171f411010cdc675478f801f2c8b044ad17d9310"}
Jul 27 15:48:40.035966 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:40.035935    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal" event={"ID":"d91a83fc84345123f3da435634f47e28","Type":"ContainerStarted","Data":"c0de6df0dff7ef8ad41029a02ce175904f5ced6e5d5040ddb76b41707a228e69"}
Jul 27 15:48:40.047554 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:40.047514    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4r989" podStartSLOduration=2.85256488 podStartE2EDuration="22.047485915s" totalImagesPullingTime="19.194921035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:40.047206236 +0000 UTC m=+22.728270665" watchObservedRunningTime="2026-07-27 15:48:40.047485915 +0000 UTC m=+22.728550343"
Jul 27 15:48:40.064440 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:40.064384    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-146.ec2.internal" podStartSLOduration=21.064366224 podStartE2EDuration="21.064366224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:40.063560801 +0000 UTC m=+22.744625231" watchObservedRunningTime="2026-07-27 15:48:40.064366224 +0000 UTC m=+22.745430655"
Jul 27 15:48:40.426125 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:40.426100    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 15:48:40.801635 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:40.801524    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T15:48:40.426119871Z","UUID":"37a2ae10-c7cd-4160-8e95-2da994dfb26b","Handler":null,"Name":"","Endpoint":""}
Jul 27 15:48:40.803024 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:40.803002    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 15:48:40.803139 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:40.803048    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 15:48:40.924916 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:40.924891    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:40.925186 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:40.925009    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:41.041107 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:41.041021    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t" event={"ID":"2ed3eff9-8de6-4a1e-af19-52e140aa4952","Type":"ContainerStarted","Data":"5a96f6ab1955578744ad39dcf23f3f018cc21d91310a1c1c228cecffe8b490ce"}
Jul 27 15:48:41.357758 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:41.357680    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:41.358376 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:41.358353    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:41.924628 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:41.924602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:41.924879 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:41.924611    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:41.924879 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:41.924709    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:41.924879 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:41.924804    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:42.047155 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:42.047121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2" event={"ID":"ab803008-f703-40f8-bacc-d3c05417c3de","Type":"ContainerStarted","Data":"55ac672bd7b77df37507eb838e2e1b53f53fae1f36aae55acfddcca5ce8e21e5"}
Jul 27 15:48:42.047630 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:42.047344    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:42.047958 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:42.047940    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5htdh"
Jul 27 15:48:42.924611 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:42.924576    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:42.924802 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:42.924710    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:43.925077 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:43.924877    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:43.925884 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:43.924959    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:43.925884 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:43.925158    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:43.925884 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:43.925213    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:44.057287 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:44.057250    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2" event={"ID":"ab803008-f703-40f8-bacc-d3c05417c3de","Type":"ContainerStarted","Data":"bcf583f8f8df687ce84f380ad0f4f58c5bd0d47f2cc0e0e017ba965925d68e57"}
Jul 27 15:48:44.057522 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:44.057468    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:44.057621 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:44.057555    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:44.059268 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:44.059242    2579 generic.go:356] "Generic (PLEG): container finished" podID="c0990436-6f55-4b52-93c6-64e871ee4661" containerID="1e2302b6bb755fcb862d7751de60600fd93837a0d7bbc205fc984e70cc7994bc" exitCode=0
Jul 27 15:48:44.059393 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:44.059317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8gfr" event={"ID":"c0990436-6f55-4b52-93c6-64e871ee4661","Type":"ContainerDied","Data":"1e2302b6bb755fcb862d7751de60600fd93837a0d7bbc205fc984e70cc7994bc"}
Jul 27 15:48:44.061729 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:44.061691    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t" event={"ID":"2ed3eff9-8de6-4a1e-af19-52e140aa4952","Type":"ContainerStarted","Data":"53c73f9ac1f527bc53b1ad5ee8673e9fe1b6555643e2ec87f8a18cf5c48fa039"}
Jul 27 15:48:44.073447 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:44.073423    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:44.073597 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:44.073582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:44.081708 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:44.081675    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2" podStartSLOduration=6.778595219 podStartE2EDuration="26.081662811s" totalImagesPullingTime="19.303067592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:44.081103123 +0000 UTC m=+26.762167553" watchObservedRunningTime="2026-07-27 15:48:44.081662811 +0000 UTC m=+26.762727219"
Jul 27 15:48:44.139677 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:44.139644    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hq64t" podStartSLOduration=2.651680848 podStartE2EDuration="26.139631723s" totalImagesPullingTime="23.487950875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:44.139332929 +0000 UTC m=+26.820397357" watchObservedRunningTime="2026-07-27 15:48:44.139631723 +0000 UTC m=+26.820696152"
Jul 27 15:48:44.924868 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:44.924839    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:44.925105 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:44.925000    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:45.065139 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:45.065102    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:48:45.336838 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:45.336631    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sng2j"]
Jul 27 15:48:45.337078 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:45.336923    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:45.337078 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:45.337045    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:45.339247 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:45.339225    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bssgv"]
Jul 27 15:48:45.339371 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:45.339311    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:45.339416 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:45.339383    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:45.347848 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:45.347826    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-44z5d"]
Jul 27 15:48:45.347962 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:45.347920    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:45.348037 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:45.348014    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:46.068885 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:46.068807    2579 generic.go:356] "Generic (PLEG): container finished" podID="c0990436-6f55-4b52-93c6-64e871ee4661" containerID="6ba877c867bcec691fe3c1aaafe543757807006bf089b489d462ad9a5b88d7d9" exitCode=0
Jul 27 15:48:46.069246 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:46.068887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8gfr" event={"ID":"c0990436-6f55-4b52-93c6-64e871ee4661","Type":"ContainerDied","Data":"6ba877c867bcec691fe3c1aaafe543757807006bf089b489d462ad9a5b88d7d9"}
Jul 27 15:48:46.924336 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:46.924307    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:46.924483 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:46.924398    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:46.924483 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:46.924419    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:46.924483 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:46.924414    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:46.924625 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:46.924488    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:46.924625 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:46.924594    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:48.074884 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:48.074850    2579 generic.go:356] "Generic (PLEG): container finished" podID="c0990436-6f55-4b52-93c6-64e871ee4661" containerID="d665433c12302c46c9e980f2ae5be6cabd6b03f762e26d78898fa6c8c190c1ef" exitCode=0
Jul 27 15:48:48.075213 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:48.074925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8gfr" event={"ID":"c0990436-6f55-4b52-93c6-64e871ee4661","Type":"ContainerDied","Data":"d665433c12302c46c9e980f2ae5be6cabd6b03f762e26d78898fa6c8c190c1ef"}
Jul 27 15:48:48.924487 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:48.924450    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:48.924487 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:48.924476    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:48.924735 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:48.924450    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:48.924735 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:48.924605    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:48.924735 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:48.924674    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:48.924735 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:48.924733    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:50.486742 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:50.486710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:50.487140 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:50.486885    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:50.487140 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:50.486963    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret podName:d3b7a762-4b09-4df3-878f-304637a41ed9 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:22.486941933 +0000 UTC m=+65.168006343 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret") pod "global-pull-secret-syncer-44z5d" (UID: "d3b7a762-4b09-4df3-878f-304637a41ed9") : object "kube-system"/"original-pull-secret" not registered
Jul 27 15:48:50.587178 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:50.587143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:50.587344 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:50.587273    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:50.587405 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:50.587349    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs podName:d2b4d804-902a-462c-9597-6201391cd658 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:22.587329431 +0000 UTC m=+65.268393858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs") pod "network-metrics-daemon-sng2j" (UID: "d2b4d804-902a-462c-9597-6201391cd658") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 15:48:50.687511 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:50.687463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntq4\" (UniqueName: \"kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4\") pod \"network-check-target-bssgv\" (UID: \"93946ad2-a0c3-48e2-bf21-958ca87b1703\") " pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:50.687689 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:50.687640    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 15:48:50.687689 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:50.687663    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 15:48:50.687689 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:50.687677    2579 projected.go:196] Error preparing data for projected volume kube-api-access-rntq4 for pod openshift-network-diagnostics/network-check-target-bssgv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:50.687830 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:50.687739    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4 podName:93946ad2-a0c3-48e2-bf21-958ca87b1703 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:22.687720491 +0000 UTC m=+65.368784907 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rntq4" (UniqueName: "kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4") pod "network-check-target-bssgv" (UID: "93946ad2-a0c3-48e2-bf21-958ca87b1703") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 15:48:50.924406 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:50.924173    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:50.924532 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:50.924212    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:50.924607 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:50.924520    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bssgv" podUID="93946ad2-a0c3-48e2-bf21-958ca87b1703"
Jul 27 15:48:50.924607 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:50.924220    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:50.924607 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:50.924591    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44z5d" podUID="d3b7a762-4b09-4df3-878f-304637a41ed9"
Jul 27 15:48:50.924730 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:50.924678    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:48:51.168268 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.168198    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-146.ec2.internal" event="NodeReady"
Jul 27 15:48:51.168433 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.168346    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 15:48:51.202128 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.202097    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7df4777f9c-6xjw6"]
Jul 27 15:48:51.204816 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.204795    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.206959 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.206931    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 15:48:51.207071 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.206980    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-twmt9\""
Jul 27 15:48:51.207071 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.206998    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 15:48:51.207071 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.207043    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 15:48:51.213745 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.213192    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 15:48:51.218042 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.218012    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rm56l"]
Jul 27 15:48:51.219661 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.219641    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7cpkh"]
Jul 27 15:48:51.219775 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.219761    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rm56l"
Jul 27 15:48:51.221743 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.221628    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df4777f9c-6xjw6"]
Jul 27 15:48:51.221743 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.221718    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.222123 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.222086    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-54wz2\""
Jul 27 15:48:51.222370 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.222330    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 15:48:51.222476 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.222363    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 15:48:51.222678 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.222659    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 15:48:51.223512 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.223482    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-748tg\""
Jul 27 15:48:51.223789 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.223770    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 15:48:51.223943 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.223927    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 15:48:51.229448 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.229428    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rm56l"]
Jul 27 15:48:51.232769 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.232733    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7cpkh"]
Jul 27 15:48:51.291679 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.291652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmcsf\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-kube-api-access-nmcsf\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.291802 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.291697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30247dd9-36f2-4249-ba97-2a7f90944475-ca-trust-extracted\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.291802 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.291775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/931dac23-0e51-4f5c-958a-88d3da987537-cert\") pod \"ingress-canary-rm56l\" (UID: \"931dac23-0e51-4f5c-958a-88d3da987537\") " pod="openshift-ingress-canary/ingress-canary-rm56l"
Jul 27 15:48:51.291940 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.291812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-registry-certificates\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.291940 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.291844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-trusted-ca\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.291940 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.291862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-installation-pull-secrets\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.291940 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.291902    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-image-registry-private-configuration\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.291940 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.291938    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-bound-sa-token\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.292125 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.291958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.292125 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.292011    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzqpq\" (UniqueName: \"kubernetes.io/projected/931dac23-0e51-4f5c-958a-88d3da987537-kube-api-access-dzqpq\") pod \"ingress-canary-rm56l\" (UID: \"931dac23-0e51-4f5c-958a-88d3da987537\") " pod="openshift-ingress-canary/ingress-canary-rm56l"
Jul 27 15:48:51.393120 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.393259 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393153    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzqpq\" (UniqueName: \"kubernetes.io/projected/931dac23-0e51-4f5c-958a-88d3da987537-kube-api-access-dzqpq\") pod \"ingress-canary-rm56l\" (UID: \"931dac23-0e51-4f5c-958a-88d3da987537\") " pod="openshift-ingress-canary/ingress-canary-rm56l"
Jul 27 15:48:51.393259 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmcsf\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-kube-api-access-nmcsf\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.393259 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:51.393203    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:48:51.393259 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01000c87-df01-472f-bd6c-e64b199bcc35-config-volume\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.393259 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:51.393220    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4777f9c-6xjw6: secret "image-registry-tls" not found
Jul 27 15:48:51.393259 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30247dd9-36f2-4249-ba97-2a7f90944475-ca-trust-extracted\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.393586 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:51.393289    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls podName:30247dd9-36f2-4249-ba97-2a7f90944475 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:51.893270084 +0000 UTC m=+34.574334514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls") pod "image-registry-7df4777f9c-6xjw6" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475") : secret "image-registry-tls" not found
Jul 27 15:48:51.393586 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/931dac23-0e51-4f5c-958a-88d3da987537-cert\") pod \"ingress-canary-rm56l\" (UID: \"931dac23-0e51-4f5c-958a-88d3da987537\") " pod="openshift-ingress-canary/ingress-canary-rm56l"
Jul 27 15:48:51.393586 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.393586 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01000c87-df01-472f-bd6c-e64b199bcc35-tmp-dir\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.393586 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-registry-certificates\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.393586 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-trusted-ca\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.393586 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-installation-pull-secrets\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.393877 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393627    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-image-registry-private-configuration\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.393877 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393669    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30247dd9-36f2-4249-ba97-2a7f90944475-ca-trust-extracted\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.393877 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-bound-sa-token\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.393877 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnl4c\" (UniqueName: \"kubernetes.io/projected/01000c87-df01-472f-bd6c-e64b199bcc35-kube-api-access-nnl4c\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.394054 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.393987    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-registry-certificates\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.394525 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.394486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-trusted-ca\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.397834 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.397813    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-installation-pull-secrets\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.397936 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.397838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/931dac23-0e51-4f5c-958a-88d3da987537-cert\") pod \"ingress-canary-rm56l\" (UID: \"931dac23-0e51-4f5c-958a-88d3da987537\") " pod="openshift-ingress-canary/ingress-canary-rm56l"
Jul 27 15:48:51.397936 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.397837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-image-registry-private-configuration\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.403437 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.403394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzqpq\" (UniqueName: \"kubernetes.io/projected/931dac23-0e51-4f5c-958a-88d3da987537-kube-api-access-dzqpq\") pod \"ingress-canary-rm56l\" (UID: \"931dac23-0e51-4f5c-958a-88d3da987537\") " pod="openshift-ingress-canary/ingress-canary-rm56l"
Jul 27 15:48:51.407646 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.407621    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-bound-sa-token\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.407977 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.407956    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmcsf\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-kube-api-access-nmcsf\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.494652 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.494586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnl4c\" (UniqueName: \"kubernetes.io/projected/01000c87-df01-472f-bd6c-e64b199bcc35-kube-api-access-nnl4c\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.494652 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.494643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01000c87-df01-472f-bd6c-e64b199bcc35-config-volume\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.495124 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.494693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.495124 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.494720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01000c87-df01-472f-bd6c-e64b199bcc35-tmp-dir\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.495124 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:51.494847    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:48:51.495124 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:51.494928    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls podName:01000c87-df01-472f-bd6c-e64b199bcc35 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:51.994908504 +0000 UTC m=+34.675972912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls") pod "dns-default-7cpkh" (UID: "01000c87-df01-472f-bd6c-e64b199bcc35") : secret "dns-default-metrics-tls" not found
Jul 27 15:48:51.495124 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.495068    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/01000c87-df01-472f-bd6c-e64b199bcc35-tmp-dir\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.495379 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.495335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/01000c87-df01-472f-bd6c-e64b199bcc35-config-volume\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.503434 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.503409    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnl4c\" (UniqueName: \"kubernetes.io/projected/01000c87-df01-472f-bd6c-e64b199bcc35-kube-api-access-nnl4c\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.530863 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.530844    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rm56l"
Jul 27 15:48:51.898797 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.898756    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:51.898964 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:51.898882    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:48:51.898964 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:51.898894    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4777f9c-6xjw6: secret "image-registry-tls" not found
Jul 27 15:48:51.898964 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:51.898954    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls podName:30247dd9-36f2-4249-ba97-2a7f90944475 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:52.898937734 +0000 UTC m=+35.580002143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls") pod "image-registry-7df4777f9c-6xjw6" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475") : secret "image-registry-tls" not found
Jul 27 15:48:51.999718 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:51.999681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:51.999852 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:51.999825    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:48:51.999893 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:51.999885    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls podName:01000c87-df01-472f-bd6c-e64b199bcc35 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:52.999870918 +0000 UTC m=+35.680935328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls") pod "dns-default-7cpkh" (UID: "01000c87-df01-472f-bd6c-e64b199bcc35") : secret "dns-default-metrics-tls" not found
Jul 27 15:48:52.118653 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:52.118619    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rm56l"]
Jul 27 15:48:52.122592 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:48:52.122561    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931dac23_0e51_4f5c_958a_88d3da987537.slice/crio-1153bbdbb3794dac22317cf935773f032f86c3c9d2377f6ec77929fe06cdbb7a WatchSource:0}: Error finding container 1153bbdbb3794dac22317cf935773f032f86c3c9d2377f6ec77929fe06cdbb7a: Status 404 returned error can't find the container with id 1153bbdbb3794dac22317cf935773f032f86c3c9d2377f6ec77929fe06cdbb7a
Jul 27 15:48:52.911014 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:52.910836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:52.911603 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:52.910977    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:48:52.911603 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:52.911043    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4777f9c-6xjw6: secret "image-registry-tls" not found
Jul 27 15:48:52.911603 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:52.911088    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls podName:30247dd9-36f2-4249-ba97-2a7f90944475 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:54.91107478 +0000 UTC m=+37.592139187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls") pod "image-registry-7df4777f9c-6xjw6" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475") : secret "image-registry-tls" not found
Jul 27 15:48:52.924649 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:52.924629    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:48:52.924726 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:52.924711    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:48:52.924759 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:52.924738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:48:52.927603 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:52.927566    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lcv26\""
Jul 27 15:48:52.927603 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:52.927582    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x92bc\""
Jul 27 15:48:52.927603 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:52.927582    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 15:48:52.927825 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:52.927567    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 15:48:52.927825 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:52.927652    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 15:48:52.927825 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:52.927582    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 15:48:53.011662 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:53.011636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:53.011795 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:53.011780    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:48:53.011858 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:53.011836    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls podName:01000c87-df01-472f-bd6c-e64b199bcc35 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:55.011819254 +0000 UTC m=+37.692883674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls") pod "dns-default-7cpkh" (UID: "01000c87-df01-472f-bd6c-e64b199bcc35") : secret "dns-default-metrics-tls" not found
Jul 27 15:48:53.090915 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:53.090878    2579 generic.go:356] "Generic (PLEG): container finished" podID="c0990436-6f55-4b52-93c6-64e871ee4661" containerID="d03c62612c178c9f3c51cf27e033700279b01739c7241c7f1c051c3edf3667e8" exitCode=0
Jul 27 15:48:53.091063 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:53.090962    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8gfr" event={"ID":"c0990436-6f55-4b52-93c6-64e871ee4661","Type":"ContainerDied","Data":"d03c62612c178c9f3c51cf27e033700279b01739c7241c7f1c051c3edf3667e8"}
Jul 27 15:48:53.092198 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:53.092173    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rm56l" event={"ID":"931dac23-0e51-4f5c-958a-88d3da987537","Type":"ContainerStarted","Data":"1153bbdbb3794dac22317cf935773f032f86c3c9d2377f6ec77929fe06cdbb7a"}
Jul 27 15:48:54.098231 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:54.098168    2579 generic.go:356] "Generic (PLEG): container finished" podID="c0990436-6f55-4b52-93c6-64e871ee4661" containerID="f8cabfff5d8a57d788d6c4f3433ec4bfe5b6b9199309eb6288ffe96689df9c80" exitCode=0
Jul 27 15:48:54.098765 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:54.098236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8gfr" event={"ID":"c0990436-6f55-4b52-93c6-64e871ee4661","Type":"ContainerDied","Data":"f8cabfff5d8a57d788d6c4f3433ec4bfe5b6b9199309eb6288ffe96689df9c80"}
Jul 27 15:48:54.930983 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:54.928648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:54.930983 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:54.928828    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:48:54.930983 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:54.928850    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4777f9c-6xjw6: secret "image-registry-tls" not found
Jul 27 15:48:54.930983 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:54.928903    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls podName:30247dd9-36f2-4249-ba97-2a7f90944475 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:58.928880307 +0000 UTC m=+41.609944719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls") pod "image-registry-7df4777f9c-6xjw6" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475") : secret "image-registry-tls" not found
Jul 27 15:48:55.030038 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:55.029999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:55.030225 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:55.030153    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:48:55.030289 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:55.030230    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls podName:01000c87-df01-472f-bd6c-e64b199bcc35 nodeName:}" failed. No retries permitted until 2026-07-27 15:48:59.030213868 +0000 UTC m=+41.711278280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls") pod "dns-default-7cpkh" (UID: "01000c87-df01-472f-bd6c-e64b199bcc35") : secret "dns-default-metrics-tls" not found
Jul 27 15:48:55.106655 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:55.106563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8gfr" event={"ID":"c0990436-6f55-4b52-93c6-64e871ee4661","Type":"ContainerStarted","Data":"f39471e44781267edb6d8598ca78170b30412fcf8f91fcd6602f99f31dc9ecd4"}
Jul 27 15:48:55.108008 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:55.107972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rm56l" event={"ID":"931dac23-0e51-4f5c-958a-88d3da987537","Type":"ContainerStarted","Data":"3feb91f2b0790927a21720e519950a88462e74fe7964b7de7da4560842144659"}
Jul 27 15:48:55.130120 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:55.130076    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s8gfr" podStartSLOduration=7.879389791 podStartE2EDuration="37.130055697s" totalImagesPullingTime="29.250665906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:55.129526883 +0000 UTC m=+37.810591314" watchObservedRunningTime="2026-07-27 15:48:55.130055697 +0000 UTC m=+37.811120128"
Jul 27 15:48:55.148661 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:55.148608    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rm56l" podStartSLOduration=1.365980366 podStartE2EDuration="4.14859058s" totalImagesPullingTime="2.782610214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:48:55.148352921 +0000 UTC m=+37.829417378" watchObservedRunningTime="2026-07-27 15:48:55.14859058 +0000 UTC m=+37.829655010"
Jul 27 15:48:58.953335 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:58.953301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:48:58.953721 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:58.953421    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:48:58.953721 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:58.953433    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4777f9c-6xjw6: secret "image-registry-tls" not found
Jul 27 15:48:58.953721 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:58.953479    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls podName:30247dd9-36f2-4249-ba97-2a7f90944475 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:06.953465473 +0000 UTC m=+49.634529880 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls") pod "image-registry-7df4777f9c-6xjw6" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475") : secret "image-registry-tls" not found
Jul 27 15:48:59.054114 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:48:59.054085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:48:59.054265 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:59.054244    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:48:59.054316 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:48:59.054306    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls podName:01000c87-df01-472f-bd6c-e64b199bcc35 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:07.054291933 +0000 UTC m=+49.735356355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls") pod "dns-default-7cpkh" (UID: "01000c87-df01-472f-bd6c-e64b199bcc35") : secret "dns-default-metrics-tls" not found
Jul 27 15:49:07.007165 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:07.007125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:49:07.007616 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:07.007245    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:49:07.007616 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:07.007256    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4777f9c-6xjw6: secret "image-registry-tls" not found
Jul 27 15:49:07.007616 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:07.007305    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls podName:30247dd9-36f2-4249-ba97-2a7f90944475 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:23.007289807 +0000 UTC m=+65.688354214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls") pod "image-registry-7df4777f9c-6xjw6" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475") : secret "image-registry-tls" not found
Jul 27 15:49:07.108158 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:07.108123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:49:07.108294 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:07.108276    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:49:07.108361 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:07.108351    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls podName:01000c87-df01-472f-bd6c-e64b199bcc35 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:23.108335081 +0000 UTC m=+65.789399488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls") pod "dns-default-7cpkh" (UID: "01000c87-df01-472f-bd6c-e64b199bcc35") : secret "dns-default-metrics-tls" not found
Jul 27 15:49:16.079137 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:16.079110    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shnx2"
Jul 27 15:49:22.511394 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.511346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:49:22.513641 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.513623    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 15:49:22.525290 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.525269    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3b7a762-4b09-4df3-878f-304637a41ed9-original-pull-secret\") pod \"global-pull-secret-syncer-44z5d\" (UID: \"d3b7a762-4b09-4df3-878f-304637a41ed9\") " pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:49:22.612107 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.612071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:49:22.614393 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.614377    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 15:49:22.623155 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:22.623138    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 15:49:22.623221 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:22.623186    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs podName:d2b4d804-902a-462c-9597-6201391cd658 nodeName:}" failed. No retries permitted until 2026-07-27 15:50:26.623171384 +0000 UTC m=+129.304235792 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs") pod "network-metrics-daemon-sng2j" (UID: "d2b4d804-902a-462c-9597-6201391cd658") : secret "metrics-daemon-secret" not found
Jul 27 15:49:22.634550 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.634529    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44z5d"
Jul 27 15:49:22.712949 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.712911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntq4\" (UniqueName: \"kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4\") pod \"network-check-target-bssgv\" (UID: \"93946ad2-a0c3-48e2-bf21-958ca87b1703\") " pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:49:22.715154 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.715139    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 15:49:22.726006 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.725986    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 15:49:22.736453 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.736433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntq4\" (UniqueName: \"kubernetes.io/projected/93946ad2-a0c3-48e2-bf21-958ca87b1703-kube-api-access-rntq4\") pod \"network-check-target-bssgv\" (UID: \"93946ad2-a0c3-48e2-bf21-958ca87b1703\") " pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:49:22.752073 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.752048    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-44z5d"]
Jul 27 15:49:22.756309 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:49:22.756284    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b7a762_4b09_4df3_878f_304637a41ed9.slice/crio-f12f7af2608b1f4c6a3dcdc3f2963cf12c40f36d0edb9619f0e57274d2c0e632 WatchSource:0}: Error finding container f12f7af2608b1f4c6a3dcdc3f2963cf12c40f36d0edb9619f0e57274d2c0e632: Status 404 returned error can't find the container with id f12f7af2608b1f4c6a3dcdc3f2963cf12c40f36d0edb9619f0e57274d2c0e632
Jul 27 15:49:22.944483 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.944462    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lcv26\""
Jul 27 15:49:22.950545 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:22.950532    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:49:23.015535 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:23.014903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:49:23.015535 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:23.015050    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:49:23.015535 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:23.015065    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4777f9c-6xjw6: secret "image-registry-tls" not found
Jul 27 15:49:23.015535 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:23.015133    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls podName:30247dd9-36f2-4249-ba97-2a7f90944475 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:55.015113809 +0000 UTC m=+97.696178220 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls") pod "image-registry-7df4777f9c-6xjw6" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475") : secret "image-registry-tls" not found
Jul 27 15:49:23.075166 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:23.075136    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bssgv"]
Jul 27 15:49:23.078054 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:49:23.078032    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93946ad2_a0c3_48e2_bf21_958ca87b1703.slice/crio-67c7f18d9f1e6bed325625dcdc1eb7f0f987fbf78db09dfbfc9ef8ba7050488a WatchSource:0}: Error finding container 67c7f18d9f1e6bed325625dcdc1eb7f0f987fbf78db09dfbfc9ef8ba7050488a: Status 404 returned error can't find the container with id 67c7f18d9f1e6bed325625dcdc1eb7f0f987fbf78db09dfbfc9ef8ba7050488a
Jul 27 15:49:23.115713 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:23.115681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:49:23.115839 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:23.115822    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:49:23.115886 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:23.115878    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls podName:01000c87-df01-472f-bd6c-e64b199bcc35 nodeName:}" failed. No retries permitted until 2026-07-27 15:49:55.115861714 +0000 UTC m=+97.796926121 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls") pod "dns-default-7cpkh" (UID: "01000c87-df01-472f-bd6c-e64b199bcc35") : secret "dns-default-metrics-tls" not found
Jul 27 15:49:23.172366 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:23.172339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bssgv" event={"ID":"93946ad2-a0c3-48e2-bf21-958ca87b1703","Type":"ContainerStarted","Data":"67c7f18d9f1e6bed325625dcdc1eb7f0f987fbf78db09dfbfc9ef8ba7050488a"}
Jul 27 15:49:23.173440 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:23.173420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-44z5d" event={"ID":"d3b7a762-4b09-4df3-878f-304637a41ed9","Type":"ContainerStarted","Data":"f12f7af2608b1f4c6a3dcdc3f2963cf12c40f36d0edb9619f0e57274d2c0e632"}
Jul 27 15:49:28.187157 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:28.187117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bssgv" event={"ID":"93946ad2-a0c3-48e2-bf21-958ca87b1703","Type":"ContainerStarted","Data":"7eaec0e7e6f4aadcaaa5f424387659ebeb797b67a14cf76ee3b362518e980217"}
Jul 27 15:49:28.187663 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:28.187227    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:49:28.188460 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:28.188437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-44z5d" event={"ID":"d3b7a762-4b09-4df3-878f-304637a41ed9","Type":"ContainerStarted","Data":"7498ff0d5e45bd4fdd195a6d357d198daf32882aa078f40f551d97d350b5b2e6"}
Jul 27 15:49:28.203661 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:28.203555    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bssgv" podStartSLOduration=66.976361307 podStartE2EDuration="1m10.203544027s" totalImagesPullingTime="3.22718272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:49:28.203221214 +0000 UTC m=+70.884285645" watchObservedRunningTime="2026-07-27 15:49:28.203544027 +0000 UTC m=+70.884608451"
Jul 27 15:49:55.024855 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:55.024818    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:49:55.025252 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:55.024948    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:49:55.025252 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:55.024961    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4777f9c-6xjw6: secret "image-registry-tls" not found
Jul 27 15:49:55.025252 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:55.025038    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls podName:30247dd9-36f2-4249-ba97-2a7f90944475 nodeName:}" failed. No retries permitted until 2026-07-27 15:50:59.025024195 +0000 UTC m=+161.706088603 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls") pod "image-registry-7df4777f9c-6xjw6" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475") : secret "image-registry-tls" not found
Jul 27 15:49:55.125482 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:55.125442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:49:55.125654 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:55.125597    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:49:55.125698 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:49:55.125673    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls podName:01000c87-df01-472f-bd6c-e64b199bcc35 nodeName:}" failed. No retries permitted until 2026-07-27 15:50:59.125657295 +0000 UTC m=+161.806721708 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls") pod "dns-default-7cpkh" (UID: "01000c87-df01-472f-bd6c-e64b199bcc35") : secret "dns-default-metrics-tls" not found
Jul 27 15:49:59.193510 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:59.193472    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bssgv"
Jul 27 15:49:59.210072 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:49:59.210008    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-44z5d" podStartSLOduration=96.278194217 podStartE2EDuration="1m41.209995939s" totalImagesPullingTime="4.931801722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:49:28.217586673 +0000 UTC m=+70.898651105" watchObservedRunningTime="2026-07-27 15:49:59.209995939 +0000 UTC m=+101.891060413"
Jul 27 15:50:26.636231 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:50:26.636192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:50:26.636821 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:50:26.636365    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 27 15:50:26.636821 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:50:26.636464    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs podName:d2b4d804-902a-462c-9597-6201391cd658 nodeName:}" failed. No retries permitted until 2026-07-27 15:52:28.636442411 +0000 UTC m=+251.317506838 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs") pod "network-metrics-daemon-sng2j" (UID: "d2b4d804-902a-462c-9597-6201391cd658") : secret "metrics-daemon-secret" not found
Jul 27 15:50:54.216122 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:50:54.216080    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6" podUID="30247dd9-36f2-4249-ba97-2a7f90944475"
Jul 27 15:50:54.237241 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:50:54.237211    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7cpkh" podUID="01000c87-df01-472f-bd6c-e64b199bcc35"
Jul 27 15:50:54.380408 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:50:54.380375    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:50:54.380600 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:50:54.380375    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:50:55.944347 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:50:55.944308    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-sng2j" podUID="d2b4d804-902a-462c-9597-6201391cd658"
Jul 27 15:50:59.047532 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:50:59.047482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:50:59.047961 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:50:59.047619    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 15:50:59.047961 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:50:59.047635    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7df4777f9c-6xjw6: secret "image-registry-tls" not found
Jul 27 15:50:59.047961 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:50:59.047694    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls podName:30247dd9-36f2-4249-ba97-2a7f90944475 nodeName:}" failed. No retries permitted until 2026-07-27 15:53:01.047680218 +0000 UTC m=+283.728744625 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls") pod "image-registry-7df4777f9c-6xjw6" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475") : secret "image-registry-tls" not found
Jul 27 15:50:59.148139 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:50:59.148109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:50:59.148273 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:50:59.148235    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 15:50:59.148331 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:50:59.148291    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls podName:01000c87-df01-472f-bd6c-e64b199bcc35 nodeName:}" failed. No retries permitted until 2026-07-27 15:53:01.148275823 +0000 UTC m=+283.829340232 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls") pod "dns-default-7cpkh" (UID: "01000c87-df01-472f-bd6c-e64b199bcc35") : secret "dns-default-metrics-tls" not found
Jul 27 15:51:10.924971 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:10.924892    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:51:34.498892 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.498858    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"]
Jul 27 15:51:34.500940 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.500924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:34.503977 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.503961    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:51:34.504297 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.504279    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-w9qdf\""
Jul 27 15:51:34.506618 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.504979    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 27 15:51:34.506618 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.505329    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 27 15:51:34.514778 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.514753    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"]
Jul 27 15:51:34.570583 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.570550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rgr7\" (UniqueName: \"kubernetes.io/projected/65385362-4323-411b-899f-5f63a42dd199-kube-api-access-7rgr7\") pod \"cluster-samples-operator-6748489656-kf2bw\" (UID: \"65385362-4323-411b-899f-5f63a42dd199\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:34.570698 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.570654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kf2bw\" (UID: \"65385362-4323-411b-899f-5f63a42dd199\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:34.597709 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.597682    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"]
Jul 27 15:51:34.599854 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.599837    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"
Jul 27 15:51:34.602364 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.602346    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 27 15:51:34.602364 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.602352    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4xfsf\""
Jul 27 15:51:34.602541 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.602460    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 27 15:51:34.602541 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.602507    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:51:34.602707 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.602693    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 27 15:51:34.619345 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.619323    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"]
Jul 27 15:51:34.622135 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.622113    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"]
Jul 27 15:51:34.623951 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.623936    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.626678 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.626657    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 27 15:51:34.626770 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.626709    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 27 15:51:34.626770 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.626718    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 27 15:51:34.626770 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.626746    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 27 15:51:34.627062 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.627046    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 27 15:51:34.627146 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.627063    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 27 15:51:34.627146 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.627067    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 27 15:51:34.638118 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.638097    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"]
Jul 27 15:51:34.670992 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.670965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kf2bw\" (UID: \"65385362-4323-411b-899f-5f63a42dd199\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:34.671127 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.670995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.671127 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.671024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7efc39-457e-4db2-829a-67eb093d6a65-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.671127 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.671053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rgr7\" (UniqueName: \"kubernetes.io/projected/65385362-4323-411b-899f-5f63a42dd199-kube-api-access-7rgr7\") pod \"cluster-samples-operator-6748489656-kf2bw\" (UID: \"65385362-4323-411b-899f-5f63a42dd199\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:34.671127 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.671097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.671127 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:34.671115    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 15:51:34.671367 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.671127    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98wzq\" (UniqueName: \"kubernetes.io/projected/2a7efc39-457e-4db2-829a-67eb093d6a65-kube-api-access-98wzq\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.671367 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.671166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b534d69f-dc4a-42a3-a71d-9f0bd6499673-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz\" (UID: \"b534d69f-dc4a-42a3-a71d-9f0bd6499673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"
Jul 27 15:51:34.671367 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:34.671186    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls podName:65385362-4323-411b-899f-5f63a42dd199 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:35.171164636 +0000 UTC m=+197.852229062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls") pod "cluster-samples-operator-6748489656-kf2bw" (UID: "65385362-4323-411b-899f-5f63a42dd199") : secret "samples-operator-tls" not found
Jul 27 15:51:34.671367 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.671225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-hub\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.671367 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.671248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b534d69f-dc4a-42a3-a71d-9f0bd6499673-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz\" (UID: \"b534d69f-dc4a-42a3-a71d-9f0bd6499673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"
Jul 27 15:51:34.671367 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.671280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-ca\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.671367 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.671338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvs7p\" (UniqueName: \"kubernetes.io/projected/b534d69f-dc4a-42a3-a71d-9f0bd6499673-kube-api-access-gvs7p\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz\" (UID: \"b534d69f-dc4a-42a3-a71d-9f0bd6499673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"
Jul 27 15:51:34.680549 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.680530    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rgr7\" (UniqueName: \"kubernetes.io/projected/65385362-4323-411b-899f-5f63a42dd199-kube-api-access-7rgr7\") pod \"cluster-samples-operator-6748489656-kf2bw\" (UID: \"65385362-4323-411b-899f-5f63a42dd199\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:34.771772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.771678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7efc39-457e-4db2-829a-67eb093d6a65-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.771772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.771752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.771772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.771775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98wzq\" (UniqueName: \"kubernetes.io/projected/2a7efc39-457e-4db2-829a-67eb093d6a65-kube-api-access-98wzq\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.772036 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.771800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b534d69f-dc4a-42a3-a71d-9f0bd6499673-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz\" (UID: \"b534d69f-dc4a-42a3-a71d-9f0bd6499673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"
Jul 27 15:51:34.772036 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.771829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-hub\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.772036 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.771854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b534d69f-dc4a-42a3-a71d-9f0bd6499673-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz\" (UID: \"b534d69f-dc4a-42a3-a71d-9f0bd6499673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"
Jul 27 15:51:34.772036 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.771878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-ca\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.772036 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.772021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvs7p\" (UniqueName: \"kubernetes.io/projected/b534d69f-dc4a-42a3-a71d-9f0bd6499673-kube-api-access-gvs7p\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz\" (UID: \"b534d69f-dc4a-42a3-a71d-9f0bd6499673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"
Jul 27 15:51:34.772270 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.772078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.772417 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.772392    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a7efc39-457e-4db2-829a-67eb093d6a65-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.772553 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.772429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b534d69f-dc4a-42a3-a71d-9f0bd6499673-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz\" (UID: \"b534d69f-dc4a-42a3-a71d-9f0bd6499673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"
Jul 27 15:51:34.774310 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.774286    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-ca\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.774550 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.774532    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b534d69f-dc4a-42a3-a71d-9f0bd6499673-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz\" (UID: \"b534d69f-dc4a-42a3-a71d-9f0bd6499673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"
Jul 27 15:51:34.774647 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.774630    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-hub\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.774772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.774752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.774890 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.774837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2a7efc39-457e-4db2-829a-67eb093d6a65-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.783466 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.783445    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98wzq\" (UniqueName: \"kubernetes.io/projected/2a7efc39-457e-4db2-829a-67eb093d6a65-kube-api-access-98wzq\") pod \"cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt\" (UID: \"2a7efc39-457e-4db2-829a-67eb093d6a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:34.793759 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.793740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvs7p\" (UniqueName: \"kubernetes.io/projected/b534d69f-dc4a-42a3-a71d-9f0bd6499673-kube-api-access-gvs7p\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz\" (UID: \"b534d69f-dc4a-42a3-a71d-9f0bd6499673\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"
Jul 27 15:51:34.908307 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.908275    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"
Jul 27 15:51:34.947933 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:34.947906    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:51:35.032379 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:35.032336    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz"]
Jul 27 15:51:35.035538 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:51:35.035510    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb534d69f_dc4a_42a3_a71d_9f0bd6499673.slice/crio-d315511339f460bb6b19979faa90561f109c91626533485fdcdb80b4fa613fca WatchSource:0}: Error finding container d315511339f460bb6b19979faa90561f109c91626533485fdcdb80b4fa613fca: Status 404 returned error can't find the container with id d315511339f460bb6b19979faa90561f109c91626533485fdcdb80b4fa613fca
Jul 27 15:51:35.076723 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:35.076699    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"]
Jul 27 15:51:35.079165 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:51:35.079137    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a7efc39_457e_4db2_829a_67eb093d6a65.slice/crio-533d5cf4c83e78c0739e807d942a67814727ef9e39a32d3a5e4ea4d46d078a6d WatchSource:0}: Error finding container 533d5cf4c83e78c0739e807d942a67814727ef9e39a32d3a5e4ea4d46d078a6d: Status 404 returned error can't find the container with id 533d5cf4c83e78c0739e807d942a67814727ef9e39a32d3a5e4ea4d46d078a6d
Jul 27 15:51:35.175558 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:35.175534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kf2bw\" (UID: \"65385362-4323-411b-899f-5f63a42dd199\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:35.175659 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:35.175647    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 15:51:35.175713 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:35.175692    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls podName:65385362-4323-411b-899f-5f63a42dd199 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:36.175679404 +0000 UTC m=+198.856743813 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls") pod "cluster-samples-operator-6748489656-kf2bw" (UID: "65385362-4323-411b-899f-5f63a42dd199") : secret "samples-operator-tls" not found
Jul 27 15:51:35.475799 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:35.475719    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz" event={"ID":"b534d69f-dc4a-42a3-a71d-9f0bd6499673","Type":"ContainerStarted","Data":"d315511339f460bb6b19979faa90561f109c91626533485fdcdb80b4fa613fca"}
Jul 27 15:51:35.476613 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:35.476593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" event={"ID":"2a7efc39-457e-4db2-829a-67eb093d6a65","Type":"ContainerStarted","Data":"533d5cf4c83e78c0739e807d942a67814727ef9e39a32d3a5e4ea4d46d078a6d"}
Jul 27 15:51:36.182430 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:36.182392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kf2bw\" (UID: \"65385362-4323-411b-899f-5f63a42dd199\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:36.182830 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:36.182556    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 15:51:36.182830 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:36.182618    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls podName:65385362-4323-411b-899f-5f63a42dd199 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:38.182601908 +0000 UTC m=+200.863666315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls") pod "cluster-samples-operator-6748489656-kf2bw" (UID: "65385362-4323-411b-899f-5f63a42dd199") : secret "samples-operator-tls" not found
Jul 27 15:51:38.198051 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:38.198014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kf2bw\" (UID: \"65385362-4323-411b-899f-5f63a42dd199\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:38.198521 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:38.198164    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 15:51:38.198521 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:38.198252    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls podName:65385362-4323-411b-899f-5f63a42dd199 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:42.198229755 +0000 UTC m=+204.879294165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls") pod "cluster-samples-operator-6748489656-kf2bw" (UID: "65385362-4323-411b-899f-5f63a42dd199") : secret "samples-operator-tls" not found
Jul 27 15:51:38.486581 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:38.486485    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz" event={"ID":"b534d69f-dc4a-42a3-a71d-9f0bd6499673","Type":"ContainerStarted","Data":"37e7701a67c0cb79592f4354ae7c316e4f31b5f209ec628e09d942c52ba62ae0"}
Jul 27 15:51:38.502384 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:38.502335    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz" podStartSLOduration=1.9138353609999998 podStartE2EDuration="4.502320123s" totalImagesPullingTime="2.588484762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:51:38.501753607 +0000 UTC m=+201.182818041" watchObservedRunningTime="2026-07-27 15:51:38.502320123 +0000 UTC m=+201.183384551"
Jul 27 15:51:40.493630 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.493596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" event={"ID":"2a7efc39-457e-4db2-829a-67eb093d6a65","Type":"ContainerStarted","Data":"f9dcb3e069f6f317fa58e504762d09620aa421f782d7081ef0bacfa514272654"}
Jul 27 15:51:40.493630 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.493638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" event={"ID":"2a7efc39-457e-4db2-829a-67eb093d6a65","Type":"ContainerStarted","Data":"7bd9279846f80f17eea84b600c05eab53201185610e02b9f37a5388949ac08eb"}
Jul 27 15:51:40.494093 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.493650    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" event={"ID":"2a7efc39-457e-4db2-829a-67eb093d6a65","Type":"ContainerStarted","Data":"13f0001ce60794aae4ae3a3013e874f734baaf30ba12d4772372a4dc7b838764"}
Jul 27 15:51:40.510542 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.510479    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" podStartSLOduration=1.6868261420000001 podStartE2EDuration="6.510465964s" totalImagesPullingTime="4.823639822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:51:40.510259024 +0000 UTC m=+203.191323459" watchObservedRunningTime="2026-07-27 15:51:40.510465964 +0000 UTC m=+203.191530393"
Jul 27 15:51:40.631739 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.631709    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-skx27"]
Jul 27 15:51:40.633673 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.633657    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.637518 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.636019    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 15:51:40.637518 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.636235    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 15:51:40.637518 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.636270    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 15:51:40.637518 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.636601    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kgjlr\""
Jul 27 15:51:40.637518 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.637344    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 15:51:40.646460 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.646441    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-skx27"]
Jul 27 15:51:40.720554 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.720529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.720681 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.720583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jqxt\" (UniqueName: \"kubernetes.io/projected/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-api-access-2jqxt\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.720681 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.720666    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee1db810-9561-46f7-9521-5fe16c9c94bd-data-volume\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.720755 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.720735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee1db810-9561-46f7-9521-5fe16c9c94bd-crio-socket\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.720787 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.720758    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.821027 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.820988    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jqxt\" (UniqueName: \"kubernetes.io/projected/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-api-access-2jqxt\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.821164 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.821044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee1db810-9561-46f7-9521-5fe16c9c94bd-data-volume\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.821164 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.821147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee1db810-9561-46f7-9521-5fe16c9c94bd-crio-socket\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.821229 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.821175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.821229 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.821204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.821321 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.821297    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ee1db810-9561-46f7-9521-5fe16c9c94bd-crio-socket\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.821355 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:40.821311    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:40.821394 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:40.821383    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls podName:ee1db810-9561-46f7-9521-5fe16c9c94bd nodeName:}" failed. No retries permitted until 2026-07-27 15:51:41.321368863 +0000 UTC m=+204.002433274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skx27" (UID: "ee1db810-9561-46f7-9521-5fe16c9c94bd") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:40.821435 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.821386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee1db810-9561-46f7-9521-5fe16c9c94bd-data-volume\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:40.821435 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:40.821321    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 15:51:40.821521 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:40.821451    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm podName:ee1db810-9561-46f7-9521-5fe16c9c94bd nodeName:}" failed. No retries permitted until 2026-07-27 15:51:41.321438534 +0000 UTC m=+204.002502941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skx27" (UID: "ee1db810-9561-46f7-9521-5fe16c9c94bd") : configmap "kube-rbac-proxy" not found
Jul 27 15:51:40.831379 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:40.831356    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jqxt\" (UniqueName: \"kubernetes.io/projected/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-api-access-2jqxt\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:41.324879 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:41.324841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:41.325051 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:41.324889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:41.325051 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:41.324969    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 15:51:41.325051 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:41.325043    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm podName:ee1db810-9561-46f7-9521-5fe16c9c94bd nodeName:}" failed. No retries permitted until 2026-07-27 15:51:42.325026751 +0000 UTC m=+205.006091163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skx27" (UID: "ee1db810-9561-46f7-9521-5fe16c9c94bd") : configmap "kube-rbac-proxy" not found
Jul 27 15:51:41.325177 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:41.325095    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:41.325177 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:41.325161    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls podName:ee1db810-9561-46f7-9521-5fe16c9c94bd nodeName:}" failed. No retries permitted until 2026-07-27 15:51:42.325148463 +0000 UTC m=+205.006212873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skx27" (UID: "ee1db810-9561-46f7-9521-5fe16c9c94bd") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:42.232440 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:42.232405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kf2bw\" (UID: \"65385362-4323-411b-899f-5f63a42dd199\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:42.233031 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:42.232578    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 27 15:51:42.233031 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:42.232666    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls podName:65385362-4323-411b-899f-5f63a42dd199 nodeName:}" failed. No retries permitted until 2026-07-27 15:51:50.232633524 +0000 UTC m=+212.913697950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls") pod "cluster-samples-operator-6748489656-kf2bw" (UID: "65385362-4323-411b-899f-5f63a42dd199") : secret "samples-operator-tls" not found
Jul 27 15:51:42.332728 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:42.332697    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:42.332856 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:42.332732    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:42.332856 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:42.332808    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 15:51:42.332856 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:42.332838    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:42.332964 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:42.332863    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm podName:ee1db810-9561-46f7-9521-5fe16c9c94bd nodeName:}" failed. No retries permitted until 2026-07-27 15:51:44.332848546 +0000 UTC m=+207.013912956 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skx27" (UID: "ee1db810-9561-46f7-9521-5fe16c9c94bd") : configmap "kube-rbac-proxy" not found
Jul 27 15:51:42.332964 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:42.332878    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls podName:ee1db810-9561-46f7-9521-5fe16c9c94bd nodeName:}" failed. No retries permitted until 2026-07-27 15:51:44.33287242 +0000 UTC m=+207.013936828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skx27" (UID: "ee1db810-9561-46f7-9521-5fe16c9c94bd") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:43.628802 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:43.628769    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zls2z_fc65e853-284c-47b7-a0f6-022fa31d1a0d/dns-node-resolver/0.log"
Jul 27 15:51:44.227906 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:44.227878    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ksdlr_2ca7316b-79a1-488e-9f95-7afaf9e1e775/node-ca/0.log"
Jul 27 15:51:44.346123 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:44.346081    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:44.346321 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:44.346130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:44.346321 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:44.346198    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 15:51:44.346321 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:44.346258    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm podName:ee1db810-9561-46f7-9521-5fe16c9c94bd nodeName:}" failed. No retries permitted until 2026-07-27 15:51:48.346242886 +0000 UTC m=+211.027307294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skx27" (UID: "ee1db810-9561-46f7-9521-5fe16c9c94bd") : configmap "kube-rbac-proxy" not found
Jul 27 15:51:44.346321 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:44.346299    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:44.346479 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:44.346358    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls podName:ee1db810-9561-46f7-9521-5fe16c9c94bd nodeName:}" failed. No retries permitted until 2026-07-27 15:51:48.346347317 +0000 UTC m=+211.027411724 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skx27" (UID: "ee1db810-9561-46f7-9521-5fe16c9c94bd") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:45.228863 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:45.228811    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rm56l_931dac23-0e51-4f5c-958a-88d3da987537/serve-healthcheck-canary/0.log"
Jul 27 15:51:46.028951 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:46.028921    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz_b534d69f-dc4a-42a3-a71d-9f0bd6499673/kube-storage-version-migrator-operator/0.log"
Jul 27 15:51:48.374857 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:48.374824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:48.374857 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:48.374862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:48.375249 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:48.374943    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 15:51:48.375249 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:48.374966    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:48.375249 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:48.375012    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm podName:ee1db810-9561-46f7-9521-5fe16c9c94bd nodeName:}" failed. No retries permitted until 2026-07-27 15:51:56.374998103 +0000 UTC m=+219.056062514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-skx27" (UID: "ee1db810-9561-46f7-9521-5fe16c9c94bd") : configmap "kube-rbac-proxy" not found
Jul 27 15:51:48.375249 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:48.375027    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls podName:ee1db810-9561-46f7-9521-5fe16c9c94bd nodeName:}" failed. No retries permitted until 2026-07-27 15:51:56.375021464 +0000 UTC m=+219.056085884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skx27" (UID: "ee1db810-9561-46f7-9521-5fe16c9c94bd") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:50.290014 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:50.289983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kf2bw\" (UID: \"65385362-4323-411b-899f-5f63a42dd199\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:50.292319 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:50.292301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65385362-4323-411b-899f-5f63a42dd199-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-kf2bw\" (UID: \"65385362-4323-411b-899f-5f63a42dd199\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:50.411066 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:50.411027    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"
Jul 27 15:51:50.547636 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:50.547564    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw"]
Jul 27 15:51:51.524698 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:51.524661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw" event={"ID":"65385362-4323-411b-899f-5f63a42dd199","Type":"ContainerStarted","Data":"92515edcef8ae9e22c7510af0a3617298406338fe8af291dc0b3a380850a1b31"}
Jul 27 15:51:53.533743 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:53.533706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw" event={"ID":"65385362-4323-411b-899f-5f63a42dd199","Type":"ContainerStarted","Data":"97270f549f78ad6d2b4067fb20b2515b01ec65ff0ff2b5c8c75f7220bdadd1af"}
Jul 27 15:51:53.534078 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:53.533778    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw" event={"ID":"65385362-4323-411b-899f-5f63a42dd199","Type":"ContainerStarted","Data":"e8caa62f3616de71b1008b29bdf75c8122dd0da5c258b5acf5d244394b1502e5"}
Jul 27 15:51:53.553477 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:53.553431    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-kf2bw" podStartSLOduration=16.751845347 podStartE2EDuration="19.553418441s" totalImagesPullingTime="2.801573094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:51:53.552217619 +0000 UTC m=+216.233282049" watchObservedRunningTime="2026-07-27 15:51:53.553418441 +0000 UTC m=+216.234482870"
Jul 27 15:51:56.444060 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:56.444025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:56.444060 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:56.444063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:51:56.444452 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:56.444193    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:56.444452 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:51:56.444260    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls podName:ee1db810-9561-46f7-9521-5fe16c9c94bd nodeName:}" failed. No retries permitted until 2026-07-27 15:52:12.444241054 +0000 UTC m=+235.125305462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-skx27" (UID: "ee1db810-9561-46f7-9521-5fe16c9c94bd") : secret "insights-runtime-extractor-tls" not found
Jul 27 15:51:56.444650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:51:56.444627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ee1db810-9561-46f7-9521-5fe16c9c94bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:52:12.448604 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:12.448555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:52:12.450773 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:12.450754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ee1db810-9561-46f7-9521-5fe16c9c94bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-skx27\" (UID: \"ee1db810-9561-46f7-9521-5fe16c9c94bd\") " pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:52:12.744305 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:12.744214    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-skx27"
Jul 27 15:52:12.869390 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:12.869175    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-skx27"]
Jul 27 15:52:12.871897 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:52:12.871866    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1db810_9561_46f7_9521_5fe16c9c94bd.slice/crio-42de86f5b1d2ea769c6c69a537906efbe2ef6c1d4dcafb8a7afb8d7476555a23 WatchSource:0}: Error finding container 42de86f5b1d2ea769c6c69a537906efbe2ef6c1d4dcafb8a7afb8d7476555a23: Status 404 returned error can't find the container with id 42de86f5b1d2ea769c6c69a537906efbe2ef6c1d4dcafb8a7afb8d7476555a23
Jul 27 15:52:13.590826 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:13.590788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skx27" event={"ID":"ee1db810-9561-46f7-9521-5fe16c9c94bd","Type":"ContainerStarted","Data":"42de86f5b1d2ea769c6c69a537906efbe2ef6c1d4dcafb8a7afb8d7476555a23"}
Jul 27 15:52:19.610051 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:19.610015    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skx27" event={"ID":"ee1db810-9561-46f7-9521-5fe16c9c94bd","Type":"ContainerStarted","Data":"a1e652d5dc5d18f9f6798ddc5ff78849534ff1dff28c8673fdebc077802ca112"}
Jul 27 15:52:22.349870 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.349825    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w5l6w"]
Jul 27 15:52:22.358551 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.358522    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.360805 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.360779    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 15:52:22.360950 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.360806    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 15:52:22.361088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.361065    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 15:52:22.361336 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.361317    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 15:52:22.361641 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.361619    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 15:52:22.361641 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.361634    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t7cjz\""
Jul 27 15:52:22.361810 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.361619    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 15:52:22.530804 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.530764    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-textfile\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.530804 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.530806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-metrics-client-ca\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.531053 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.530837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-tls\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.531053 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.530876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.531053 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.530930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-root\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.531053 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.530964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-wtmp\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.531053 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.530988    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-sys\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.531053 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.531009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txwx7\" (UniqueName: \"kubernetes.io/projected/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-kube-api-access-txwx7\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.531053 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.531034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-accelerators-collector-config\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.631762 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.631635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-wtmp\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.631762 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.631686    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-sys\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.631762 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.631716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txwx7\" (UniqueName: \"kubernetes.io/projected/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-kube-api-access-txwx7\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.631762 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.631741    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-accelerators-collector-config\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.632088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.631808    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-sys\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.632088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.631813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-textfile\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.632088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.631907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-metrics-client-ca\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.632088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.631946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-tls\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.632088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.631810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-wtmp\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.632088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.631987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.632088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.632037    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-root\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.632433 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.632109    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-textfile\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.632433 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.632115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-root\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.632547 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.632427    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-accelerators-collector-config\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.632547 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.632447    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-metrics-client-ca\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.634813 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.634786    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.634974 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.634955    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-node-exporter-tls\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.641216 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.641188    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txwx7\" (UniqueName: \"kubernetes.io/projected/2a5154fb-d47f-4313-9ab7-ba8a8d36e80a-kube-api-access-txwx7\") pod \"node-exporter-w5l6w\" (UID: \"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a\") " pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.669914 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:22.669888    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w5l6w"
Jul 27 15:52:22.797647 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:52:22.797615    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5154fb_d47f_4313_9ab7_ba8a8d36e80a.slice/crio-895c20710d22ff23a6c32f8d71cf0ecb92fde6da04e8b32fe2a47db293b897fc WatchSource:0}: Error finding container 895c20710d22ff23a6c32f8d71cf0ecb92fde6da04e8b32fe2a47db293b897fc: Status 404 returned error can't find the container with id 895c20710d22ff23a6c32f8d71cf0ecb92fde6da04e8b32fe2a47db293b897fc
Jul 27 15:52:23.624797 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:23.624758    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skx27" event={"ID":"ee1db810-9561-46f7-9521-5fe16c9c94bd","Type":"ContainerStarted","Data":"fc20370a9a0dbcb59989f4dae20b1ef09c00043676bc78b23611bbc1f3e5f36d"}
Jul 27 15:52:23.625950 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:23.625922    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5l6w" event={"ID":"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a","Type":"ContainerStarted","Data":"895c20710d22ff23a6c32f8d71cf0ecb92fde6da04e8b32fe2a47db293b897fc"}
Jul 27 15:52:26.638792 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:26.638686    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-skx27" event={"ID":"ee1db810-9561-46f7-9521-5fe16c9c94bd","Type":"ContainerStarted","Data":"f79a9d50bcd1d6000fc32b8a548fbcb6eafcb1b52c1168f6c2b130db578a996a"}
Jul 27 15:52:26.640212 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:26.640190    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a5154fb-d47f-4313-9ab7-ba8a8d36e80a" containerID="c02e41aa9222c867396d96d336e9d05572ab885bc037dc7d0730a81d303ace18" exitCode=0
Jul 27 15:52:26.640298 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:26.640224    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5l6w" event={"ID":"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a","Type":"ContainerDied","Data":"c02e41aa9222c867396d96d336e9d05572ab885bc037dc7d0730a81d303ace18"}
Jul 27 15:52:26.658283 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:26.658228    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-skx27" podStartSLOduration=33.269066022 podStartE2EDuration="46.658207718s" totalImagesPullingTime="13.389141696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 15:51:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:26.657194408 +0000 UTC m=+249.338258839" watchObservedRunningTime="2026-07-27 15:52:26.658207718 +0000 UTC m=+249.339272148"
Jul 27 15:52:27.645458 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:27.645423    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5l6w" event={"ID":"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a","Type":"ContainerStarted","Data":"1b5bdf8073cd32252f38ecd15b1d0223652dbfec6f692621bc0e036ad89adec5"}
Jul 27 15:52:27.645835 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:27.645480    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5l6w" event={"ID":"2a5154fb-d47f-4313-9ab7-ba8a8d36e80a","Type":"ContainerStarted","Data":"3732f8365c53cbb0793989aa472c9ac1ce50f0a96cf9c2b16b9049070b71cc48"}
Jul 27 15:52:27.664408 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:27.664362    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w5l6w" podStartSLOduration=2.031195162 podStartE2EDuration="5.664347713s" totalImagesPullingTime="3.572252187s" totalInitContainerRuntime="60.900364ms" isStatefulPod=true podCreationTimestamp="2026-07-27 15:52:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:27.663678482 +0000 UTC m=+250.344742936" watchObservedRunningTime="2026-07-27 15:52:27.664347713 +0000 UTC m=+250.345412144"
Jul 27 15:52:28.681192 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:28.681156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:52:28.683337 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:28.683315    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2b4d804-902a-462c-9597-6201391cd658-metrics-certs\") pod \"network-metrics-daemon-sng2j\" (UID: \"d2b4d804-902a-462c-9597-6201391cd658\") " pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:52:28.928965 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:28.928935    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x92bc\""
Jul 27 15:52:28.936635 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:28.936589    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sng2j"
Jul 27 15:52:29.061438 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:29.061407    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sng2j"]
Jul 27 15:52:29.064160 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:52:29.064130    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b4d804_902a_462c_9597_6201391cd658.slice/crio-d3049c59617d28be3d16519d856970d855b78a94916402fa465b95eca9358531 WatchSource:0}: Error finding container d3049c59617d28be3d16519d856970d855b78a94916402fa465b95eca9358531: Status 404 returned error can't find the container with id d3049c59617d28be3d16519d856970d855b78a94916402fa465b95eca9358531
Jul 27 15:52:29.653921 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:29.653873    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sng2j" event={"ID":"d2b4d804-902a-462c-9597-6201391cd658","Type":"ContainerStarted","Data":"d3049c59617d28be3d16519d856970d855b78a94916402fa465b95eca9358531"}
Jul 27 15:52:30.658792 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:30.658755    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sng2j" event={"ID":"d2b4d804-902a-462c-9597-6201391cd658","Type":"ContainerStarted","Data":"32e4922eed271b29f69b2d21341c8ea0f7245e0c8663fe4bb64c7ffe747540d1"}
Jul 27 15:52:30.659223 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:30.658806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sng2j" event={"ID":"d2b4d804-902a-462c-9597-6201391cd658","Type":"ContainerStarted","Data":"29fd77226fd11016f8ef0ab8598790237d24b8de7ee81e5960f08599b19ec5f8"}
Jul 27 15:52:30.676145 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:30.676099    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sng2j" podStartSLOduration=251.637489173 podStartE2EDuration="4m12.67608534s" totalImagesPullingTime="1.038596167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:30.675160997 +0000 UTC m=+253.356225427" watchObservedRunningTime="2026-07-27 15:52:30.67608534 +0000 UTC m=+253.357149770"
Jul 27 15:52:45.399008 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.398934    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54cdf4f694-6rkdn"]
Jul 27 15:52:45.402085 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.402065    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.404787 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.404768    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 27 15:52:45.404998 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.404983    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 27 15:52:45.405596 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.405578    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 27 15:52:45.405737 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.405720    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 27 15:52:45.405814 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.405742    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 27 15:52:45.405814 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.405771    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 27 15:52:45.406703 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.406689    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-26flv\""
Jul 27 15:52:45.406888 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.406874    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 27 15:52:45.419957 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.419937    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54cdf4f694-6rkdn"]
Jul 27 15:52:45.502755 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.502712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-config\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.502931 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.502798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-serving-cert\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.502931 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.502856    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-oauth-config\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.502931 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.502879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-service-ca\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.503090 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.502954    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z265v\" (UniqueName: \"kubernetes.io/projected/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-kube-api-access-z265v\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.503090 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.502982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-oauth-serving-cert\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.603746 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.603716    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-serving-cert\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.603746 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.603751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-oauth-config\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.603944 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.603767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-service-ca\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.603944 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.603928    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z265v\" (UniqueName: \"kubernetes.io/projected/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-kube-api-access-z265v\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.604045 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.603958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-oauth-serving-cert\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.604045 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.604004    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-config\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.604611 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.604584    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-service-ca\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.604727 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.604628    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-oauth-serving-cert\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.604727 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.604661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-config\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.606180 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.606155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-serving-cert\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.606261 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.606177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-oauth-config\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.612623 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.612604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z265v\" (UniqueName: \"kubernetes.io/projected/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-kube-api-access-z265v\") pod \"console-54cdf4f694-6rkdn\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") " pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.711376 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.711298    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:45.837056 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:45.837035    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54cdf4f694-6rkdn"]
Jul 27 15:52:45.839370 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:52:45.839339    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61bb6c9_b05c_43cc_9cf6_58900b8d6631.slice/crio-3aaae6118be61480e134e1d97291557e28680066afd2f989b48147ecfdb22815 WatchSource:0}: Error finding container 3aaae6118be61480e134e1d97291557e28680066afd2f989b48147ecfdb22815: Status 404 returned error can't find the container with id 3aaae6118be61480e134e1d97291557e28680066afd2f989b48147ecfdb22815
Jul 27 15:52:46.711075 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:46.711007    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cdf4f694-6rkdn" event={"ID":"f61bb6c9-b05c-43cc-9cf6-58900b8d6631","Type":"ContainerStarted","Data":"3aaae6118be61480e134e1d97291557e28680066afd2f989b48147ecfdb22815"}
Jul 27 15:52:47.757195 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.757160    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d6ff7867-dp9bx"]
Jul 27 15:52:47.760297 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.760276    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.768077 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.768048    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 27 15:52:47.771357 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.771325    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d6ff7867-dp9bx"]
Jul 27 15:52:47.819762 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.819733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-service-ca\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.819908 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.819767    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-oauth-config\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.819908 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.819819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-console-config\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.819908 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.819838    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgdvf\" (UniqueName: \"kubernetes.io/projected/398eddd6-4e2c-4adc-8d74-412b88b36715-kube-api-access-cgdvf\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.819908 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.819865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-serving-cert\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.819908 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.819884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-oauth-serving-cert\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.819908 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.819903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-trusted-ca-bundle\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.921085 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.921047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-trusted-ca-bundle\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.921272 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.921127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-service-ca\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.921272 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.921172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-oauth-config\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.921396 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.921328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-console-config\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.921396 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.921380    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgdvf\" (UniqueName: \"kubernetes.io/projected/398eddd6-4e2c-4adc-8d74-412b88b36715-kube-api-access-cgdvf\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.921520 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.921435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-serving-cert\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.921520 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.921467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-oauth-serving-cert\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.921969 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.921909    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-service-ca\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.922085 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.922020    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-console-config\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.922085 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.922054    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-trusted-ca-bundle\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.922487 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.922465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-oauth-serving-cert\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.924317 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.924295    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-oauth-config\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.924620 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.924573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-serving-cert\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:47.931623 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:47.931573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgdvf\" (UniqueName: \"kubernetes.io/projected/398eddd6-4e2c-4adc-8d74-412b88b36715-kube-api-access-cgdvf\") pod \"console-75d6ff7867-dp9bx\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") " pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:48.071750 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:48.071707    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:48.224542 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:48.224512    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zls2z_fc65e853-284c-47b7-a0f6-022fa31d1a0d/dns-node-resolver/0.log"
Jul 27 15:52:48.824860 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:48.824832    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ksdlr_2ca7316b-79a1-488e-9f95-7afaf9e1e775/node-ca/0.log"
Jul 27 15:52:48.973541 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:48.973516    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d6ff7867-dp9bx"]
Jul 27 15:52:48.975660 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:52:48.975637    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398eddd6_4e2c_4adc_8d74_412b88b36715.slice/crio-aaea9d18525ea6902d5969a52cacf48ab9bcce5d0b9630041d389f5002cbe2b7 WatchSource:0}: Error finding container aaea9d18525ea6902d5969a52cacf48ab9bcce5d0b9630041d389f5002cbe2b7: Status 404 returned error can't find the container with id aaea9d18525ea6902d5969a52cacf48ab9bcce5d0b9630041d389f5002cbe2b7
Jul 27 15:52:49.723292 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:49.723257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cdf4f694-6rkdn" event={"ID":"f61bb6c9-b05c-43cc-9cf6-58900b8d6631","Type":"ContainerStarted","Data":"8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c"}
Jul 27 15:52:49.724744 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:49.724720    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d6ff7867-dp9bx" event={"ID":"398eddd6-4e2c-4adc-8d74-412b88b36715","Type":"ContainerStarted","Data":"0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2"}
Jul 27 15:52:49.724862 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:49.724760    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d6ff7867-dp9bx" event={"ID":"398eddd6-4e2c-4adc-8d74-412b88b36715","Type":"ContainerStarted","Data":"aaea9d18525ea6902d5969a52cacf48ab9bcce5d0b9630041d389f5002cbe2b7"}
Jul 27 15:52:49.742057 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:49.742003    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54cdf4f694-6rkdn" podStartSLOduration=1.67375226 podStartE2EDuration="4.741985549s" totalImagesPullingTime="3.068233289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:49.740351918 +0000 UTC m=+272.421416348" watchObservedRunningTime="2026-07-27 15:52:49.741985549 +0000 UTC m=+272.423049979"
Jul 27 15:52:49.758333 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:49.758291    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d6ff7867-dp9bx" podStartSLOduration=2.758277517 podStartE2EDuration="2.758277517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:52:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:52:49.75717324 +0000 UTC m=+272.438237667" watchObservedRunningTime="2026-07-27 15:52:49.758277517 +0000 UTC m=+272.439341946"
Jul 27 15:52:49.822472 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:49.822441    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rm56l_931dac23-0e51-4f5c-958a-88d3da987537/serve-healthcheck-canary/0.log"
Jul 27 15:52:55.711933 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:55.711895    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:55.712338 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:55.711956    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:52:55.713336 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:55.713310    2579 patch_prober.go:28] interesting pod/console-54cdf4f694-6rkdn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.13:8443/health\": dial tcp 10.132.0.13:8443: connect: connection refused" start-of-body=
Jul 27 15:52:55.713448 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:55.713354    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54cdf4f694-6rkdn" podUID="f61bb6c9-b05c-43cc-9cf6-58900b8d6631" containerName="console" probeResult="failure" output="Get \"https://10.132.0.13:8443/health\": dial tcp 10.132.0.13:8443: connect: connection refused"
Jul 27 15:52:57.381912 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:52:57.381867    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7cpkh" podUID="01000c87-df01-472f-bd6c-e64b199bcc35"
Jul 27 15:52:57.381912 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:52:57.381867    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6" podUID="30247dd9-36f2-4249-ba97-2a7f90944475"
Jul 27 15:52:57.755760 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:57.755666    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:52:57.756138 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:57.756115    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:52:58.072313 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:58.072277    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:58.072476 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:58.072342    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:52:58.073910 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:58.073882    2579 patch_prober.go:28] interesting pod/console-75d6ff7867-dp9bx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body=
Jul 27 15:52:58.074036 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:52:58.073955    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75d6ff7867-dp9bx" podUID="398eddd6-4e2c-4adc-8d74-412b88b36715" containerName="console" probeResult="failure" output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused"
Jul 27 15:53:01.123925 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.123891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:53:01.126185 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.126165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"image-registry-7df4777f9c-6xjw6\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") " pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:53:01.225201 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.225158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:53:01.227421 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.227388    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/01000c87-df01-472f-bd6c-e64b199bcc35-metrics-tls\") pod \"dns-default-7cpkh\" (UID: \"01000c87-df01-472f-bd6c-e64b199bcc35\") " pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:53:01.359490 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.359460    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-748tg\""
Jul 27 15:53:01.359733 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.359719    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-twmt9\""
Jul 27 15:53:01.367297 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.367279    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:53:01.367343 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.367296    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:53:01.542958 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.542931    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7df4777f9c-6xjw6"]
Jul 27 15:53:01.545378 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:53:01.545351    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30247dd9_36f2_4249_ba97_2a7f90944475.slice/crio-6f242ae666e0f1a814975716452e5f45ea5a07c3125ffca5613568a50519119a WatchSource:0}: Error finding container 6f242ae666e0f1a814975716452e5f45ea5a07c3125ffca5613568a50519119a: Status 404 returned error can't find the container with id 6f242ae666e0f1a814975716452e5f45ea5a07c3125ffca5613568a50519119a
Jul 27 15:53:01.557694 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.557658    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7cpkh"]
Jul 27 15:53:01.560078 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:53:01.560056    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01000c87_df01_472f_bd6c_e64b199bcc35.slice/crio-6ff880cc1160cd75d2c0bea86bd25aac53877713ff5e04c6432876f4616cc4e8 WatchSource:0}: Error finding container 6ff880cc1160cd75d2c0bea86bd25aac53877713ff5e04c6432876f4616cc4e8: Status 404 returned error can't find the container with id 6ff880cc1160cd75d2c0bea86bd25aac53877713ff5e04c6432876f4616cc4e8
Jul 27 15:53:01.772512 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.772415    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7cpkh" event={"ID":"01000c87-df01-472f-bd6c-e64b199bcc35","Type":"ContainerStarted","Data":"6ff880cc1160cd75d2c0bea86bd25aac53877713ff5e04c6432876f4616cc4e8"}
Jul 27 15:53:01.773868 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.773845    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6" event={"ID":"30247dd9-36f2-4249-ba97-2a7f90944475","Type":"ContainerStarted","Data":"2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7"}
Jul 27 15:53:01.773969 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.773882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6" event={"ID":"30247dd9-36f2-4249-ba97-2a7f90944475","Type":"ContainerStarted","Data":"6f242ae666e0f1a814975716452e5f45ea5a07c3125ffca5613568a50519119a"}
Jul 27 15:53:01.774021 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.773997    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:53:01.796052 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:01.796002    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6" podStartSLOduration=283.79598613 podStartE2EDuration="4m43.79598613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:53:01.795380625 +0000 UTC m=+284.476445056" watchObservedRunningTime="2026-07-27 15:53:01.79598613 +0000 UTC m=+284.477050559"
Jul 27 15:53:04.787641 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:04.787602    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7cpkh" event={"ID":"01000c87-df01-472f-bd6c-e64b199bcc35","Type":"ContainerStarted","Data":"fcab9efe38020e11205e15ca77c2a179b5a2cc88ee644c1bc546393f660739eb"}
Jul 27 15:53:04.788129 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:04.787664    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7cpkh" event={"ID":"01000c87-df01-472f-bd6c-e64b199bcc35","Type":"ContainerStarted","Data":"26591caa8d09cff72dd30d929b5dd132ea7e286a47c5c74e50011a930360af14"}
Jul 27 15:53:04.788129 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:04.787739    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:53:05.712744 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:05.712708    2579 patch_prober.go:28] interesting pod/console-54cdf4f694-6rkdn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.13:8443/health\": dial tcp 10.132.0.13:8443: connect: connection refused" start-of-body=
Jul 27 15:53:05.712912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:05.712759    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54cdf4f694-6rkdn" podUID="f61bb6c9-b05c-43cc-9cf6-58900b8d6631" containerName="console" probeResult="failure" output="Get \"https://10.132.0.13:8443/health\": dial tcp 10.132.0.13:8443: connect: connection refused"
Jul 27 15:53:08.072092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:08.072055    2579 patch_prober.go:28] interesting pod/console-75d6ff7867-dp9bx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body=
Jul 27 15:53:08.072457 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:08.072114    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75d6ff7867-dp9bx" podUID="398eddd6-4e2c-4adc-8d74-412b88b36715" containerName="console" probeResult="failure" output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused"
Jul 27 15:53:08.801170 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:08.801143    2579 generic.go:356] "Generic (PLEG): container finished" podID="b534d69f-dc4a-42a3-a71d-9f0bd6499673" containerID="37e7701a67c0cb79592f4354ae7c316e4f31b5f209ec628e09d942c52ba62ae0" exitCode=0
Jul 27 15:53:08.801267 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:08.801182    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz" event={"ID":"b534d69f-dc4a-42a3-a71d-9f0bd6499673","Type":"ContainerDied","Data":"37e7701a67c0cb79592f4354ae7c316e4f31b5f209ec628e09d942c52ba62ae0"}
Jul 27 15:53:08.801530 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:08.801515    2579 scope.go:117] "RemoveContainer" containerID="37e7701a67c0cb79592f4354ae7c316e4f31b5f209ec628e09d942c52ba62ae0"
Jul 27 15:53:08.817455 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:08.817414    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7cpkh" podStartSLOduration=255.470126024 podStartE2EDuration="4m17.817402734s" totalImagesPullingTime="2.34727671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:53:04.808883838 +0000 UTC m=+287.489948267" watchObservedRunningTime="2026-07-27 15:53:08.817402734 +0000 UTC m=+291.498467161"
Jul 27 15:53:09.806240 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:09.806210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz" event={"ID":"b534d69f-dc4a-42a3-a71d-9f0bd6499673","Type":"ContainerStarted","Data":"220d1bf640bcfef4ac8df0a1c80cb985a471dcc38987677868adb485247ae4c4"}
Jul 27 15:53:14.793431 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:14.793398    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7cpkh"
Jul 27 15:53:14.950056 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:14.950010    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" podUID="2a7efc39-457e-4db2-829a-67eb093d6a65" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 15:53:15.712566 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:15.712526    2579 patch_prober.go:28] interesting pod/console-54cdf4f694-6rkdn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.13:8443/health\": dial tcp 10.132.0.13:8443: connect: connection refused" start-of-body=
Jul 27 15:53:15.712785 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:15.712583    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54cdf4f694-6rkdn" podUID="f61bb6c9-b05c-43cc-9cf6-58900b8d6631" containerName="console" probeResult="failure" output="Get \"https://10.132.0.13:8443/health\": dial tcp 10.132.0.13:8443: connect: connection refused"
Jul 27 15:53:17.733940 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:17.733914    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 15:53:18.072809 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:18.072781    2579 patch_prober.go:28] interesting pod/console-75d6ff7867-dp9bx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body=
Jul 27 15:53:18.073777 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:18.072834    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-75d6ff7867-dp9bx" podUID="398eddd6-4e2c-4adc-8d74-412b88b36715" containerName="console" probeResult="failure" output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused"
Jul 27 15:53:21.371956 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:21.371917    2579 patch_prober.go:28] interesting pod/image-registry-7df4777f9c-6xjw6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 15:53:21.372327 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:21.371973    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6" podUID="30247dd9-36f2-4249-ba97-2a7f90944475" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 15:53:22.782800 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:22.782774    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:53:24.949251 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:24.949213    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" podUID="2a7efc39-457e-4db2-829a-67eb093d6a65" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 15:53:25.716514 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:25.716469    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:53:25.720237 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:25.720213    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:53:28.076426 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:28.076396    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:53:28.080101 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:28.080071    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:53:28.143098 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:28.143069    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54cdf4f694-6rkdn"]
Jul 27 15:53:30.654772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:30.654742    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df4777f9c-6xjw6"]
Jul 27 15:53:34.949713 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:34.949676    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" podUID="2a7efc39-457e-4db2-829a-67eb093d6a65" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 27 15:53:34.950155 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:34.949739    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt"
Jul 27 15:53:34.950219 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:34.950144    2579 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f9dcb3e069f6f317fa58e504762d09620aa421f782d7081ef0bacfa514272654"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 27 15:53:34.950219 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:34.950191    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" podUID="2a7efc39-457e-4db2-829a-67eb093d6a65" containerName="service-proxy" containerID="cri-o://f9dcb3e069f6f317fa58e504762d09620aa421f782d7081ef0bacfa514272654" gracePeriod=30
Jul 27 15:53:35.894935 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:35.894901    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a7efc39-457e-4db2-829a-67eb093d6a65" containerID="f9dcb3e069f6f317fa58e504762d09620aa421f782d7081ef0bacfa514272654" exitCode=2
Jul 27 15:53:35.895127 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:35.894978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" event={"ID":"2a7efc39-457e-4db2-829a-67eb093d6a65","Type":"ContainerDied","Data":"f9dcb3e069f6f317fa58e504762d09620aa421f782d7081ef0bacfa514272654"}
Jul 27 15:53:35.895127 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:35.895032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c7ddcc79d-bx2xt" event={"ID":"2a7efc39-457e-4db2-829a-67eb093d6a65","Type":"ContainerStarted","Data":"0e263aea59c59a7b915c93e5f783282314ea21ead35474daf2b30c1aeea56c97"}
Jul 27 15:53:52.690047 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.690013    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-758ff5f94c-44l54"]
Jul 27 15:53:52.693245 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.693222    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.705271 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.705246    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-758ff5f94c-44l54"]
Jul 27 15:53:52.782630 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.782602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf769\" (UniqueName: \"kubernetes.io/projected/3f423fa8-6f20-498e-9806-177fcf30654a-kube-api-access-nf769\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.782759 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.782632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-trusted-ca-bundle\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.782759 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.782664    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-console-config\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.782759 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.782699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-oauth-config\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.782759 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.782721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-serving-cert\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.782759 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.782740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-service-ca\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.782919 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.782806    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-oauth-serving-cert\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.883826 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.883784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-trusted-ca-bundle\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.883826 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.883836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-console-config\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.884011 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.883860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-oauth-config\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.884011 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.883882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-serving-cert\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.884011 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.883900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-service-ca\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.884011 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.883930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-oauth-serving-cert\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.884011 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.883980    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf769\" (UniqueName: \"kubernetes.io/projected/3f423fa8-6f20-498e-9806-177fcf30654a-kube-api-access-nf769\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.884703 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.884638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-service-ca\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.884845 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.884743    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-trusted-ca-bundle\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.884904 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.884843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-oauth-serving-cert\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.884904 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.884871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-console-config\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.886455 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.886432    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-oauth-config\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.886554 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.886461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-serving-cert\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:52.892506 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:52.892471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf769\" (UniqueName: \"kubernetes.io/projected/3f423fa8-6f20-498e-9806-177fcf30654a-kube-api-access-nf769\") pod \"console-758ff5f94c-44l54\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") " pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:53.002304 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.002202    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:53:53.128574 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.128410    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-758ff5f94c-44l54"]
Jul 27 15:53:53.131288 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:53:53.131261    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f423fa8_6f20_498e_9806_177fcf30654a.slice/crio-03118dfa11cc1f60a19589de0bbfb1508b2ec21a29f6de8793676966d8b4b313 WatchSource:0}: Error finding container 03118dfa11cc1f60a19589de0bbfb1508b2ec21a29f6de8793676966d8b4b313: Status 404 returned error can't find the container with id 03118dfa11cc1f60a19589de0bbfb1508b2ec21a29f6de8793676966d8b4b313
Jul 27 15:53:53.166108 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.166056    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54cdf4f694-6rkdn" podUID="f61bb6c9-b05c-43cc-9cf6-58900b8d6631" containerName="console" containerID="cri-o://8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c" gracePeriod=15
Jul 27 15:53:53.402798 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.402777    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:53:53.489648 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.489620    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-oauth-config\") pod \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") "
Jul 27 15:53:53.489763 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.489653    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-oauth-serving-cert\") pod \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") "
Jul 27 15:53:53.489763 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.489674    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-config\") pod \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") "
Jul 27 15:53:53.489763 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.489700    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z265v\" (UniqueName: \"kubernetes.io/projected/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-kube-api-access-z265v\") pod \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") "
Jul 27 15:53:53.489763 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.489752    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-serving-cert\") pod \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") "
Jul 27 15:53:53.489966 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.489791    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-service-ca\") pod \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\" (UID: \"f61bb6c9-b05c-43cc-9cf6-58900b8d6631\") "
Jul 27 15:53:53.490051 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.490005    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-config" (OuterVolumeSpecName: "console-config") pod "f61bb6c9-b05c-43cc-9cf6-58900b8d6631" (UID: "f61bb6c9-b05c-43cc-9cf6-58900b8d6631"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:53:53.490051 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.490041    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f61bb6c9-b05c-43cc-9cf6-58900b8d6631" (UID: "f61bb6c9-b05c-43cc-9cf6-58900b8d6631"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:53:53.490254 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.490227    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-service-ca" (OuterVolumeSpecName: "service-ca") pod "f61bb6c9-b05c-43cc-9cf6-58900b8d6631" (UID: "f61bb6c9-b05c-43cc-9cf6-58900b8d6631"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:53:53.491872 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.491852    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f61bb6c9-b05c-43cc-9cf6-58900b8d6631" (UID: "f61bb6c9-b05c-43cc-9cf6-58900b8d6631"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:53:53.491950 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.491878    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f61bb6c9-b05c-43cc-9cf6-58900b8d6631" (UID: "f61bb6c9-b05c-43cc-9cf6-58900b8d6631"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:53:53.491950 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.491892    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-kube-api-access-z265v" (OuterVolumeSpecName: "kube-api-access-z265v") pod "f61bb6c9-b05c-43cc-9cf6-58900b8d6631" (UID: "f61bb6c9-b05c-43cc-9cf6-58900b8d6631"). InnerVolumeSpecName "kube-api-access-z265v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:53:53.590782 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.590750    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-service-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:53.590782 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.590776    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-oauth-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:53.590782 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.590786    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-oauth-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:53.590984 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.590794    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:53.590984 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.590803    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z265v\" (UniqueName: \"kubernetes.io/projected/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-kube-api-access-z265v\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:53.590984 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.590811    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f61bb6c9-b05c-43cc-9cf6-58900b8d6631-console-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:53.957040 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.957003    2579 generic.go:356] "Generic (PLEG): container finished" podID="f61bb6c9-b05c-43cc-9cf6-58900b8d6631" containerID="8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c" exitCode=0
Jul 27 15:53:53.957374 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.957052    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cdf4f694-6rkdn"
Jul 27 15:53:53.957374 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.957048    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cdf4f694-6rkdn" event={"ID":"f61bb6c9-b05c-43cc-9cf6-58900b8d6631","Type":"ContainerDied","Data":"8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c"}
Jul 27 15:53:53.957374 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.957107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cdf4f694-6rkdn" event={"ID":"f61bb6c9-b05c-43cc-9cf6-58900b8d6631","Type":"ContainerDied","Data":"3aaae6118be61480e134e1d97291557e28680066afd2f989b48147ecfdb22815"}
Jul 27 15:53:53.957374 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.957137    2579 scope.go:117] "RemoveContainer" containerID="8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c"
Jul 27 15:53:53.958688 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.958664    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758ff5f94c-44l54" event={"ID":"3f423fa8-6f20-498e-9806-177fcf30654a","Type":"ContainerStarted","Data":"aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480"}
Jul 27 15:53:53.958795 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.958704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758ff5f94c-44l54" event={"ID":"3f423fa8-6f20-498e-9806-177fcf30654a","Type":"ContainerStarted","Data":"03118dfa11cc1f60a19589de0bbfb1508b2ec21a29f6de8793676966d8b4b313"}
Jul 27 15:53:53.964768 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.964749    2579 scope.go:117] "RemoveContainer" containerID="8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c"
Jul 27 15:53:53.965028 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:53:53.965009    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c\": container with ID starting with 8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c not found: ID does not exist" containerID="8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c"
Jul 27 15:53:53.965090 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.965044    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c"} err="failed to get container status \"8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c\": rpc error: code = NotFound desc = could not find container \"8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c\": container with ID starting with 8953246c17b4d410e1436600ec0a46f7d67065f602f6f3dda9d7240a5e30100c not found: ID does not exist"
Jul 27 15:53:53.980226 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.980184    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-758ff5f94c-44l54" podStartSLOduration=1.980168989 podStartE2EDuration="1.980168989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:53:53.979849085 +0000 UTC m=+336.660913528" watchObservedRunningTime="2026-07-27 15:53:53.980168989 +0000 UTC m=+336.661233420"
Jul 27 15:53:53.991657 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.991632    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54cdf4f694-6rkdn"]
Jul 27 15:53:53.995315 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:53.995293    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54cdf4f694-6rkdn"]
Jul 27 15:53:55.673318 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:55.673259    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6" podUID="30247dd9-36f2-4249-ba97-2a7f90944475" containerName="registry" containerID="cri-o://2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7" gracePeriod=30
Jul 27 15:53:55.904737 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:55.904715    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:53:55.930716 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:55.930651    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f61bb6c9-b05c-43cc-9cf6-58900b8d6631" path="/var/lib/kubelet/pods/f61bb6c9-b05c-43cc-9cf6-58900b8d6631/volumes"
Jul 27 15:53:55.967387 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:55.967355    2579 generic.go:356] "Generic (PLEG): container finished" podID="30247dd9-36f2-4249-ba97-2a7f90944475" containerID="2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7" exitCode=0
Jul 27 15:53:55.967541 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:55.967401    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6"
Jul 27 15:53:55.967541 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:55.967441    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6" event={"ID":"30247dd9-36f2-4249-ba97-2a7f90944475","Type":"ContainerDied","Data":"2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7"}
Jul 27 15:53:55.967541 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:55.967511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7df4777f9c-6xjw6" event={"ID":"30247dd9-36f2-4249-ba97-2a7f90944475","Type":"ContainerDied","Data":"6f242ae666e0f1a814975716452e5f45ea5a07c3125ffca5613568a50519119a"}
Jul 27 15:53:55.967541 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:55.967539    2579 scope.go:117] "RemoveContainer" containerID="2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7"
Jul 27 15:53:55.975302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:55.975282    2579 scope.go:117] "RemoveContainer" containerID="2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7"
Jul 27 15:53:55.975554 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:53:55.975536    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7\": container with ID starting with 2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7 not found: ID does not exist" containerID="2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7"
Jul 27 15:53:55.975598 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:55.975563    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7"} err="failed to get container status \"2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7\": rpc error: code = NotFound desc = could not find container \"2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7\": container with ID starting with 2bc5acfa1541e0c150990699aa3fd40c1d6d4f7bdebbe6ac00dd015b0543d0d7 not found: ID does not exist"
Jul 27 15:53:56.008944 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.008925    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-trusted-ca\") pod \"30247dd9-36f2-4249-ba97-2a7f90944475\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") "
Jul 27 15:53:56.009010 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.008952    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-image-registry-private-configuration\") pod \"30247dd9-36f2-4249-ba97-2a7f90944475\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") "
Jul 27 15:53:56.009010 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.008993    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-bound-sa-token\") pod \"30247dd9-36f2-4249-ba97-2a7f90944475\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") "
Jul 27 15:53:56.009082 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.009028    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30247dd9-36f2-4249-ba97-2a7f90944475-ca-trust-extracted\") pod \"30247dd9-36f2-4249-ba97-2a7f90944475\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") "
Jul 27 15:53:56.009115 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.009097    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmcsf\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-kube-api-access-nmcsf\") pod \"30247dd9-36f2-4249-ba97-2a7f90944475\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") "
Jul 27 15:53:56.009152 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.009123    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") pod \"30247dd9-36f2-4249-ba97-2a7f90944475\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") "
Jul 27 15:53:56.009200 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.009151    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-registry-certificates\") pod \"30247dd9-36f2-4249-ba97-2a7f90944475\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") "
Jul 27 15:53:56.009245 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.009198    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-installation-pull-secrets\") pod \"30247dd9-36f2-4249-ba97-2a7f90944475\" (UID: \"30247dd9-36f2-4249-ba97-2a7f90944475\") "
Jul 27 15:53:56.009637 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.009337    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "30247dd9-36f2-4249-ba97-2a7f90944475" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:53:56.009637 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.009485    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-trusted-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:56.009794 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.009723    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "30247dd9-36f2-4249-ba97-2a7f90944475" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:53:56.011638 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.011604    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "30247dd9-36f2-4249-ba97-2a7f90944475" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:53:56.011638 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.011626    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "30247dd9-36f2-4249-ba97-2a7f90944475" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:53:56.011772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.011630    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "30247dd9-36f2-4249-ba97-2a7f90944475" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:53:56.011822 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.011797    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-kube-api-access-nmcsf" (OuterVolumeSpecName: "kube-api-access-nmcsf") pod "30247dd9-36f2-4249-ba97-2a7f90944475" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475"). InnerVolumeSpecName "kube-api-access-nmcsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:53:56.011922 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.011899    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "30247dd9-36f2-4249-ba97-2a7f90944475" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:53:56.018455 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.018433    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30247dd9-36f2-4249-ba97-2a7f90944475-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "30247dd9-36f2-4249-ba97-2a7f90944475" (UID: "30247dd9-36f2-4249-ba97-2a7f90944475"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:53:56.110317 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.110282    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-bound-sa-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:56.110317 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.110314    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/30247dd9-36f2-4249-ba97-2a7f90944475-ca-trust-extracted\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:56.110317 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.110326    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmcsf\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-kube-api-access-nmcsf\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:56.110474 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.110336    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/30247dd9-36f2-4249-ba97-2a7f90944475-registry-tls\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:56.110474 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.110344    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/30247dd9-36f2-4249-ba97-2a7f90944475-registry-certificates\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:56.110474 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.110352    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-installation-pull-secrets\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:56.110474 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.110361    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/30247dd9-36f2-4249-ba97-2a7f90944475-image-registry-private-configuration\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:53:56.288294 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.288267    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7df4777f9c-6xjw6"]
Jul 27 15:53:56.292604 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:56.292583    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7df4777f9c-6xjw6"]
Jul 27 15:53:57.928974 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:53:57.928938    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30247dd9-36f2-4249-ba97-2a7f90944475" path="/var/lib/kubelet/pods/30247dd9-36f2-4249-ba97-2a7f90944475/volumes"
Jul 27 15:54:03.002619 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:03.002588    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:54:03.003007 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:03.002856    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:54:03.007161 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:03.007142    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:54:03.998465 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:03.998439    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:54:04.046338 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:04.046307    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d6ff7867-dp9bx"]
Jul 27 15:54:29.064946 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.064888    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-75d6ff7867-dp9bx" podUID="398eddd6-4e2c-4adc-8d74-412b88b36715" containerName="console" containerID="cri-o://0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2" gracePeriod=15
Jul 27 15:54:29.302336 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.302306    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:54:29.333620 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.333545    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-serving-cert\") pod \"398eddd6-4e2c-4adc-8d74-412b88b36715\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") "
Jul 27 15:54:29.333620 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.333614    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-oauth-config\") pod \"398eddd6-4e2c-4adc-8d74-412b88b36715\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") "
Jul 27 15:54:29.333801 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.333654    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-oauth-serving-cert\") pod \"398eddd6-4e2c-4adc-8d74-412b88b36715\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") "
Jul 27 15:54:29.333801 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.333680    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-service-ca\") pod \"398eddd6-4e2c-4adc-8d74-412b88b36715\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") "
Jul 27 15:54:29.333801 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.333707    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-console-config\") pod \"398eddd6-4e2c-4adc-8d74-412b88b36715\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") "
Jul 27 15:54:29.333801 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.333759    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgdvf\" (UniqueName: \"kubernetes.io/projected/398eddd6-4e2c-4adc-8d74-412b88b36715-kube-api-access-cgdvf\") pod \"398eddd6-4e2c-4adc-8d74-412b88b36715\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") "
Jul 27 15:54:29.333801 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.333774    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-trusted-ca-bundle\") pod \"398eddd6-4e2c-4adc-8d74-412b88b36715\" (UID: \"398eddd6-4e2c-4adc-8d74-412b88b36715\") "
Jul 27 15:54:29.334213 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.334142    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "398eddd6-4e2c-4adc-8d74-412b88b36715" (UID: "398eddd6-4e2c-4adc-8d74-412b88b36715"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:54:29.334213 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.334162    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-service-ca" (OuterVolumeSpecName: "service-ca") pod "398eddd6-4e2c-4adc-8d74-412b88b36715" (UID: "398eddd6-4e2c-4adc-8d74-412b88b36715"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:54:29.334363 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.334262    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-console-config" (OuterVolumeSpecName: "console-config") pod "398eddd6-4e2c-4adc-8d74-412b88b36715" (UID: "398eddd6-4e2c-4adc-8d74-412b88b36715"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:54:29.334363 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.334330    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "398eddd6-4e2c-4adc-8d74-412b88b36715" (UID: "398eddd6-4e2c-4adc-8d74-412b88b36715"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:54:29.335612 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.335591    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "398eddd6-4e2c-4adc-8d74-412b88b36715" (UID: "398eddd6-4e2c-4adc-8d74-412b88b36715"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:54:29.335680 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.335641    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "398eddd6-4e2c-4adc-8d74-412b88b36715" (UID: "398eddd6-4e2c-4adc-8d74-412b88b36715"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:54:29.335841 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.335823    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398eddd6-4e2c-4adc-8d74-412b88b36715-kube-api-access-cgdvf" (OuterVolumeSpecName: "kube-api-access-cgdvf") pod "398eddd6-4e2c-4adc-8d74-412b88b36715" (UID: "398eddd6-4e2c-4adc-8d74-412b88b36715"). InnerVolumeSpecName "kube-api-access-cgdvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:54:29.434218 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.434190    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-console-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:54:29.434218 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.434213    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgdvf\" (UniqueName: \"kubernetes.io/projected/398eddd6-4e2c-4adc-8d74-412b88b36715-kube-api-access-cgdvf\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:54:29.434363 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.434224    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-trusted-ca-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:54:29.434363 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.434233    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:54:29.434363 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.434241    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/398eddd6-4e2c-4adc-8d74-412b88b36715-console-oauth-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:54:29.434363 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.434250    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-oauth-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:54:29.434363 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:29.434258    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/398eddd6-4e2c-4adc-8d74-412b88b36715-service-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:54:30.076997 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:30.076966    2579 generic.go:356] "Generic (PLEG): container finished" podID="398eddd6-4e2c-4adc-8d74-412b88b36715" containerID="0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2" exitCode=0
Jul 27 15:54:30.077424 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:30.077006    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d6ff7867-dp9bx" event={"ID":"398eddd6-4e2c-4adc-8d74-412b88b36715","Type":"ContainerDied","Data":"0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2"}
Jul 27 15:54:30.077424 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:30.077012    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d6ff7867-dp9bx"
Jul 27 15:54:30.077424 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:30.077053    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d6ff7867-dp9bx" event={"ID":"398eddd6-4e2c-4adc-8d74-412b88b36715","Type":"ContainerDied","Data":"aaea9d18525ea6902d5969a52cacf48ab9bcce5d0b9630041d389f5002cbe2b7"}
Jul 27 15:54:30.077424 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:30.077091    2579 scope.go:117] "RemoveContainer" containerID="0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2"
Jul 27 15:54:30.084795 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:30.084777    2579 scope.go:117] "RemoveContainer" containerID="0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2"
Jul 27 15:54:30.085061 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:54:30.085043    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2\": container with ID starting with 0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2 not found: ID does not exist" containerID="0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2"
Jul 27 15:54:30.085134 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:30.085069    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2"} err="failed to get container status \"0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2\": rpc error: code = NotFound desc = could not find container \"0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2\": container with ID starting with 0d4300fc0f3e7a3710d54b0eb7cf981e38c6985498772faa791cc84a50381aa2 not found: ID does not exist"
Jul 27 15:54:30.092512 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:30.092478    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d6ff7867-dp9bx"]
Jul 27 15:54:30.096521 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:30.096486    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75d6ff7867-dp9bx"]
Jul 27 15:54:31.929000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:54:31.928973    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="398eddd6-4e2c-4adc-8d74-412b88b36715" path="/var/lib/kubelet/pods/398eddd6-4e2c-4adc-8d74-412b88b36715/volumes"
Jul 27 15:55:16.351065 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.351031    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c97b659dd-fgxmf"]
Jul 27 15:55:16.351650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.351336    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398eddd6-4e2c-4adc-8d74-412b88b36715" containerName="console"
Jul 27 15:55:16.351650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.351354    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="398eddd6-4e2c-4adc-8d74-412b88b36715" containerName="console"
Jul 27 15:55:16.351650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.351379    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30247dd9-36f2-4249-ba97-2a7f90944475" containerName="registry"
Jul 27 15:55:16.351650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.351388    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="30247dd9-36f2-4249-ba97-2a7f90944475" containerName="registry"
Jul 27 15:55:16.351650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.351402    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61bb6c9-b05c-43cc-9cf6-58900b8d6631" containerName="console"
Jul 27 15:55:16.351650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.351409    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61bb6c9-b05c-43cc-9cf6-58900b8d6631" containerName="console"
Jul 27 15:55:16.351650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.351459    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61bb6c9-b05c-43cc-9cf6-58900b8d6631" containerName="console"
Jul 27 15:55:16.351650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.351470    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="398eddd6-4e2c-4adc-8d74-412b88b36715" containerName="console"
Jul 27 15:55:16.351650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.351477    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="30247dd9-36f2-4249-ba97-2a7f90944475" containerName="registry"
Jul 27 15:55:16.354317 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.354297    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.366461 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.366431    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c97b659dd-fgxmf"]
Jul 27 15:55:16.446781 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.446748    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gfg6\" (UniqueName: \"kubernetes.io/projected/896bad3d-352b-4287-81c6-d23290baa686-kube-api-access-8gfg6\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.446781 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.446782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-service-ca\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.446969 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.446799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-oauth-serving-cert\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.446969 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.446816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-serving-cert\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.446969 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.446831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-console-config\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.446969 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.446893    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-oauth-config\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.446969 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.446951    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-trusted-ca-bundle\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.548179 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.548149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-trusted-ca-bundle\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.548339 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.548195    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gfg6\" (UniqueName: \"kubernetes.io/projected/896bad3d-352b-4287-81c6-d23290baa686-kube-api-access-8gfg6\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.548339 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.548225    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-service-ca\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.548339 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.548242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-oauth-serving-cert\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.548339 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.548259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-serving-cert\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.548339 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.548281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-console-config\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.548339 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.548304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-oauth-config\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.548995 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.548972    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-oauth-serving-cert\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.549129 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.549088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-service-ca\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.549181 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.549124    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-trusted-ca-bundle\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.549181 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.549124    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-console-config\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.550812 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.550791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-serving-cert\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.550929 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.550903    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-oauth-config\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.556535 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.556490    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gfg6\" (UniqueName: \"kubernetes.io/projected/896bad3d-352b-4287-81c6-d23290baa686-kube-api-access-8gfg6\") pod \"console-5c97b659dd-fgxmf\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") " pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.662772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.662721    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:16.783016 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:16.782989    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c97b659dd-fgxmf"]
Jul 27 15:55:16.785232 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:55:16.785207    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896bad3d_352b_4287_81c6_d23290baa686.slice/crio-df3692c96aac3c2e0c792d10a0f38be1466c85e74229d7a9eeb339f9f6132151 WatchSource:0}: Error finding container df3692c96aac3c2e0c792d10a0f38be1466c85e74229d7a9eeb339f9f6132151: Status 404 returned error can't find the container with id df3692c96aac3c2e0c792d10a0f38be1466c85e74229d7a9eeb339f9f6132151
Jul 27 15:55:17.230511 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:17.230461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c97b659dd-fgxmf" event={"ID":"896bad3d-352b-4287-81c6-d23290baa686","Type":"ContainerStarted","Data":"82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda"}
Jul 27 15:55:17.230668 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:17.230530    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c97b659dd-fgxmf" event={"ID":"896bad3d-352b-4287-81c6-d23290baa686","Type":"ContainerStarted","Data":"df3692c96aac3c2e0c792d10a0f38be1466c85e74229d7a9eeb339f9f6132151"}
Jul 27 15:55:17.249438 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:17.249391    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c97b659dd-fgxmf" podStartSLOduration=1.249377475 podStartE2EDuration="1.249377475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:55:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:55:17.249012408 +0000 UTC m=+419.930076836" watchObservedRunningTime="2026-07-27 15:55:17.249377475 +0000 UTC m=+419.930441906"
Jul 27 15:55:26.663509 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:26.663469    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:26.663895 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:26.663533    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:26.667906 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:26.667883    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:27.265283 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:27.265253    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:55:27.311132 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:27.311103    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-758ff5f94c-44l54"]
Jul 27 15:55:52.330483 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.330441    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-758ff5f94c-44l54" podUID="3f423fa8-6f20-498e-9806-177fcf30654a" containerName="console" containerID="cri-o://aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480" gracePeriod=15
Jul 27 15:55:52.555666 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.555646    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:55:52.691164 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.691111    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-oauth-config\") pod \"3f423fa8-6f20-498e-9806-177fcf30654a\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") "
Jul 27 15:55:52.691265 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.691176    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-trusted-ca-bundle\") pod \"3f423fa8-6f20-498e-9806-177fcf30654a\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") "
Jul 27 15:55:52.691265 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.691191    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-serving-cert\") pod \"3f423fa8-6f20-498e-9806-177fcf30654a\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") "
Jul 27 15:55:52.691265 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.691216    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-oauth-serving-cert\") pod \"3f423fa8-6f20-498e-9806-177fcf30654a\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") "
Jul 27 15:55:52.691265 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.691231    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-service-ca\") pod \"3f423fa8-6f20-498e-9806-177fcf30654a\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") "
Jul 27 15:55:52.691265 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.691248    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf769\" (UniqueName: \"kubernetes.io/projected/3f423fa8-6f20-498e-9806-177fcf30654a-kube-api-access-nf769\") pod \"3f423fa8-6f20-498e-9806-177fcf30654a\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") "
Jul 27 15:55:52.691481 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.691271    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-console-config\") pod \"3f423fa8-6f20-498e-9806-177fcf30654a\" (UID: \"3f423fa8-6f20-498e-9806-177fcf30654a\") "
Jul 27 15:55:52.691681 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.691641    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3f423fa8-6f20-498e-9806-177fcf30654a" (UID: "3f423fa8-6f20-498e-9806-177fcf30654a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:55:52.691795 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.691705    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3f423fa8-6f20-498e-9806-177fcf30654a" (UID: "3f423fa8-6f20-498e-9806-177fcf30654a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:55:52.691795 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.691712    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-service-ca" (OuterVolumeSpecName: "service-ca") pod "3f423fa8-6f20-498e-9806-177fcf30654a" (UID: "3f423fa8-6f20-498e-9806-177fcf30654a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:55:52.691905 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.691783    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-console-config" (OuterVolumeSpecName: "console-config") pod "3f423fa8-6f20-498e-9806-177fcf30654a" (UID: "3f423fa8-6f20-498e-9806-177fcf30654a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:55:52.693142 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.693122    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3f423fa8-6f20-498e-9806-177fcf30654a" (UID: "3f423fa8-6f20-498e-9806-177fcf30654a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:55:52.693223 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.693148    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3f423fa8-6f20-498e-9806-177fcf30654a" (UID: "3f423fa8-6f20-498e-9806-177fcf30654a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:55:52.693362 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.693345    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f423fa8-6f20-498e-9806-177fcf30654a-kube-api-access-nf769" (OuterVolumeSpecName: "kube-api-access-nf769") pod "3f423fa8-6f20-498e-9806-177fcf30654a" (UID: "3f423fa8-6f20-498e-9806-177fcf30654a"). InnerVolumeSpecName "kube-api-access-nf769". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:55:52.792628 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.792603    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-oauth-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:55:52.792628 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.792624    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-trusted-ca-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:55:52.792776 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.792635    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f423fa8-6f20-498e-9806-177fcf30654a-console-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:55:52.792776 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.792655    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-oauth-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:55:52.792776 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.792664    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-service-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:55:52.792776 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.792673    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf769\" (UniqueName: \"kubernetes.io/projected/3f423fa8-6f20-498e-9806-177fcf30654a-kube-api-access-nf769\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:55:52.792776 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:52.792680    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f423fa8-6f20-498e-9806-177fcf30654a-console-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:55:53.344012 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:53.343979    2579 generic.go:356] "Generic (PLEG): container finished" podID="3f423fa8-6f20-498e-9806-177fcf30654a" containerID="aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480" exitCode=0
Jul 27 15:55:53.344375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:53.344020    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-758ff5f94c-44l54"
Jul 27 15:55:53.344375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:53.344033    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758ff5f94c-44l54" event={"ID":"3f423fa8-6f20-498e-9806-177fcf30654a","Type":"ContainerDied","Data":"aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480"}
Jul 27 15:55:53.344375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:53.344069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-758ff5f94c-44l54" event={"ID":"3f423fa8-6f20-498e-9806-177fcf30654a","Type":"ContainerDied","Data":"03118dfa11cc1f60a19589de0bbfb1508b2ec21a29f6de8793676966d8b4b313"}
Jul 27 15:55:53.344375 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:53.344088    2579 scope.go:117] "RemoveContainer" containerID="aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480"
Jul 27 15:55:53.351701 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:53.351684    2579 scope.go:117] "RemoveContainer" containerID="aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480"
Jul 27 15:55:53.351960 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:55:53.351942    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480\": container with ID starting with aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480 not found: ID does not exist" containerID="aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480"
Jul 27 15:55:53.352009 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:53.351968    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480"} err="failed to get container status \"aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480\": rpc error: code = NotFound desc = could not find container \"aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480\": container with ID starting with aaa4bd140c0e652b15d98ba6754c7117cbd40a53fa5de4fc3da1717d92dd7480 not found: ID does not exist"
Jul 27 15:55:53.363107 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:53.363084    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-758ff5f94c-44l54"]
Jul 27 15:55:53.368562 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:53.368543    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-758ff5f94c-44l54"]
Jul 27 15:55:53.928398 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:55:53.928370    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f423fa8-6f20-498e-9806-177fcf30654a" path="/var/lib/kubelet/pods/3f423fa8-6f20-498e-9806-177fcf30654a/volumes"
Jul 27 15:56:12.202462 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.202422    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"]
Jul 27 15:56:12.202844 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.202679    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f423fa8-6f20-498e-9806-177fcf30654a" containerName="console"
Jul 27 15:56:12.202844 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.202690    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f423fa8-6f20-498e-9806-177fcf30654a" containerName="console"
Jul 27 15:56:12.202844 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.202742    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f423fa8-6f20-498e-9806-177fcf30654a" containerName="console"
Jul 27 15:56:12.205491 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.205472    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:12.207926 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.207903    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 15:56:12.208048 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.207954    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-krxhc\""
Jul 27 15:56:12.208634 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.208619    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 15:56:12.214247 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.214225    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"]
Jul 27 15:56:12.320593 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.320558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:12.320593 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.320591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:12.320794 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.320621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggm5h\" (UniqueName: \"kubernetes.io/projected/a5ca40b4-287c-4d24-8c6d-174aeffaff05-kube-api-access-ggm5h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:12.421968 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.421938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:12.421968 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.421965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:12.422165 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.421995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggm5h\" (UniqueName: \"kubernetes.io/projected/a5ca40b4-287c-4d24-8c6d-174aeffaff05-kube-api-access-ggm5h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:12.422385 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.422365    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:12.422430 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.422374    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:12.430204 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.430181    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggm5h\" (UniqueName: \"kubernetes.io/projected/a5ca40b4-287c-4d24-8c6d-174aeffaff05-kube-api-access-ggm5h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:12.515168 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.515083    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:12.634346 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.634207    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"]
Jul 27 15:56:12.636907 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:56:12.636876    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ca40b4_287c_4d24_8c6d_174aeffaff05.slice/crio-7b4042eb1094e0b073b8036e8efc8d54970899706ad8834998b4da4ebfbc6629 WatchSource:0}: Error finding container 7b4042eb1094e0b073b8036e8efc8d54970899706ad8834998b4da4ebfbc6629: Status 404 returned error can't find the container with id 7b4042eb1094e0b073b8036e8efc8d54970899706ad8834998b4da4ebfbc6629
Jul 27 15:56:12.638823 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:12.638802    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 15:56:13.411838 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:13.411802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2" event={"ID":"a5ca40b4-287c-4d24-8c6d-174aeffaff05","Type":"ContainerStarted","Data":"7b4042eb1094e0b073b8036e8efc8d54970899706ad8834998b4da4ebfbc6629"}
Jul 27 15:56:19.435892 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:19.435855    2579 generic.go:356] "Generic (PLEG): container finished" podID="a5ca40b4-287c-4d24-8c6d-174aeffaff05" containerID="3eed945da6be681499bcfe5a35598c28f32827e849fb07ee824d537ae7493cab" exitCode=0
Jul 27 15:56:19.436274 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:19.435919    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2" event={"ID":"a5ca40b4-287c-4d24-8c6d-174aeffaff05","Type":"ContainerDied","Data":"3eed945da6be681499bcfe5a35598c28f32827e849fb07ee824d537ae7493cab"}
Jul 27 15:56:21.443961 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:21.443930    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2" event={"ID":"a5ca40b4-287c-4d24-8c6d-174aeffaff05","Type":"ContainerStarted","Data":"2474152ca2e73ee1d3132c0f73897fbc0bc648a41b70e5c16f2bd439d4d63c1c"}
Jul 27 15:56:22.449015 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:22.448982    2579 generic.go:356] "Generic (PLEG): container finished" podID="a5ca40b4-287c-4d24-8c6d-174aeffaff05" containerID="2474152ca2e73ee1d3132c0f73897fbc0bc648a41b70e5c16f2bd439d4d63c1c" exitCode=0
Jul 27 15:56:22.449463 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:22.449067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2" event={"ID":"a5ca40b4-287c-4d24-8c6d-174aeffaff05","Type":"ContainerDied","Data":"2474152ca2e73ee1d3132c0f73897fbc0bc648a41b70e5c16f2bd439d4d63c1c"}
Jul 27 15:56:31.483909 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:31.483877    2579 generic.go:356] "Generic (PLEG): container finished" podID="a5ca40b4-287c-4d24-8c6d-174aeffaff05" containerID="5677e1e55a0fcd6565d95292f4da1d452f35dc2137820fe1851f322aa7590501" exitCode=0
Jul 27 15:56:31.484314 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:31.483953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2" event={"ID":"a5ca40b4-287c-4d24-8c6d-174aeffaff05","Type":"ContainerDied","Data":"5677e1e55a0fcd6565d95292f4da1d452f35dc2137820fe1851f322aa7590501"}
Jul 27 15:56:32.607861 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:32.607835    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:32.671239 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:32.671211    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-bundle\") pod \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") "
Jul 27 15:56:32.671374 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:32.671264    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggm5h\" (UniqueName: \"kubernetes.io/projected/a5ca40b4-287c-4d24-8c6d-174aeffaff05-kube-api-access-ggm5h\") pod \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") "
Jul 27 15:56:32.671374 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:32.671281    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-util\") pod \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\" (UID: \"a5ca40b4-287c-4d24-8c6d-174aeffaff05\") "
Jul 27 15:56:32.671846 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:32.671819    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-bundle" (OuterVolumeSpecName: "bundle") pod "a5ca40b4-287c-4d24-8c6d-174aeffaff05" (UID: "a5ca40b4-287c-4d24-8c6d-174aeffaff05"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:32.673301 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:32.673278    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5ca40b4-287c-4d24-8c6d-174aeffaff05-kube-api-access-ggm5h" (OuterVolumeSpecName: "kube-api-access-ggm5h") pod "a5ca40b4-287c-4d24-8c6d-174aeffaff05" (UID: "a5ca40b4-287c-4d24-8c6d-174aeffaff05"). InnerVolumeSpecName "kube-api-access-ggm5h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:56:32.676761 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:32.676738    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-util" (OuterVolumeSpecName: "util") pod "a5ca40b4-287c-4d24-8c6d-174aeffaff05" (UID: "a5ca40b4-287c-4d24-8c6d-174aeffaff05"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:32.772112 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:32.772042    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:56:32.772112 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:32.772067    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggm5h\" (UniqueName: \"kubernetes.io/projected/a5ca40b4-287c-4d24-8c6d-174aeffaff05-kube-api-access-ggm5h\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:56:32.772112 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:32.772077    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5ca40b4-287c-4d24-8c6d-174aeffaff05-util\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:56:33.492166 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:33.492139    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2"
Jul 27 15:56:33.492166 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:33.492143    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lmgl2" event={"ID":"a5ca40b4-287c-4d24-8c6d-174aeffaff05","Type":"ContainerDied","Data":"7b4042eb1094e0b073b8036e8efc8d54970899706ad8834998b4da4ebfbc6629"}
Jul 27 15:56:33.492370 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:33.492187    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b4042eb1094e0b073b8036e8efc8d54970899706ad8834998b4da4ebfbc6629"
Jul 27 15:56:40.246026 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.245994    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5"]
Jul 27 15:56:40.246413 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.246223    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ca40b4-287c-4d24-8c6d-174aeffaff05" containerName="util"
Jul 27 15:56:40.246413 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.246235    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ca40b4-287c-4d24-8c6d-174aeffaff05" containerName="util"
Jul 27 15:56:40.246413 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.246258    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ca40b4-287c-4d24-8c6d-174aeffaff05" containerName="pull"
Jul 27 15:56:40.246413 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.246264    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ca40b4-287c-4d24-8c6d-174aeffaff05" containerName="pull"
Jul 27 15:56:40.246413 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.246271    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ca40b4-287c-4d24-8c6d-174aeffaff05" containerName="extract"
Jul 27 15:56:40.246413 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.246276    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ca40b4-287c-4d24-8c6d-174aeffaff05" containerName="extract"
Jul 27 15:56:40.246413 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.246315    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5ca40b4-287c-4d24-8c6d-174aeffaff05" containerName="extract"
Jul 27 15:56:40.248181 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.248164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5"
Jul 27 15:56:40.250457 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.250438    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 27 15:56:40.250652 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.250438    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 27 15:56:40.250785 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.250769    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-vf4bw\""
Jul 27 15:56:40.262291 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.262260    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5"]
Jul 27 15:56:40.328224 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.328186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hzdb\" (UniqueName: \"kubernetes.io/projected/b86fa86b-16e4-4398-ab5c-f69a7c04bf08-kube-api-access-9hzdb\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rdk5\" (UID: \"b86fa86b-16e4-4398-ab5c-f69a7c04bf08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5"
Jul 27 15:56:40.328382 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.328238    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b86fa86b-16e4-4398-ab5c-f69a7c04bf08-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rdk5\" (UID: \"b86fa86b-16e4-4398-ab5c-f69a7c04bf08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5"
Jul 27 15:56:40.429229 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.429184    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hzdb\" (UniqueName: \"kubernetes.io/projected/b86fa86b-16e4-4398-ab5c-f69a7c04bf08-kube-api-access-9hzdb\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rdk5\" (UID: \"b86fa86b-16e4-4398-ab5c-f69a7c04bf08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5"
Jul 27 15:56:40.429365 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.429242    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b86fa86b-16e4-4398-ab5c-f69a7c04bf08-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rdk5\" (UID: \"b86fa86b-16e4-4398-ab5c-f69a7c04bf08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5"
Jul 27 15:56:40.429586 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.429570    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b86fa86b-16e4-4398-ab5c-f69a7c04bf08-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rdk5\" (UID: \"b86fa86b-16e4-4398-ab5c-f69a7c04bf08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5"
Jul 27 15:56:40.437755 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.437733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hzdb\" (UniqueName: \"kubernetes.io/projected/b86fa86b-16e4-4398-ab5c-f69a7c04bf08-kube-api-access-9hzdb\") pod \"cert-manager-operator-controller-manager-55c444bf86-8rdk5\" (UID: \"b86fa86b-16e4-4398-ab5c-f69a7c04bf08\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5"
Jul 27 15:56:40.561212 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.561183    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5"
Jul 27 15:56:40.682454 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:40.682430    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5"]
Jul 27 15:56:40.685124 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:56:40.685097    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86fa86b_16e4_4398_ab5c_f69a7c04bf08.slice/crio-e48509fde68dfe0640358472888070e40b7a650523f47d06111d993d553bb962 WatchSource:0}: Error finding container e48509fde68dfe0640358472888070e40b7a650523f47d06111d993d553bb962: Status 404 returned error can't find the container with id e48509fde68dfe0640358472888070e40b7a650523f47d06111d993d553bb962
Jul 27 15:56:41.520893 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:41.520852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5" event={"ID":"b86fa86b-16e4-4398-ab5c-f69a7c04bf08","Type":"ContainerStarted","Data":"e48509fde68dfe0640358472888070e40b7a650523f47d06111d993d553bb962"}
Jul 27 15:56:42.526182 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:42.526153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5" event={"ID":"b86fa86b-16e4-4398-ab5c-f69a7c04bf08","Type":"ContainerStarted","Data":"7212adb1a6cc73f3e23cd7e60609f61fda63e9971d7e22a6565cc31cfdf7a1f3"}
Jul 27 15:56:42.550882 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:42.550835    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8rdk5" podStartSLOduration=0.90541986 podStartE2EDuration="2.550815744s" totalImagesPullingTime="1.645395884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:56:42.549507666 +0000 UTC m=+505.230572088" watchObservedRunningTime="2026-07-27 15:56:42.550815744 +0000 UTC m=+505.231880175"
Jul 27 15:56:43.722358 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.722326    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"]
Jul 27 15:56:43.724671 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.724652    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:43.726770 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.726745    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 15:56:43.727416 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.727396    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-krxhc\""
Jul 27 15:56:43.727520 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.727396    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 15:56:43.734015 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.733996    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"]
Jul 27 15:56:43.855400 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.855370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqg4c\" (UniqueName: \"kubernetes.io/projected/589dcf80-9ae0-4108-b69e-0903a371653f-kube-api-access-gqg4c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:43.855547 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.855412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:43.855547 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.855435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:43.955812 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.955786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:43.955923 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.955821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:43.955923 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.955851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqg4c\" (UniqueName: \"kubernetes.io/projected/589dcf80-9ae0-4108-b69e-0903a371653f-kube-api-access-gqg4c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:43.956236 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.956212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:43.956274 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.956220    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:43.967393 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:43.967367    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqg4c\" (UniqueName: \"kubernetes.io/projected/589dcf80-9ae0-4108-b69e-0903a371653f-kube-api-access-gqg4c\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:44.032414 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:44.032383    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:44.154989 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:44.154969    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"]
Jul 27 15:56:44.157038 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:56:44.156993    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod589dcf80_9ae0_4108_b69e_0903a371653f.slice/crio-9f0b9a9c1b87d916538c3945cf3615f9da6baedde971d66dd482217616f18bab WatchSource:0}: Error finding container 9f0b9a9c1b87d916538c3945cf3615f9da6baedde971d66dd482217616f18bab: Status 404 returned error can't find the container with id 9f0b9a9c1b87d916538c3945cf3615f9da6baedde971d66dd482217616f18bab
Jul 27 15:56:44.533287 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:44.533257    2579 generic.go:356] "Generic (PLEG): container finished" podID="589dcf80-9ae0-4108-b69e-0903a371653f" containerID="a1bce961810c0b0f4e6b9661f6e83415e57a919fb01e47fd85225a91e9fd708f" exitCode=0
Jul 27 15:56:44.533429 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:44.533310    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98" event={"ID":"589dcf80-9ae0-4108-b69e-0903a371653f","Type":"ContainerDied","Data":"a1bce961810c0b0f4e6b9661f6e83415e57a919fb01e47fd85225a91e9fd708f"}
Jul 27 15:56:44.533429 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:44.533356    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98" event={"ID":"589dcf80-9ae0-4108-b69e-0903a371653f","Type":"ContainerStarted","Data":"9f0b9a9c1b87d916538c3945cf3615f9da6baedde971d66dd482217616f18bab"}
Jul 27 15:56:47.545877 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:47.545838    2579 generic.go:356] "Generic (PLEG): container finished" podID="589dcf80-9ae0-4108-b69e-0903a371653f" containerID="1d87ef77e7050414d92c08e500b6f5382609e957389d08333164481e4b68fce8" exitCode=0
Jul 27 15:56:47.546218 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:47.545922    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98" event={"ID":"589dcf80-9ae0-4108-b69e-0903a371653f","Type":"ContainerDied","Data":"1d87ef77e7050414d92c08e500b6f5382609e957389d08333164481e4b68fce8"}
Jul 27 15:56:48.551390 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:48.551354    2579 generic.go:356] "Generic (PLEG): container finished" podID="589dcf80-9ae0-4108-b69e-0903a371653f" containerID="60d76e7dc03ddfe534239c26c71ad8fd1dfc87a529a291d23d6071490eccf5c7" exitCode=0
Jul 27 15:56:48.551819 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:48.551400    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98" event={"ID":"589dcf80-9ae0-4108-b69e-0903a371653f","Type":"ContainerDied","Data":"60d76e7dc03ddfe534239c26c71ad8fd1dfc87a529a291d23d6071490eccf5c7"}
Jul 27 15:56:49.680108 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:49.680084    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:49.802301 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:49.802266    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-bundle\") pod \"589dcf80-9ae0-4108-b69e-0903a371653f\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") "
Jul 27 15:56:49.802449 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:49.802333    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-util\") pod \"589dcf80-9ae0-4108-b69e-0903a371653f\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") "
Jul 27 15:56:49.802449 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:49.802362    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqg4c\" (UniqueName: \"kubernetes.io/projected/589dcf80-9ae0-4108-b69e-0903a371653f-kube-api-access-gqg4c\") pod \"589dcf80-9ae0-4108-b69e-0903a371653f\" (UID: \"589dcf80-9ae0-4108-b69e-0903a371653f\") "
Jul 27 15:56:49.802772 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:49.802747    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-bundle" (OuterVolumeSpecName: "bundle") pod "589dcf80-9ae0-4108-b69e-0903a371653f" (UID: "589dcf80-9ae0-4108-b69e-0903a371653f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:49.804424 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:49.804399    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/589dcf80-9ae0-4108-b69e-0903a371653f-kube-api-access-gqg4c" (OuterVolumeSpecName: "kube-api-access-gqg4c") pod "589dcf80-9ae0-4108-b69e-0903a371653f" (UID: "589dcf80-9ae0-4108-b69e-0903a371653f"). InnerVolumeSpecName "kube-api-access-gqg4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:56:49.806919 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:49.806862    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-util" (OuterVolumeSpecName: "util") pod "589dcf80-9ae0-4108-b69e-0903a371653f" (UID: "589dcf80-9ae0-4108-b69e-0903a371653f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:56:49.903397 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:49.903356    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:56:49.903397 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:49.903389    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/589dcf80-9ae0-4108-b69e-0903a371653f-util\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:56:49.903397 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:49.903398    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqg4c\" (UniqueName: \"kubernetes.io/projected/589dcf80-9ae0-4108-b69e-0903a371653f-kube-api-access-gqg4c\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:56:50.560291 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:50.560256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98" event={"ID":"589dcf80-9ae0-4108-b69e-0903a371653f","Type":"ContainerDied","Data":"9f0b9a9c1b87d916538c3945cf3615f9da6baedde971d66dd482217616f18bab"}
Jul 27 15:56:50.560291 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:50.560278    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzjj98"
Jul 27 15:56:50.560481 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:50.560313    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f0b9a9c1b87d916538c3945cf3615f9da6baedde971d66dd482217616f18bab"
Jul 27 15:56:51.159756 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.159721    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx"]
Jul 27 15:56:51.160149 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.159972    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589dcf80-9ae0-4108-b69e-0903a371653f" containerName="util"
Jul 27 15:56:51.160149 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.159983    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="589dcf80-9ae0-4108-b69e-0903a371653f" containerName="util"
Jul 27 15:56:51.160149 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.159995    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589dcf80-9ae0-4108-b69e-0903a371653f" containerName="pull"
Jul 27 15:56:51.160149 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.160001    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="589dcf80-9ae0-4108-b69e-0903a371653f" containerName="pull"
Jul 27 15:56:51.160149 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.160007    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="589dcf80-9ae0-4108-b69e-0903a371653f" containerName="extract"
Jul 27 15:56:51.160149 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.160012    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="589dcf80-9ae0-4108-b69e-0903a371653f" containerName="extract"
Jul 27 15:56:51.160149 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.160054    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="589dcf80-9ae0-4108-b69e-0903a371653f" containerName="extract"
Jul 27 15:56:51.162059 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.162042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx"
Jul 27 15:56:51.164127 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.164101    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 15:56:51.164238 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.164108    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 15:56:51.164238 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.164225    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5vn2m\""
Jul 27 15:56:51.170134 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.170111    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx"]
Jul 27 15:56:51.313696 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.313660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16ac6cba-0407-4c8e-8a06-fc76a449b16c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hqgcx\" (UID: \"16ac6cba-0407-4c8e-8a06-fc76a449b16c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx"
Jul 27 15:56:51.313893 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.313730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6mnj\" (UniqueName: \"kubernetes.io/projected/16ac6cba-0407-4c8e-8a06-fc76a449b16c-kube-api-access-w6mnj\") pod \"cert-manager-cainjector-559cdd8c87-hqgcx\" (UID: \"16ac6cba-0407-4c8e-8a06-fc76a449b16c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx"
Jul 27 15:56:51.415104 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.415016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6mnj\" (UniqueName: \"kubernetes.io/projected/16ac6cba-0407-4c8e-8a06-fc76a449b16c-kube-api-access-w6mnj\") pod \"cert-manager-cainjector-559cdd8c87-hqgcx\" (UID: \"16ac6cba-0407-4c8e-8a06-fc76a449b16c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx"
Jul 27 15:56:51.415104 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.415064    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16ac6cba-0407-4c8e-8a06-fc76a449b16c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hqgcx\" (UID: \"16ac6cba-0407-4c8e-8a06-fc76a449b16c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx"
Jul 27 15:56:51.425842 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.425817    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16ac6cba-0407-4c8e-8a06-fc76a449b16c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hqgcx\" (UID: \"16ac6cba-0407-4c8e-8a06-fc76a449b16c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx"
Jul 27 15:56:51.426138 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.426117    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6mnj\" (UniqueName: \"kubernetes.io/projected/16ac6cba-0407-4c8e-8a06-fc76a449b16c-kube-api-access-w6mnj\") pod \"cert-manager-cainjector-559cdd8c87-hqgcx\" (UID: \"16ac6cba-0407-4c8e-8a06-fc76a449b16c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx"
Jul 27 15:56:51.471947 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.471914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx"
Jul 27 15:56:51.593449 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:51.593418    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx"]
Jul 27 15:56:51.596624 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:56:51.596594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16ac6cba_0407_4c8e_8a06_fc76a449b16c.slice/crio-9f3430e882439d4bdda191ea32e1fe261b64e09893ed79ab64701c14f8ddb9df WatchSource:0}: Error finding container 9f3430e882439d4bdda191ea32e1fe261b64e09893ed79ab64701c14f8ddb9df: Status 404 returned error can't find the container with id 9f3430e882439d4bdda191ea32e1fe261b64e09893ed79ab64701c14f8ddb9df
Jul 27 15:56:52.570144 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:52.570099    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx" event={"ID":"16ac6cba-0407-4c8e-8a06-fc76a449b16c","Type":"ContainerStarted","Data":"9f3430e882439d4bdda191ea32e1fe261b64e09893ed79ab64701c14f8ddb9df"}
Jul 27 15:56:54.579780 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:54.579745    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx" event={"ID":"16ac6cba-0407-4c8e-8a06-fc76a449b16c","Type":"ContainerStarted","Data":"707885932c4aa8b0d279278c81e357005d4dd1800b5bc1c1f44367668eb23229"}
Jul 27 15:56:54.594658 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:56:54.594607    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgcx" podStartSLOduration=1.175978735 podStartE2EDuration="3.594589038s" totalImagesPullingTime="2.418610303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:56:54.59276849 +0000 UTC m=+517.273832921" watchObservedRunningTime="2026-07-27 15:56:54.594589038 +0000 UTC m=+517.275653469"
Jul 27 15:57:05.793583 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:05.793547    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"]
Jul 27 15:57:05.818609 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:05.818567    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"]
Jul 27 15:57:05.818774 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:05.818674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:05.820971 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:05.820951    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 27 15:57:05.821088 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:05.820951    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-krxhc\""
Jul 27 15:57:05.821529 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:05.821510    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 27 15:57:05.924287 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:05.924246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t52n\" (UniqueName: \"kubernetes.io/projected/833fa570-cf62-4f9a-afac-94d8cc467ed6-kube-api-access-5t52n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:05.924287 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:05.924286    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:05.924547 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:05.924390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:06.025241 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:06.025208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t52n\" (UniqueName: \"kubernetes.io/projected/833fa570-cf62-4f9a-afac-94d8cc467ed6-kube-api-access-5t52n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:06.025241 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:06.025245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:06.025413 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:06.025288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:06.025676 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:06.025656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:06.025719 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:06.025680    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:06.033592 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:06.033561    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t52n\" (UniqueName: \"kubernetes.io/projected/833fa570-cf62-4f9a-afac-94d8cc467ed6-kube-api-access-5t52n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:06.127333 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:06.127274    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:06.269026 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:06.268995    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"]
Jul 27 15:57:06.271467 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:57:06.271437    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833fa570_cf62_4f9a_afac_94d8cc467ed6.slice/crio-126bc04f416e74461ce23889ad01c952d3a175c4ed5a76d9f8422667f2ca208f WatchSource:0}: Error finding container 126bc04f416e74461ce23889ad01c952d3a175c4ed5a76d9f8422667f2ca208f: Status 404 returned error can't find the container with id 126bc04f416e74461ce23889ad01c952d3a175c4ed5a76d9f8422667f2ca208f
Jul 27 15:57:06.627247 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:06.627212    2579 generic.go:356] "Generic (PLEG): container finished" podID="833fa570-cf62-4f9a-afac-94d8cc467ed6" containerID="ef3b388cd5d46b86c5f0dcfd91bdfb24e0fb86e1c6a257887eaa18856d5e6e66" exitCode=0
Jul 27 15:57:06.627406 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:06.627251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn" event={"ID":"833fa570-cf62-4f9a-afac-94d8cc467ed6","Type":"ContainerDied","Data":"ef3b388cd5d46b86c5f0dcfd91bdfb24e0fb86e1c6a257887eaa18856d5e6e66"}
Jul 27 15:57:06.627406 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:06.627287    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn" event={"ID":"833fa570-cf62-4f9a-afac-94d8cc467ed6","Type":"ContainerStarted","Data":"126bc04f416e74461ce23889ad01c952d3a175c4ed5a76d9f8422667f2ca208f"}
Jul 27 15:57:07.632973 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:07.632884    2579 generic.go:356] "Generic (PLEG): container finished" podID="833fa570-cf62-4f9a-afac-94d8cc467ed6" containerID="b7e825537f12d1b20c15520445ccb63cd8ec4d128dd43626d1807cdd5f82f5f5" exitCode=0
Jul 27 15:57:07.632973 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:07.632964    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn" event={"ID":"833fa570-cf62-4f9a-afac-94d8cc467ed6","Type":"ContainerDied","Data":"b7e825537f12d1b20c15520445ccb63cd8ec4d128dd43626d1807cdd5f82f5f5"}
Jul 27 15:57:08.638641 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:08.638604    2579 generic.go:356] "Generic (PLEG): container finished" podID="833fa570-cf62-4f9a-afac-94d8cc467ed6" containerID="20210d29a41e9f6bb7b2a40b1009980b6badb4a7f72a2c37592abbc5e38edfd4" exitCode=0
Jul 27 15:57:08.639010 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:08.638666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn" event={"ID":"833fa570-cf62-4f9a-afac-94d8cc467ed6","Type":"ContainerDied","Data":"20210d29a41e9f6bb7b2a40b1009980b6badb4a7f72a2c37592abbc5e38edfd4"}
Jul 27 15:57:09.772155 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:09.772129    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:09.853790 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:09.853756    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t52n\" (UniqueName: \"kubernetes.io/projected/833fa570-cf62-4f9a-afac-94d8cc467ed6-kube-api-access-5t52n\") pod \"833fa570-cf62-4f9a-afac-94d8cc467ed6\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") "
Jul 27 15:57:09.853967 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:09.853801    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-bundle\") pod \"833fa570-cf62-4f9a-afac-94d8cc467ed6\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") "
Jul 27 15:57:09.853967 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:09.853859    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-util\") pod \"833fa570-cf62-4f9a-afac-94d8cc467ed6\" (UID: \"833fa570-cf62-4f9a-afac-94d8cc467ed6\") "
Jul 27 15:57:09.854761 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:09.854733    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-bundle" (OuterVolumeSpecName: "bundle") pod "833fa570-cf62-4f9a-afac-94d8cc467ed6" (UID: "833fa570-cf62-4f9a-afac-94d8cc467ed6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:57:09.855934 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:09.855911    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/833fa570-cf62-4f9a-afac-94d8cc467ed6-kube-api-access-5t52n" (OuterVolumeSpecName: "kube-api-access-5t52n") pod "833fa570-cf62-4f9a-afac-94d8cc467ed6" (UID: "833fa570-cf62-4f9a-afac-94d8cc467ed6"). InnerVolumeSpecName "kube-api-access-5t52n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:57:09.862360 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:09.862332    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-util" (OuterVolumeSpecName: "util") pod "833fa570-cf62-4f9a-afac-94d8cc467ed6" (UID: "833fa570-cf62-4f9a-afac-94d8cc467ed6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:57:09.954724 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:09.954694    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t52n\" (UniqueName: \"kubernetes.io/projected/833fa570-cf62-4f9a-afac-94d8cc467ed6-kube-api-access-5t52n\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:57:09.954724 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:09.954718    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:57:09.954724 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:09.954727    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/833fa570-cf62-4f9a-afac-94d8cc467ed6-util\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:57:10.648370 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:10.648338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn" event={"ID":"833fa570-cf62-4f9a-afac-94d8cc467ed6","Type":"ContainerDied","Data":"126bc04f416e74461ce23889ad01c952d3a175c4ed5a76d9f8422667f2ca208f"}
Jul 27 15:57:10.648546 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:10.648383    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="126bc04f416e74461ce23889ad01c952d3a175c4ed5a76d9f8422667f2ca208f"
Jul 27 15:57:10.648546 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:10.648392    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7bmsn"
Jul 27 15:57:18.722111 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.722077    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"]
Jul 27 15:57:18.722488 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.722306    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833fa570-cf62-4f9a-afac-94d8cc467ed6" containerName="pull"
Jul 27 15:57:18.722488 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.722318    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="833fa570-cf62-4f9a-afac-94d8cc467ed6" containerName="pull"
Jul 27 15:57:18.722488 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.722335    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833fa570-cf62-4f9a-afac-94d8cc467ed6" containerName="util"
Jul 27 15:57:18.722488 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.722341    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="833fa570-cf62-4f9a-afac-94d8cc467ed6" containerName="util"
Jul 27 15:57:18.722488 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.722348    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833fa570-cf62-4f9a-afac-94d8cc467ed6" containerName="extract"
Jul 27 15:57:18.722488 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.722354    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="833fa570-cf62-4f9a-afac-94d8cc467ed6" containerName="extract"
Jul 27 15:57:18.722488 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.722409    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="833fa570-cf62-4f9a-afac-94d8cc467ed6" containerName="extract"
Jul 27 15:57:18.727123 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.727104    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.729444 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.729419    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 15:57:18.729582 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.729446    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 15:57:18.729653 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.729597    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 15:57:18.729653 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.729645    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2p7wq\""
Jul 27 15:57:18.729765 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.729732    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 15:57:18.741611 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.741589    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"]
Jul 27 15:57:18.815456 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.815419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x4vm\" (UniqueName: \"kubernetes.io/projected/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-kube-api-access-5x4vm\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.815662 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.815464    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-manifests\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.815662 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.815485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-tmp\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.815662 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.815603    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.815662 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.815644    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.916542 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.916484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-tmp\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.916733 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.916552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.916733 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.916575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.916733 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.916611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x4vm\" (UniqueName: \"kubernetes.io/projected/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-kube-api-access-5x4vm\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.916733 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.916639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-manifests\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.916969 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.916951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-manifests\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.918833 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.918803    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-tmp\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.919034 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.919017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.919073 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.919026    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:18.925242 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:18.925218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x4vm\" (UniqueName: \"kubernetes.io/projected/a43f8fe7-87fe-4358-a2b3-1963f4f1348e-kube-api-access-5x4vm\") pod \"opendatahub-operator-controller-manager-7fc7975cbd-4lj7x\" (UID: \"a43f8fe7-87fe-4358-a2b3-1963f4f1348e\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:19.037373 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:19.037341    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:19.167838 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:19.167812    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"]
Jul 27 15:57:19.170209 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:57:19.170173    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda43f8fe7_87fe_4358_a2b3_1963f4f1348e.slice/crio-f0f4c47ea2d77f4c9880f7bd7c52823c4bd60e404c9b2281d9b8545b96d41eff WatchSource:0}: Error finding container f0f4c47ea2d77f4c9880f7bd7c52823c4bd60e404c9b2281d9b8545b96d41eff: Status 404 returned error can't find the container with id f0f4c47ea2d77f4c9880f7bd7c52823c4bd60e404c9b2281d9b8545b96d41eff
Jul 27 15:57:19.684009 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:19.683968    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x" event={"ID":"a43f8fe7-87fe-4358-a2b3-1963f4f1348e","Type":"ContainerStarted","Data":"f0f4c47ea2d77f4c9880f7bd7c52823c4bd60e404c9b2281d9b8545b96d41eff"}
Jul 27 15:57:23.704342 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:23.704308    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x" event={"ID":"a43f8fe7-87fe-4358-a2b3-1963f4f1348e","Type":"ContainerStarted","Data":"5d10f309a81d7171ab12ae27303295b2c31b4cec426fbf88c91ca605611f913e"}
Jul 27 15:57:24.710135 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:24.710096    2579 generic.go:356] "Generic (PLEG): container finished" podID="a43f8fe7-87fe-4358-a2b3-1963f4f1348e" containerID="5d10f309a81d7171ab12ae27303295b2c31b4cec426fbf88c91ca605611f913e" exitCode=0
Jul 27 15:57:24.710135 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:24.710144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x" event={"ID":"a43f8fe7-87fe-4358-a2b3-1963f4f1348e","Type":"ContainerDied","Data":"5d10f309a81d7171ab12ae27303295b2c31b4cec426fbf88c91ca605611f913e"}
Jul 27 15:57:25.715714 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:25.715619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x" event={"ID":"a43f8fe7-87fe-4358-a2b3-1963f4f1348e","Type":"ContainerStarted","Data":"0084ed2fac7e47a35c2543badb3aa290d81f9be683c68c64a0ac31e04abe0598"}
Jul 27 15:57:25.716136 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:25.715736    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:25.740051 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:25.740005    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x" podStartSLOduration=2.341776844 podStartE2EDuration="7.739989494s" totalImagesPullingTime="4.374288306s" totalInitContainerRuntime="1.023924344s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:25.738744758 +0000 UTC m=+548.419809210" watchObservedRunningTime="2026-07-27 15:57:25.739989494 +0000 UTC m=+548.421053923"
Jul 27 15:57:36.722099 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:36.722070    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fc7975cbd-4lj7x"
Jul 27 15:57:39.653719 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.653684    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lnv82"]
Jul 27 15:57:39.661674 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.661653    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lnv82"
Jul 27 15:57:39.664110 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.664089    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bfh4l\""
Jul 27 15:57:39.664226 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.664206    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 27 15:57:39.668972 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.668950    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lnv82"]
Jul 27 15:57:39.759445 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.759409    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bd2c52a-2595-43c2-b5f6-7c36c1c3446f-cert\") pod \"odh-model-controller-7998c67dc4-lnv82\" (UID: \"1bd2c52a-2595-43c2-b5f6-7c36c1c3446f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnv82"
Jul 27 15:57:39.759609 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.759483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bclrd\" (UniqueName: \"kubernetes.io/projected/1bd2c52a-2595-43c2-b5f6-7c36c1c3446f-kube-api-access-bclrd\") pod \"odh-model-controller-7998c67dc4-lnv82\" (UID: \"1bd2c52a-2595-43c2-b5f6-7c36c1c3446f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnv82"
Jul 27 15:57:39.859844 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.859812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bd2c52a-2595-43c2-b5f6-7c36c1c3446f-cert\") pod \"odh-model-controller-7998c67dc4-lnv82\" (UID: \"1bd2c52a-2595-43c2-b5f6-7c36c1c3446f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnv82"
Jul 27 15:57:39.860010 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.859854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bclrd\" (UniqueName: \"kubernetes.io/projected/1bd2c52a-2595-43c2-b5f6-7c36c1c3446f-kube-api-access-bclrd\") pod \"odh-model-controller-7998c67dc4-lnv82\" (UID: \"1bd2c52a-2595-43c2-b5f6-7c36c1c3446f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnv82"
Jul 27 15:57:39.862253 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.862233    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bd2c52a-2595-43c2-b5f6-7c36c1c3446f-cert\") pod \"odh-model-controller-7998c67dc4-lnv82\" (UID: \"1bd2c52a-2595-43c2-b5f6-7c36c1c3446f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnv82"
Jul 27 15:57:39.871414 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.871391    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bclrd\" (UniqueName: \"kubernetes.io/projected/1bd2c52a-2595-43c2-b5f6-7c36c1c3446f-kube-api-access-bclrd\") pod \"odh-model-controller-7998c67dc4-lnv82\" (UID: \"1bd2c52a-2595-43c2-b5f6-7c36c1c3446f\") " pod="opendatahub/odh-model-controller-7998c67dc4-lnv82"
Jul 27 15:57:39.972716 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:39.972622    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lnv82"
Jul 27 15:57:40.098022 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.097995    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lnv82"]
Jul 27 15:57:40.100387 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:57:40.100360    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd2c52a_2595_43c2_b5f6_7c36c1c3446f.slice/crio-30e89138a3de31395153ddf665bcf69b80a7ef6afe0218aeac5f24716cd8e63b WatchSource:0}: Error finding container 30e89138a3de31395153ddf665bcf69b80a7ef6afe0218aeac5f24716cd8e63b: Status 404 returned error can't find the container with id 30e89138a3de31395153ddf665bcf69b80a7ef6afe0218aeac5f24716cd8e63b
Jul 27 15:57:40.215058 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.215026    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8bfcd"]
Jul 27 15:57:40.219296 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.219277    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd"
Jul 27 15:57:40.221224 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.221204    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-9k78t\""
Jul 27 15:57:40.221313 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.221200    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 15:57:40.224331 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.224277    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8bfcd"]
Jul 27 15:57:40.262544 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.262490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5mbn\" (UniqueName: \"kubernetes.io/projected/a3671a02-bda6-4192-96f5-5ef9ea3fbeb4-kube-api-access-c5mbn\") pod \"model-serving-api-54d89bd5fc-8bfcd\" (UID: \"a3671a02-bda6-4192-96f5-5ef9ea3fbeb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd"
Jul 27 15:57:40.262664 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.262563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3671a02-bda6-4192-96f5-5ef9ea3fbeb4-tls-certs\") pod \"model-serving-api-54d89bd5fc-8bfcd\" (UID: \"a3671a02-bda6-4192-96f5-5ef9ea3fbeb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd"
Jul 27 15:57:40.363449 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.363419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3671a02-bda6-4192-96f5-5ef9ea3fbeb4-tls-certs\") pod \"model-serving-api-54d89bd5fc-8bfcd\" (UID: \"a3671a02-bda6-4192-96f5-5ef9ea3fbeb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd"
Jul 27 15:57:40.363617 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.363515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5mbn\" (UniqueName: \"kubernetes.io/projected/a3671a02-bda6-4192-96f5-5ef9ea3fbeb4-kube-api-access-c5mbn\") pod \"model-serving-api-54d89bd5fc-8bfcd\" (UID: \"a3671a02-bda6-4192-96f5-5ef9ea3fbeb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd"
Jul 27 15:57:40.363617 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:57:40.363577    2579 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 27 15:57:40.363712 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:57:40.363647    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3671a02-bda6-4192-96f5-5ef9ea3fbeb4-tls-certs podName:a3671a02-bda6-4192-96f5-5ef9ea3fbeb4 nodeName:}" failed. No retries permitted until 2026-07-27 15:57:40.863629503 +0000 UTC m=+563.544693912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a3671a02-bda6-4192-96f5-5ef9ea3fbeb4-tls-certs") pod "model-serving-api-54d89bd5fc-8bfcd" (UID: "a3671a02-bda6-4192-96f5-5ef9ea3fbeb4") : secret "model-serving-api-tls" not found
Jul 27 15:57:40.372838 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.372815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5mbn\" (UniqueName: \"kubernetes.io/projected/a3671a02-bda6-4192-96f5-5ef9ea3fbeb4-kube-api-access-c5mbn\") pod \"model-serving-api-54d89bd5fc-8bfcd\" (UID: \"a3671a02-bda6-4192-96f5-5ef9ea3fbeb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd"
Jul 27 15:57:40.775906 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.775875    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lnv82" event={"ID":"1bd2c52a-2595-43c2-b5f6-7c36c1c3446f","Type":"ContainerStarted","Data":"30e89138a3de31395153ddf665bcf69b80a7ef6afe0218aeac5f24716cd8e63b"}
Jul 27 15:57:40.868018 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.867984    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3671a02-bda6-4192-96f5-5ef9ea3fbeb4-tls-certs\") pod \"model-serving-api-54d89bd5fc-8bfcd\" (UID: \"a3671a02-bda6-4192-96f5-5ef9ea3fbeb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd"
Jul 27 15:57:40.870425 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:40.870403    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a3671a02-bda6-4192-96f5-5ef9ea3fbeb4-tls-certs\") pod \"model-serving-api-54d89bd5fc-8bfcd\" (UID: \"a3671a02-bda6-4192-96f5-5ef9ea3fbeb4\") " pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd"
Jul 27 15:57:41.132025 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:41.131948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd"
Jul 27 15:57:41.255323 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:41.255300    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8bfcd"]
Jul 27 15:57:41.257218 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:57:41.257192    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3671a02_bda6_4192_96f5_5ef9ea3fbeb4.slice/crio-16c58ddf08533a430f41453e5316065fbc2b0e95ef25b93766f24da1d088c5d5 WatchSource:0}: Error finding container 16c58ddf08533a430f41453e5316065fbc2b0e95ef25b93766f24da1d088c5d5: Status 404 returned error can't find the container with id 16c58ddf08533a430f41453e5316065fbc2b0e95ef25b93766f24da1d088c5d5
Jul 27 15:57:41.782799 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:41.782762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd" event={"ID":"a3671a02-bda6-4192-96f5-5ef9ea3fbeb4","Type":"ContainerStarted","Data":"16c58ddf08533a430f41453e5316065fbc2b0e95ef25b93766f24da1d088c5d5"}
Jul 27 15:57:43.800032 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:43.799990    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lnv82" event={"ID":"1bd2c52a-2595-43c2-b5f6-7c36c1c3446f","Type":"ContainerStarted","Data":"686c03eba0a5764002daa3f939e456133fe41e8ca20de431fe22070dddfa149f"}
Jul 27 15:57:43.800485 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:43.800136    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lnv82"
Jul 27 15:57:43.817945 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:43.817903    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lnv82" podStartSLOduration=1.325255278 podStartE2EDuration="4.817884914s" totalImagesPullingTime="3.492629636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:43.817694483 +0000 UTC m=+566.498758920" watchObservedRunningTime="2026-07-27 15:57:43.817884914 +0000 UTC m=+566.498949344"
Jul 27 15:57:45.002286 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.002257    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"]
Jul 27 15:57:45.006750 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.006729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"
Jul 27 15:57:45.009035 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.009004    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 27 15:57:45.009851 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.009695    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 15:57:45.009851 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.009698    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 15:57:45.009851 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.009721    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 27 15:57:45.009851 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.009765    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m2pn9\""
Jul 27 15:57:45.015758 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.015733    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"]
Jul 27 15:57:45.096705 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.096676    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62s88\" (UniqueName: \"kubernetes.io/projected/2d8badc6-554c-4e66-8908-8d1c446ef225-kube-api-access-62s88\") pod \"kube-auth-proxy-5f7696b457-r8smj\" (UID: \"2d8badc6-554c-4e66-8908-8d1c446ef225\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"
Jul 27 15:57:45.096863 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.096718    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d8badc6-554c-4e66-8908-8d1c446ef225-tmp\") pod \"kube-auth-proxy-5f7696b457-r8smj\" (UID: \"2d8badc6-554c-4e66-8908-8d1c446ef225\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"
Jul 27 15:57:45.096863 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.096757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d8badc6-554c-4e66-8908-8d1c446ef225-tls-certs\") pod \"kube-auth-proxy-5f7696b457-r8smj\" (UID: \"2d8badc6-554c-4e66-8908-8d1c446ef225\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"
Jul 27 15:57:45.197602 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.197569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d8badc6-554c-4e66-8908-8d1c446ef225-tls-certs\") pod \"kube-auth-proxy-5f7696b457-r8smj\" (UID: \"2d8badc6-554c-4e66-8908-8d1c446ef225\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"
Jul 27 15:57:45.197754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.197626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62s88\" (UniqueName: \"kubernetes.io/projected/2d8badc6-554c-4e66-8908-8d1c446ef225-kube-api-access-62s88\") pod \"kube-auth-proxy-5f7696b457-r8smj\" (UID: \"2d8badc6-554c-4e66-8908-8d1c446ef225\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"
Jul 27 15:57:45.197754 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.197667    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d8badc6-554c-4e66-8908-8d1c446ef225-tmp\") pod \"kube-auth-proxy-5f7696b457-r8smj\" (UID: \"2d8badc6-554c-4e66-8908-8d1c446ef225\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"
Jul 27 15:57:45.199802 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.199772    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d8badc6-554c-4e66-8908-8d1c446ef225-tmp\") pod \"kube-auth-proxy-5f7696b457-r8smj\" (UID: \"2d8badc6-554c-4e66-8908-8d1c446ef225\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"
Jul 27 15:57:45.200070 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.200047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d8badc6-554c-4e66-8908-8d1c446ef225-tls-certs\") pod \"kube-auth-proxy-5f7696b457-r8smj\" (UID: \"2d8badc6-554c-4e66-8908-8d1c446ef225\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"
Jul 27 15:57:45.207865 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.207834    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62s88\" (UniqueName: \"kubernetes.io/projected/2d8badc6-554c-4e66-8908-8d1c446ef225-kube-api-access-62s88\") pod \"kube-auth-proxy-5f7696b457-r8smj\" (UID: \"2d8badc6-554c-4e66-8908-8d1c446ef225\") " pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"
Jul 27 15:57:45.325450 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.325406    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"
Jul 27 15:57:45.458089 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.458059    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f7696b457-r8smj"]
Jul 27 15:57:45.461399 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:57:45.461374    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d8badc6_554c_4e66_8908_8d1c446ef225.slice/crio-a1cda84b3160aead472d68139b5441077da96def83ae1a6b0bda22680a4fc243 WatchSource:0}: Error finding container a1cda84b3160aead472d68139b5441077da96def83ae1a6b0bda22680a4fc243: Status 404 returned error can't find the container with id a1cda84b3160aead472d68139b5441077da96def83ae1a6b0bda22680a4fc243
Jul 27 15:57:45.809880 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.809843    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd" event={"ID":"a3671a02-bda6-4192-96f5-5ef9ea3fbeb4","Type":"ContainerStarted","Data":"c9db3defe067af41f6b5592d46e65e5bae40d85bce7c2d1ca1e8a653bd3e8e9c"}
Jul 27 15:57:45.810064 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.809958    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd"
Jul 27 15:57:45.811206 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.811179    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj" event={"ID":"2d8badc6-554c-4e66-8908-8d1c446ef225","Type":"ContainerStarted","Data":"a1cda84b3160aead472d68139b5441077da96def83ae1a6b0bda22680a4fc243"}
Jul 27 15:57:45.829960 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:45.829900    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd" podStartSLOduration=2.116741284 podStartE2EDuration="5.829882546s" totalImagesPullingTime="3.713141262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:45.828661792 +0000 UTC m=+568.509726246" watchObservedRunningTime="2026-07-27 15:57:45.829882546 +0000 UTC m=+568.510946977"
Jul 27 15:57:46.635151 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.635118    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"]
Jul 27 15:57:46.639282 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.639261    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.650422 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.650399    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 15:57:46.650422 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.650404    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 15:57:46.650590 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.650422    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 15:57:46.651238 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.651223    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 15:57:46.651506 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.651481    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sqbpf\""
Jul 27 15:57:46.673131 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.673108    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"]
Jul 27 15:57:46.708132 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.708105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.708258 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.708142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.708258 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.708169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45e993b7-d3b2-4a5a-92e3-d200962425ab-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.708258 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.708245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e993b7-d3b2-4a5a-92e3-d200962425ab-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.708372 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.708282    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.708372 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.708303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82jvt\" (UniqueName: \"kubernetes.io/projected/45e993b7-d3b2-4a5a-92e3-d200962425ab-kube-api-access-82jvt\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.708372 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.708327    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.809295 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.809265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.809468 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.809304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45e993b7-d3b2-4a5a-92e3-d200962425ab-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.809468 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.809335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e993b7-d3b2-4a5a-92e3-d200962425ab-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.809468 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.809442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.809658 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.809482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82jvt\" (UniqueName: \"kubernetes.io/projected/45e993b7-d3b2-4a5a-92e3-d200962425ab-kube-api-access-82jvt\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.809658 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.809546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.809658 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.809600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.810190 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.810163    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.811750 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.811720    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/45e993b7-d3b2-4a5a-92e3-d200962425ab-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.811859 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.811791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/45e993b7-d3b2-4a5a-92e3-d200962425ab-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.811920 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.811898    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.811977 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.811957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.841784 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.841754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45e993b7-d3b2-4a5a-92e3-d200962425ab-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.868208 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.868182    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82jvt\" (UniqueName: \"kubernetes.io/projected/45e993b7-d3b2-4a5a-92e3-d200962425ab-kube-api-access-82jvt\") pod \"istiod-openshift-gateway-5677ccb49b-8ssgg\" (UID: \"45e993b7-d3b2-4a5a-92e3-d200962425ab\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:46.948487 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:46.948413    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:47.081377 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:47.081339    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"]
Jul 27 15:57:47.084621 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:57:47.084583    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e993b7_d3b2_4a5a_92e3_d200962425ab.slice/crio-0b27d637bcba1ba0490bcda7d0a09080a1027ed3e0067eb29fa4977a5f731a54 WatchSource:0}: Error finding container 0b27d637bcba1ba0490bcda7d0a09080a1027ed3e0067eb29fa4977a5f731a54: Status 404 returned error can't find the container with id 0b27d637bcba1ba0490bcda7d0a09080a1027ed3e0067eb29fa4977a5f731a54
Jul 27 15:57:47.821761 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:47.821720    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg" event={"ID":"45e993b7-d3b2-4a5a-92e3-d200962425ab","Type":"ContainerStarted","Data":"0b27d637bcba1ba0490bcda7d0a09080a1027ed3e0067eb29fa4977a5f731a54"}
Jul 27 15:57:49.833609 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:49.833571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj" event={"ID":"2d8badc6-554c-4e66-8908-8d1c446ef225","Type":"ContainerStarted","Data":"51cd197f6da70c777876c693ca5c262383a3c69dab8514c79369c6bff85f8826"}
Jul 27 15:57:49.856742 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:49.856693    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f7696b457-r8smj" podStartSLOduration=2.448739089 podStartE2EDuration="5.856678602s" totalImagesPullingTime="3.407939513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:49.855642701 +0000 UTC m=+572.536707134" watchObservedRunningTime="2026-07-27 15:57:49.856678602 +0000 UTC m=+572.537743031"
Jul 27 15:57:50.439988 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.439955    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"]
Jul 27 15:57:50.448571 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.448548    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"
Jul 27 15:57:50.450678 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.450645    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 27 15:57:50.450821 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.450685    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wd6sh\""
Jul 27 15:57:50.455251 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.455191    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"]
Jul 27 15:57:50.543448 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.543412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf26w\" (UniqueName: \"kubernetes.io/projected/71495e28-54bb-4239-bd98-eb79f515dd5b-kube-api-access-gf26w\") pod \"kserve-controller-manager-d6f4b65b8-7z7tx\" (UID: \"71495e28-54bb-4239-bd98-eb79f515dd5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"
Jul 27 15:57:50.543645 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.543465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71495e28-54bb-4239-bd98-eb79f515dd5b-cert\") pod \"kserve-controller-manager-d6f4b65b8-7z7tx\" (UID: \"71495e28-54bb-4239-bd98-eb79f515dd5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"
Jul 27 15:57:50.641430 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.641386    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 15:57:50.641559 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.641459    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 15:57:50.644265 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.644240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf26w\" (UniqueName: \"kubernetes.io/projected/71495e28-54bb-4239-bd98-eb79f515dd5b-kube-api-access-gf26w\") pod \"kserve-controller-manager-d6f4b65b8-7z7tx\" (UID: \"71495e28-54bb-4239-bd98-eb79f515dd5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"
Jul 27 15:57:50.644355 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.644277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71495e28-54bb-4239-bd98-eb79f515dd5b-cert\") pod \"kserve-controller-manager-d6f4b65b8-7z7tx\" (UID: \"71495e28-54bb-4239-bd98-eb79f515dd5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"
Jul 27 15:57:50.646825 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.646803    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71495e28-54bb-4239-bd98-eb79f515dd5b-cert\") pod \"kserve-controller-manager-d6f4b65b8-7z7tx\" (UID: \"71495e28-54bb-4239-bd98-eb79f515dd5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"
Jul 27 15:57:50.662434 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.662406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf26w\" (UniqueName: \"kubernetes.io/projected/71495e28-54bb-4239-bd98-eb79f515dd5b-kube-api-access-gf26w\") pod \"kserve-controller-manager-d6f4b65b8-7z7tx\" (UID: \"71495e28-54bb-4239-bd98-eb79f515dd5b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"
Jul 27 15:57:50.762845 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.762807    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"
Jul 27 15:57:50.840625 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.840586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg" event={"ID":"45e993b7-d3b2-4a5a-92e3-d200962425ab","Type":"ContainerStarted","Data":"96764705fc624b68c7acce627011966ff91da2cbf1ca4d50cb15b5765e9da1e6"}
Jul 27 15:57:50.840965 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.840675    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:50.895319 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.895271    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg" podStartSLOduration=1.341323436 podStartE2EDuration="4.895253407s" totalImagesPullingTime="3.553929971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:50.865429843 +0000 UTC m=+573.546494273" watchObservedRunningTime="2026-07-27 15:57:50.895253407 +0000 UTC m=+573.576317859"
Jul 27 15:57:50.896036 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:50.896020    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"]
Jul 27 15:57:50.897998 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:57:50.897970    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71495e28_54bb_4239_bd98_eb79f515dd5b.slice/crio-6b0dfdf6eb26cb0fcf901e173cd1fd2acecddd6dce5b105888eee4834ce7f936 WatchSource:0}: Error finding container 6b0dfdf6eb26cb0fcf901e173cd1fd2acecddd6dce5b105888eee4834ce7f936: Status 404 returned error can't find the container with id 6b0dfdf6eb26cb0fcf901e173cd1fd2acecddd6dce5b105888eee4834ce7f936
Jul 27 15:57:51.845904 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:51.845866    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx" event={"ID":"71495e28-54bb-4239-bd98-eb79f515dd5b","Type":"ContainerStarted","Data":"6b0dfdf6eb26cb0fcf901e173cd1fd2acecddd6dce5b105888eee4834ce7f936"}
Jul 27 15:57:51.847891 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:51.847863    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-8ssgg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 15:57:51.848031 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:51.847922    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg" podUID="45e993b7-d3b2-4a5a-92e3-d200962425ab" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 15:57:53.163858 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.163826    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"]
Jul 27 15:57:53.168288 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.168250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.174992 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.174872    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hnsbp\""
Jul 27 15:57:53.185773 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.185730    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"]
Jul 27 15:57:53.266230 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.266198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.266418 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.266237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.266418 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.266286    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.266418 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.266363    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.266616 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.266420    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0453ab-cd93-4a12-845e-ebed7524993d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.266616 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.266478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.266616 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.266526    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.266616 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.266553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.266616 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.266571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdjz6\" (UniqueName: \"kubernetes.io/projected/6f0453ab-cd93-4a12-845e-ebed7524993d-kube-api-access-sdjz6\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.367157 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.367116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.367341 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.367173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.367415 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.367352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0453ab-cd93-4a12-845e-ebed7524993d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.367415 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.367387    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.367562 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.367534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.367620 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.367594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.367674 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.367625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdjz6\" (UniqueName: \"kubernetes.io/projected/6f0453ab-cd93-4a12-845e-ebed7524993d-kube-api-access-sdjz6\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.367674 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.367630    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.367764 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.367695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.367764 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.367733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.367764 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.367742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.368102 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.368075    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.368208 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.368168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.368534 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.368482    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f0453ab-cd93-4a12-845e-ebed7524993d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.370256 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.370235    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.370369 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.370352    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.379278 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.379240    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f0453ab-cd93-4a12-845e-ebed7524993d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.384875 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.384854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdjz6\" (UniqueName: \"kubernetes.io/projected/6f0453ab-cd93-4a12-845e-ebed7524993d-kube-api-access-sdjz6\") pod \"data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr\" (UID: \"6f0453ab-cd93-4a12-845e-ebed7524993d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.480432 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.480277    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:53.718950 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.718923    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"]
Jul 27 15:57:53.722110 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:57:53.722085    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0453ab_cd93_4a12_845e_ebed7524993d.slice/crio-59c19826ed2932b0320de5891da36d36103b15d3756bcc82ca0dad0ac88c01ff WatchSource:0}: Error finding container 59c19826ed2932b0320de5891da36d36103b15d3756bcc82ca0dad0ac88c01ff: Status 404 returned error can't find the container with id 59c19826ed2932b0320de5891da36d36103b15d3756bcc82ca0dad0ac88c01ff
Jul 27 15:57:53.857365 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.857319    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr" event={"ID":"6f0453ab-cd93-4a12-845e-ebed7524993d","Type":"ContainerStarted","Data":"59c19826ed2932b0320de5891da36d36103b15d3756bcc82ca0dad0ac88c01ff"}
Jul 27 15:57:53.858809 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.858777    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx" event={"ID":"71495e28-54bb-4239-bd98-eb79f515dd5b","Type":"ContainerStarted","Data":"6e05de84357c4cc0b59daf1404f2fd638ab426ac2034bb22d1ba61f09b5cac35"}
Jul 27 15:57:53.858941 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.858876    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"
Jul 27 15:57:53.903093 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:53.903031    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx" podStartSLOduration=1.173750107 podStartE2EDuration="3.903011544s" totalImagesPullingTime="2.729261437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:53.901153081 +0000 UTC m=+576.582217511" watchObservedRunningTime="2026-07-27 15:57:53.903011544 +0000 UTC m=+576.584075975"
Jul 27 15:57:54.806356 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:54.806327    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lnv82"
Jul 27 15:57:54.851627 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:54.851340    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-8ssgg"
Jul 27 15:57:56.820485 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:56.820459    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-8bfcd"
Jul 27 15:57:57.770876 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:57.770835    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 15:57:57.771021 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:57.770910    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 15:57:57.771021 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:57.770941    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 15:57:57.881469 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:57.881430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr" event={"ID":"6f0453ab-cd93-4a12-845e-ebed7524993d","Type":"ContainerStarted","Data":"ba02ba9087eb6688a0646aefaa7ab88aecaed1485805f609502f427fdd60ae02"}
Jul 27 15:57:57.902801 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:57.902748    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr" podStartSLOduration=0.856560854 podStartE2EDuration="4.902733493s" totalImagesPullingTime="4.046172639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:57:57.900727533 +0000 UTC m=+580.581791975" watchObservedRunningTime="2026-07-27 15:57:57.902733493 +0000 UTC m=+580.583797924"
Jul 27 15:57:58.481236 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:58.481201    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:58.485551 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:58.485528    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:58.885402 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:58.885370    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:57:58.886242 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:57:58.886222    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr"
Jul 27 15:58:24.869024 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:24.868985    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7z7tx"
Jul 27 15:58:56.078125 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.078091    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"]
Jul 27 15:58:56.081553 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.081537    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:58:56.084274 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.084254    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-r6t56\""
Jul 27 15:58:56.084677 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.084663    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 15:58:56.084733 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.084692    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 15:58:56.092181 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.092161    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"]
Jul 27 15:58:56.155271 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.155247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:58:56.155388 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.155308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpbct\" (UniqueName: \"kubernetes.io/projected/dd027e94-0738-4a30-a481-478dd0774e93-kube-api-access-jpbct\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:58:56.155388 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.155334    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:58:56.255877 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.255841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpbct\" (UniqueName: \"kubernetes.io/projected/dd027e94-0738-4a30-a481-478dd0774e93-kube-api-access-jpbct\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:58:56.255995 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.255886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:58:56.255995 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.255955    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:58:56.256277 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.256257    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:58:56.256342 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.256294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:58:56.265083 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.265056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpbct\" (UniqueName: \"kubernetes.io/projected/dd027e94-0738-4a30-a481-478dd0774e93-kube-api-access-jpbct\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:58:56.390338 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.390256    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:58:56.520917 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.520887    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"]
Jul 27 15:58:56.523080 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:58:56.523053    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd027e94_0738_4a30_a481_478dd0774e93.slice/crio-d791cd19d230fb889c0b9897a24c67416ba80e6f03590aed08a7d8057da34260 WatchSource:0}: Error finding container d791cd19d230fb889c0b9897a24c67416ba80e6f03590aed08a7d8057da34260: Status 404 returned error can't find the container with id d791cd19d230fb889c0b9897a24c67416ba80e6f03590aed08a7d8057da34260
Jul 27 15:58:56.670798 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.670738    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"]
Jul 27 15:58:56.673990 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.673974    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:58:56.682967 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.682946    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"]
Jul 27 15:58:56.759462 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.759434    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:58:56.759606 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.759467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrlkq\" (UniqueName: \"kubernetes.io/projected/e647bd06-92f3-4153-911e-0e0cb8d31a91-kube-api-access-jrlkq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:58:56.759606 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.759490    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:58:56.859969 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.859939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:58:56.860124 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.859976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrlkq\" (UniqueName: \"kubernetes.io/projected/e647bd06-92f3-4153-911e-0e0cb8d31a91-kube-api-access-jrlkq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:58:56.860124 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.859998    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:58:56.860361 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.860339    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:58:56.860415 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.860406    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:58:56.869282 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:56.869260    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrlkq\" (UniqueName: \"kubernetes.io/projected/e647bd06-92f3-4153-911e-0e0cb8d31a91-kube-api-access-jrlkq\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:58:57.008449 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.008394    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:58:57.068403 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.068372    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"]
Jul 27 15:58:57.072013 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.071991    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:58:57.079040 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.079005    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"]
Jul 27 15:58:57.134328 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.134297    2579 generic.go:356] "Generic (PLEG): container finished" podID="dd027e94-0738-4a30-a481-478dd0774e93" containerID="14116ce7ac52e21950f2b22de809339d8002f049c823c63228afe5abfa5b01f7" exitCode=0
Jul 27 15:58:57.134487 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.134336    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4" event={"ID":"dd027e94-0738-4a30-a481-478dd0774e93","Type":"ContainerDied","Data":"14116ce7ac52e21950f2b22de809339d8002f049c823c63228afe5abfa5b01f7"}
Jul 27 15:58:57.134487 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.134371    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4" event={"ID":"dd027e94-0738-4a30-a481-478dd0774e93","Type":"ContainerStarted","Data":"d791cd19d230fb889c0b9897a24c67416ba80e6f03590aed08a7d8057da34260"}
Jul 27 15:58:57.139273 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.139249    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"]
Jul 27 15:58:57.142209 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:58:57.142182    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode647bd06_92f3_4153_911e_0e0cb8d31a91.slice/crio-c60fe2e2557475bf6cadca22160117ee10194016ad0b055cc895fab44fd4e4e9 WatchSource:0}: Error finding container c60fe2e2557475bf6cadca22160117ee10194016ad0b055cc895fab44fd4e4e9: Status 404 returned error can't find the container with id c60fe2e2557475bf6cadca22160117ee10194016ad0b055cc895fab44fd4e4e9
Jul 27 15:58:57.163918 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.163898    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:58:57.164009 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.163930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:58:57.164009 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.163972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dsrs\" (UniqueName: \"kubernetes.io/projected/102a0a81-0316-43f0-b5b5-f02088f1ad4f-kube-api-access-4dsrs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:58:57.264538 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.264466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:58:57.264652 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.264551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dsrs\" (UniqueName: \"kubernetes.io/projected/102a0a81-0316-43f0-b5b5-f02088f1ad4f-kube-api-access-4dsrs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:58:57.264652 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.264638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:58:57.264866 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.264846    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:58:57.264964 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.264948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:58:57.274078 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.274055    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dsrs\" (UniqueName: \"kubernetes.io/projected/102a0a81-0316-43f0-b5b5-f02088f1ad4f-kube-api-access-4dsrs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:58:57.382040 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.382018    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:58:57.471848 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.471821    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"]
Jul 27 15:58:57.475486 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.475463    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:58:57.486755 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.486732    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"]
Jul 27 15:58:57.506811 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.506758    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"]
Jul 27 15:58:57.509201 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:58:57.509175    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102a0a81_0316_43f0_b5b5_f02088f1ad4f.slice/crio-f566b99f59a1343b0721a7ba0662e1d81e4b765b942da4b50816c9ba3194431f WatchSource:0}: Error finding container f566b99f59a1343b0721a7ba0662e1d81e4b765b942da4b50816c9ba3194431f: Status 404 returned error can't find the container with id f566b99f59a1343b0721a7ba0662e1d81e4b765b942da4b50816c9ba3194431f
Jul 27 15:58:57.566712 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.566688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:58:57.566826 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.566728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:58:57.566826 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.566754    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8wq8\" (UniqueName: \"kubernetes.io/projected/077de615-73a1-4d1f-be41-0d9f8f07e52d-kube-api-access-x8wq8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:58:57.668039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.668012    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:58:57.668148 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.668053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:58:57.668148 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.668080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8wq8\" (UniqueName: \"kubernetes.io/projected/077de615-73a1-4d1f-be41-0d9f8f07e52d-kube-api-access-x8wq8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:58:57.668374 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.668356    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:58:57.668413 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.668379    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:58:57.677365 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.677339    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8wq8\" (UniqueName: \"kubernetes.io/projected/077de615-73a1-4d1f-be41-0d9f8f07e52d-kube-api-access-x8wq8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:58:57.786706 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.786673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:58:57.968318 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:57.968298    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"]
Jul 27 15:58:57.969749 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:58:57.969725    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod077de615_73a1_4d1f_be41_0d9f8f07e52d.slice/crio-1dcad87bddfe83b25aef187bb39bfe182fbc198ece03ed7b1a69c954368e9a00 WatchSource:0}: Error finding container 1dcad87bddfe83b25aef187bb39bfe182fbc198ece03ed7b1a69c954368e9a00: Status 404 returned error can't find the container with id 1dcad87bddfe83b25aef187bb39bfe182fbc198ece03ed7b1a69c954368e9a00
Jul 27 15:58:58.140805 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.140772    2579 generic.go:356] "Generic (PLEG): container finished" podID="077de615-73a1-4d1f-be41-0d9f8f07e52d" containerID="1915f8a27e8664904983b9b6ec0588a11e5a3dd2b740a1f18db2f9ebe42da43c" exitCode=0
Jul 27 15:58:58.141195 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.140861    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm" event={"ID":"077de615-73a1-4d1f-be41-0d9f8f07e52d","Type":"ContainerDied","Data":"1915f8a27e8664904983b9b6ec0588a11e5a3dd2b740a1f18db2f9ebe42da43c"}
Jul 27 15:58:58.141195 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.140909    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm" event={"ID":"077de615-73a1-4d1f-be41-0d9f8f07e52d","Type":"ContainerStarted","Data":"1dcad87bddfe83b25aef187bb39bfe182fbc198ece03ed7b1a69c954368e9a00"}
Jul 27 15:58:58.142365 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.142341    2579 generic.go:356] "Generic (PLEG): container finished" podID="102a0a81-0316-43f0-b5b5-f02088f1ad4f" containerID="b2c24917ced0a4e581ec9050fcae07e9cce01028c4b542b5a9cb2c1e7f93f9bc" exitCode=0
Jul 27 15:58:58.142514 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.142415    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n" event={"ID":"102a0a81-0316-43f0-b5b5-f02088f1ad4f","Type":"ContainerDied","Data":"b2c24917ced0a4e581ec9050fcae07e9cce01028c4b542b5a9cb2c1e7f93f9bc"}
Jul 27 15:58:58.142514 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.142454    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n" event={"ID":"102a0a81-0316-43f0-b5b5-f02088f1ad4f","Type":"ContainerStarted","Data":"f566b99f59a1343b0721a7ba0662e1d81e4b765b942da4b50816c9ba3194431f"}
Jul 27 15:58:58.143898 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.143875    2579 generic.go:356] "Generic (PLEG): container finished" podID="e647bd06-92f3-4153-911e-0e0cb8d31a91" containerID="3991d8085a10d583dd5e95b6bc1f14cd3e4b786d38e20cac9db15c0f55974872" exitCode=0
Jul 27 15:58:58.144001 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.143960    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw" event={"ID":"e647bd06-92f3-4153-911e-0e0cb8d31a91","Type":"ContainerDied","Data":"3991d8085a10d583dd5e95b6bc1f14cd3e4b786d38e20cac9db15c0f55974872"}
Jul 27 15:58:58.144060 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.144027    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw" event={"ID":"e647bd06-92f3-4153-911e-0e0cb8d31a91","Type":"ContainerStarted","Data":"c60fe2e2557475bf6cadca22160117ee10194016ad0b055cc895fab44fd4e4e9"}
Jul 27 15:58:58.145866 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.145846    2579 generic.go:356] "Generic (PLEG): container finished" podID="dd027e94-0738-4a30-a481-478dd0774e93" containerID="69198fe5ac7c2226d5bfef47b2e675e65454e7ce79c3858827e9796e7b07c257" exitCode=0
Jul 27 15:58:58.145951 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.145901    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4" event={"ID":"dd027e94-0738-4a30-a481-478dd0774e93","Type":"ContainerDied","Data":"69198fe5ac7c2226d5bfef47b2e675e65454e7ce79c3858827e9796e7b07c257"}
Jul 27 15:58:58.509038 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.508979    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ddc4c856f-2f9zg"]
Jul 27 15:58:58.512039 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.512022    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.524198 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.524173    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddc4c856f-2f9zg"]
Jul 27 15:58:58.574748 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.574721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f566621d-c040-4b88-9844-e89f311f2b55-console-serving-cert\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.574864 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.574753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-service-ca\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.574864 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.574782    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-console-config\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.574864 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.574846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f566621d-c040-4b88-9844-e89f311f2b55-console-oauth-config\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.574964 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.574870    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-oauth-serving-cert\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.574964 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.574911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-trusted-ca-bundle\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.574964 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.574935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9twk\" (UniqueName: \"kubernetes.io/projected/f566621d-c040-4b88-9844-e89f311f2b55-kube-api-access-w9twk\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.675788 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.675725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f566621d-c040-4b88-9844-e89f311f2b55-console-serving-cert\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.675788 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.675760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-service-ca\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.675788 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.675786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-console-config\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.676000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.675807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f566621d-c040-4b88-9844-e89f311f2b55-console-oauth-config\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.676000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.675823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-oauth-serving-cert\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.676000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.675868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-trusted-ca-bundle\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.676000 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.675900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9twk\" (UniqueName: \"kubernetes.io/projected/f566621d-c040-4b88-9844-e89f311f2b55-kube-api-access-w9twk\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.676593 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.676559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-service-ca\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.676707 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.676559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-oauth-serving-cert\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.676810 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.676785    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-console-config\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.676899 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.676879    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f566621d-c040-4b88-9844-e89f311f2b55-trusted-ca-bundle\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.678021 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.677996    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f566621d-c040-4b88-9844-e89f311f2b55-console-serving-cert\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.678289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.678266    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f566621d-c040-4b88-9844-e89f311f2b55-console-oauth-config\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.684541 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.684524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9twk\" (UniqueName: \"kubernetes.io/projected/f566621d-c040-4b88-9844-e89f311f2b55-kube-api-access-w9twk\") pod \"console-7ddc4c856f-2f9zg\" (UID: \"f566621d-c040-4b88-9844-e89f311f2b55\") " pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.821432 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.821399    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:58:58.954850 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:58.954822    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddc4c856f-2f9zg"]
Jul 27 15:58:58.955948 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:58:58.955919    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf566621d_c040_4b88_9844_e89f311f2b55.slice/crio-bafdc6c7de5b51a3dd79567f04d071d122936ed900e963ae000de588b7932017 WatchSource:0}: Error finding container bafdc6c7de5b51a3dd79567f04d071d122936ed900e963ae000de588b7932017: Status 404 returned error can't find the container with id bafdc6c7de5b51a3dd79567f04d071d122936ed900e963ae000de588b7932017
Jul 27 15:58:59.151838 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:59.151806    2579 generic.go:356] "Generic (PLEG): container finished" podID="102a0a81-0316-43f0-b5b5-f02088f1ad4f" containerID="672db5d0ebaaf74674ec7a2afc26d8194324522b8f467f851cd4e11c8b721ba6" exitCode=0
Jul 27 15:58:59.152260 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:59.151901    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n" event={"ID":"102a0a81-0316-43f0-b5b5-f02088f1ad4f","Type":"ContainerDied","Data":"672db5d0ebaaf74674ec7a2afc26d8194324522b8f467f851cd4e11c8b721ba6"}
Jul 27 15:58:59.154054 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:59.154029    2579 generic.go:356] "Generic (PLEG): container finished" podID="dd027e94-0738-4a30-a481-478dd0774e93" containerID="e13fb965f002d43f78a69b8c0025decf8c3ef22e25908516135dfbf4d4955e7b" exitCode=0
Jul 27 15:58:59.154152 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:59.154108    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4" event={"ID":"dd027e94-0738-4a30-a481-478dd0774e93","Type":"ContainerDied","Data":"e13fb965f002d43f78a69b8c0025decf8c3ef22e25908516135dfbf4d4955e7b"}
Jul 27 15:58:59.155491 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:59.155472    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddc4c856f-2f9zg" event={"ID":"f566621d-c040-4b88-9844-e89f311f2b55","Type":"ContainerStarted","Data":"8cd24ebecb12c8e53c00786db279afd7e6427037252215516f11fffe31f5888f"}
Jul 27 15:58:59.155595 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:59.155523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddc4c856f-2f9zg" event={"ID":"f566621d-c040-4b88-9844-e89f311f2b55","Type":"ContainerStarted","Data":"bafdc6c7de5b51a3dd79567f04d071d122936ed900e963ae000de588b7932017"}
Jul 27 15:58:59.203801 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:58:59.203760    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ddc4c856f-2f9zg" podStartSLOduration=1.203746368 podStartE2EDuration="1.203746368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:58:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:58:59.202706328 +0000 UTC m=+641.883770758" watchObservedRunningTime="2026-07-27 15:58:59.203746368 +0000 UTC m=+641.884810791"
Jul 27 15:59:00.162368 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.162336    2579 generic.go:356] "Generic (PLEG): container finished" podID="077de615-73a1-4d1f-be41-0d9f8f07e52d" containerID="a3a0d9e13f42d9dde33b9b8fd39bbf8b3a6a48f6830a19d998f05bbcb07c9655" exitCode=0
Jul 27 15:59:00.162826 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.162418    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm" event={"ID":"077de615-73a1-4d1f-be41-0d9f8f07e52d","Type":"ContainerDied","Data":"a3a0d9e13f42d9dde33b9b8fd39bbf8b3a6a48f6830a19d998f05bbcb07c9655"}
Jul 27 15:59:00.164598 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.164574    2579 generic.go:356] "Generic (PLEG): container finished" podID="102a0a81-0316-43f0-b5b5-f02088f1ad4f" containerID="6c0c5848803534c2dff2d58ce9dc17def3f420e4fc1273e836aab31c8a7b4a47" exitCode=0
Jul 27 15:59:00.164753 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.164663    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n" event={"ID":"102a0a81-0316-43f0-b5b5-f02088f1ad4f","Type":"ContainerDied","Data":"6c0c5848803534c2dff2d58ce9dc17def3f420e4fc1273e836aab31c8a7b4a47"}
Jul 27 15:59:00.166361 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.166338    2579 generic.go:356] "Generic (PLEG): container finished" podID="e647bd06-92f3-4153-911e-0e0cb8d31a91" containerID="61ada549ae49681df741f871524238e0e1cf700803d977e4e9218462091e04a3" exitCode=0
Jul 27 15:59:00.166456 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.166374    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw" event={"ID":"e647bd06-92f3-4153-911e-0e0cb8d31a91","Type":"ContainerDied","Data":"61ada549ae49681df741f871524238e0e1cf700803d977e4e9218462091e04a3"}
Jul 27 15:59:00.296755 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.296732    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:59:00.390395 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.390368    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpbct\" (UniqueName: \"kubernetes.io/projected/dd027e94-0738-4a30-a481-478dd0774e93-kube-api-access-jpbct\") pod \"dd027e94-0738-4a30-a481-478dd0774e93\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") "
Jul 27 15:59:00.390736 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.390412    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-util\") pod \"dd027e94-0738-4a30-a481-478dd0774e93\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") "
Jul 27 15:59:00.390736 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.390522    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-bundle\") pod \"dd027e94-0738-4a30-a481-478dd0774e93\" (UID: \"dd027e94-0738-4a30-a481-478dd0774e93\") "
Jul 27 15:59:00.391127 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.391093    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-bundle" (OuterVolumeSpecName: "bundle") pod "dd027e94-0738-4a30-a481-478dd0774e93" (UID: "dd027e94-0738-4a30-a481-478dd0774e93"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:00.392482 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.392456    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd027e94-0738-4a30-a481-478dd0774e93-kube-api-access-jpbct" (OuterVolumeSpecName: "kube-api-access-jpbct") pod "dd027e94-0738-4a30-a481-478dd0774e93" (UID: "dd027e94-0738-4a30-a481-478dd0774e93"). InnerVolumeSpecName "kube-api-access-jpbct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:59:00.395878 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.395860    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-util" (OuterVolumeSpecName: "util") pod "dd027e94-0738-4a30-a481-478dd0774e93" (UID: "dd027e94-0738-4a30-a481-478dd0774e93"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:00.492007 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.491952    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpbct\" (UniqueName: \"kubernetes.io/projected/dd027e94-0738-4a30-a481-478dd0774e93-kube-api-access-jpbct\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:00.492007 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.491975    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-util\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:00.492007 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:00.491985    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd027e94-0738-4a30-a481-478dd0774e93-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:01.179220 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.179179    2579 generic.go:356] "Generic (PLEG): container finished" podID="077de615-73a1-4d1f-be41-0d9f8f07e52d" containerID="43897b3dee00c92c4ed4fe5cb50e34568d83d3b621de890420cadb547edefd2f" exitCode=0
Jul 27 15:59:01.179655 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.179227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm" event={"ID":"077de615-73a1-4d1f-be41-0d9f8f07e52d","Type":"ContainerDied","Data":"43897b3dee00c92c4ed4fe5cb50e34568d83d3b621de890420cadb547edefd2f"}
Jul 27 15:59:01.181340 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.181312    2579 generic.go:356] "Generic (PLEG): container finished" podID="e647bd06-92f3-4153-911e-0e0cb8d31a91" containerID="c05883b1209cc5810ab5611062db5651fa50a996ab338529934af7b9eb927b02" exitCode=0
Jul 27 15:59:01.181436 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.181337    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw" event={"ID":"e647bd06-92f3-4153-911e-0e0cb8d31a91","Type":"ContainerDied","Data":"c05883b1209cc5810ab5611062db5651fa50a996ab338529934af7b9eb927b02"}
Jul 27 15:59:01.183168 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.183149    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4" event={"ID":"dd027e94-0738-4a30-a481-478dd0774e93","Type":"ContainerDied","Data":"d791cd19d230fb889c0b9897a24c67416ba80e6f03590aed08a7d8057da34260"}
Jul 27 15:59:01.183168 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.183162    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4"
Jul 27 15:59:01.183304 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.183182    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d791cd19d230fb889c0b9897a24c67416ba80e6f03590aed08a7d8057da34260"
Jul 27 15:59:01.307280 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.307258    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:59:01.399151 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.399123    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dsrs\" (UniqueName: \"kubernetes.io/projected/102a0a81-0316-43f0-b5b5-f02088f1ad4f-kube-api-access-4dsrs\") pod \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") "
Jul 27 15:59:01.399268 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.399211    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-util\") pod \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") "
Jul 27 15:59:01.399268 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.399233    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-bundle\") pod \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\" (UID: \"102a0a81-0316-43f0-b5b5-f02088f1ad4f\") "
Jul 27 15:59:01.399696 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.399676    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-bundle" (OuterVolumeSpecName: "bundle") pod "102a0a81-0316-43f0-b5b5-f02088f1ad4f" (UID: "102a0a81-0316-43f0-b5b5-f02088f1ad4f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:01.401214 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.401190    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/102a0a81-0316-43f0-b5b5-f02088f1ad4f-kube-api-access-4dsrs" (OuterVolumeSpecName: "kube-api-access-4dsrs") pod "102a0a81-0316-43f0-b5b5-f02088f1ad4f" (UID: "102a0a81-0316-43f0-b5b5-f02088f1ad4f"). InnerVolumeSpecName "kube-api-access-4dsrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:59:01.404313 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.404295    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-util" (OuterVolumeSpecName: "util") pod "102a0a81-0316-43f0-b5b5-f02088f1ad4f" (UID: "102a0a81-0316-43f0-b5b5-f02088f1ad4f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:01.500146 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.500096    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dsrs\" (UniqueName: \"kubernetes.io/projected/102a0a81-0316-43f0-b5b5-f02088f1ad4f-kube-api-access-4dsrs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:01.500146 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.500116    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-util\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:01.500146 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:01.500125    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/102a0a81-0316-43f0-b5b5-f02088f1ad4f-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:02.189302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.189226    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n"
Jul 27 15:59:02.189302 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.189257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n" event={"ID":"102a0a81-0316-43f0-b5b5-f02088f1ad4f","Type":"ContainerDied","Data":"f566b99f59a1343b0721a7ba0662e1d81e4b765b942da4b50816c9ba3194431f"}
Jul 27 15:59:02.189715 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.189308    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f566b99f59a1343b0721a7ba0662e1d81e4b765b942da4b50816c9ba3194431f"
Jul 27 15:59:02.316876 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.316851    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:59:02.345374 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.345348    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:59:02.407020 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.406990    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-bundle\") pod \"e647bd06-92f3-4153-911e-0e0cb8d31a91\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") "
Jul 27 15:59:02.407020 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.407022    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-bundle\") pod \"077de615-73a1-4d1f-be41-0d9f8f07e52d\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") "
Jul 27 15:59:02.407240 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.407067    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-util\") pod \"077de615-73a1-4d1f-be41-0d9f8f07e52d\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") "
Jul 27 15:59:02.407240 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.407092    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-util\") pod \"e647bd06-92f3-4153-911e-0e0cb8d31a91\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") "
Jul 27 15:59:02.407240 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.407133    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8wq8\" (UniqueName: \"kubernetes.io/projected/077de615-73a1-4d1f-be41-0d9f8f07e52d-kube-api-access-x8wq8\") pod \"077de615-73a1-4d1f-be41-0d9f8f07e52d\" (UID: \"077de615-73a1-4d1f-be41-0d9f8f07e52d\") "
Jul 27 15:59:02.407240 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.407172    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrlkq\" (UniqueName: \"kubernetes.io/projected/e647bd06-92f3-4153-911e-0e0cb8d31a91-kube-api-access-jrlkq\") pod \"e647bd06-92f3-4153-911e-0e0cb8d31a91\" (UID: \"e647bd06-92f3-4153-911e-0e0cb8d31a91\") "
Jul 27 15:59:02.407651 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.407621    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-bundle" (OuterVolumeSpecName: "bundle") pod "e647bd06-92f3-4153-911e-0e0cb8d31a91" (UID: "e647bd06-92f3-4153-911e-0e0cb8d31a91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:02.407808 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.407782    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-bundle" (OuterVolumeSpecName: "bundle") pod "077de615-73a1-4d1f-be41-0d9f8f07e52d" (UID: "077de615-73a1-4d1f-be41-0d9f8f07e52d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:02.409311 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.409288    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e647bd06-92f3-4153-911e-0e0cb8d31a91-kube-api-access-jrlkq" (OuterVolumeSpecName: "kube-api-access-jrlkq") pod "e647bd06-92f3-4153-911e-0e0cb8d31a91" (UID: "e647bd06-92f3-4153-911e-0e0cb8d31a91"). InnerVolumeSpecName "kube-api-access-jrlkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:59:02.409434 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.409320    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/077de615-73a1-4d1f-be41-0d9f8f07e52d-kube-api-access-x8wq8" (OuterVolumeSpecName: "kube-api-access-x8wq8") pod "077de615-73a1-4d1f-be41-0d9f8f07e52d" (UID: "077de615-73a1-4d1f-be41-0d9f8f07e52d"). InnerVolumeSpecName "kube-api-access-x8wq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:59:02.412900 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.412867    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-util" (OuterVolumeSpecName: "util") pod "077de615-73a1-4d1f-be41-0d9f8f07e52d" (UID: "077de615-73a1-4d1f-be41-0d9f8f07e52d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:02.414912 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.414889    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-util" (OuterVolumeSpecName: "util") pod "e647bd06-92f3-4153-911e-0e0cb8d31a91" (UID: "e647bd06-92f3-4153-911e-0e0cb8d31a91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 15:59:02.507972 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.507905    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8wq8\" (UniqueName: \"kubernetes.io/projected/077de615-73a1-4d1f-be41-0d9f8f07e52d-kube-api-access-x8wq8\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:02.507972 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.507929    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrlkq\" (UniqueName: \"kubernetes.io/projected/e647bd06-92f3-4153-911e-0e0cb8d31a91-kube-api-access-jrlkq\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:02.507972 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.507938    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:02.507972 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.507946    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:02.507972 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.507953    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/077de615-73a1-4d1f-be41-0d9f8f07e52d-util\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:02.507972 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:02.507960    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e647bd06-92f3-4153-911e-0e0cb8d31a91-util\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:03.195365 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:03.195330    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm"
Jul 27 15:59:03.195365 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:03.195352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm" event={"ID":"077de615-73a1-4d1f-be41-0d9f8f07e52d","Type":"ContainerDied","Data":"1dcad87bddfe83b25aef187bb39bfe182fbc198ece03ed7b1a69c954368e9a00"}
Jul 27 15:59:03.195889 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:03.195405    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1dcad87bddfe83b25aef187bb39bfe182fbc198ece03ed7b1a69c954368e9a00"
Jul 27 15:59:03.197244 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:03.197230    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw"
Jul 27 15:59:03.197347 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:03.197246    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw" event={"ID":"e647bd06-92f3-4153-911e-0e0cb8d31a91","Type":"ContainerDied","Data":"c60fe2e2557475bf6cadca22160117ee10194016ad0b055cc895fab44fd4e4e9"}
Jul 27 15:59:03.197347 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:03.197281    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c60fe2e2557475bf6cadca22160117ee10194016ad0b055cc895fab44fd4e4e9"
Jul 27 15:59:08.821909 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:08.821874    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:59:08.822268 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:08.821940    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:59:08.826151 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:08.826126    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:59:09.231610 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:09.231534    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ddc4c856f-2f9zg"
Jul 27 15:59:09.287722 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:09.287691    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c97b659dd-fgxmf"]
Jul 27 15:59:15.907708 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.907666    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8"]
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.907951    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd027e94-0738-4a30-a481-478dd0774e93" containerName="pull"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.907962    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd027e94-0738-4a30-a481-478dd0774e93" containerName="pull"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.907969    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e647bd06-92f3-4153-911e-0e0cb8d31a91" containerName="pull"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.907975    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e647bd06-92f3-4153-911e-0e0cb8d31a91" containerName="pull"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.907983    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e647bd06-92f3-4153-911e-0e0cb8d31a91" containerName="util"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.907988    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e647bd06-92f3-4153-911e-0e0cb8d31a91" containerName="util"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.907995    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd027e94-0738-4a30-a481-478dd0774e93" containerName="extract"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908000    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd027e94-0738-4a30-a481-478dd0774e93" containerName="extract"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908007    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102a0a81-0316-43f0-b5b5-f02088f1ad4f" containerName="pull"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908012    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="102a0a81-0316-43f0-b5b5-f02088f1ad4f" containerName="pull"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908022    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077de615-73a1-4d1f-be41-0d9f8f07e52d" containerName="pull"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908027    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="077de615-73a1-4d1f-be41-0d9f8f07e52d" containerName="pull"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908035    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e647bd06-92f3-4153-911e-0e0cb8d31a91" containerName="extract"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908040    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e647bd06-92f3-4153-911e-0e0cb8d31a91" containerName="extract"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908046    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd027e94-0738-4a30-a481-478dd0774e93" containerName="util"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908050    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd027e94-0738-4a30-a481-478dd0774e93" containerName="util"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908056    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077de615-73a1-4d1f-be41-0d9f8f07e52d" containerName="util"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908061    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="077de615-73a1-4d1f-be41-0d9f8f07e52d" containerName="util"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908067    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102a0a81-0316-43f0-b5b5-f02088f1ad4f" containerName="extract"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908071    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="102a0a81-0316-43f0-b5b5-f02088f1ad4f" containerName="extract"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908076    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102a0a81-0316-43f0-b5b5-f02088f1ad4f" containerName="util"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908082    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="102a0a81-0316-43f0-b5b5-f02088f1ad4f" containerName="util"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908089    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077de615-73a1-4d1f-be41-0d9f8f07e52d" containerName="extract"
Jul 27 15:59:15.908092 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908094    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="077de615-73a1-4d1f-be41-0d9f8f07e52d" containerName="extract"
Jul 27 15:59:15.908752 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908144    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="077de615-73a1-4d1f-be41-0d9f8f07e52d" containerName="extract"
Jul 27 15:59:15.908752 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908152    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd027e94-0738-4a30-a481-478dd0774e93" containerName="extract"
Jul 27 15:59:15.908752 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908157    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e647bd06-92f3-4153-911e-0e0cb8d31a91" containerName="extract"
Jul 27 15:59:15.908752 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.908164    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="102a0a81-0316-43f0-b5b5-f02088f1ad4f" containerName="extract"
Jul 27 15:59:15.911043 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.911027    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8"
Jul 27 15:59:15.918024 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.917986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-5bp5k\""
Jul 27 15:59:15.918805 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.918789    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 15:59:15.918872 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.918827    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 15:59:15.918907 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.918790    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 27 15:59:15.929649 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:15.929630    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8"]
Jul 27 15:59:16.009685 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:16.009638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjnlv\" (UniqueName: \"kubernetes.io/projected/7f9ef2c1-2fc2-472c-b49c-99606c2b8da6-kube-api-access-zjnlv\") pod \"dns-operator-controller-manager-864dd78c4c-9mlp8\" (UID: \"7f9ef2c1-2fc2-472c-b49c-99606c2b8da6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8"
Jul 27 15:59:16.110544 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:16.110484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjnlv\" (UniqueName: \"kubernetes.io/projected/7f9ef2c1-2fc2-472c-b49c-99606c2b8da6-kube-api-access-zjnlv\") pod \"dns-operator-controller-manager-864dd78c4c-9mlp8\" (UID: \"7f9ef2c1-2fc2-472c-b49c-99606c2b8da6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8"
Jul 27 15:59:16.120363 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:16.120330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjnlv\" (UniqueName: \"kubernetes.io/projected/7f9ef2c1-2fc2-472c-b49c-99606c2b8da6-kube-api-access-zjnlv\") pod \"dns-operator-controller-manager-864dd78c4c-9mlp8\" (UID: \"7f9ef2c1-2fc2-472c-b49c-99606c2b8da6\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8"
Jul 27 15:59:16.220996 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:16.220908    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8"
Jul 27 15:59:16.364161 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:16.364130    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8"]
Jul 27 15:59:16.364691 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:59:16.364669    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9ef2c1_2fc2_472c_b49c_99606c2b8da6.slice/crio-ba47fde990acfd5f84770dea27388c11c5caceced8b6d902e1025e0ef84aab60 WatchSource:0}: Error finding container ba47fde990acfd5f84770dea27388c11c5caceced8b6d902e1025e0ef84aab60: Status 404 returned error can't find the container with id ba47fde990acfd5f84770dea27388c11c5caceced8b6d902e1025e0ef84aab60
Jul 27 15:59:17.268009 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:17.267971    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8" event={"ID":"7f9ef2c1-2fc2-472c-b49c-99606c2b8da6","Type":"ContainerStarted","Data":"ba47fde990acfd5f84770dea27388c11c5caceced8b6d902e1025e0ef84aab60"}
Jul 27 15:59:18.596382 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:18.596359    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 27 15:59:18.774929 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:18.774896    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"]
Jul 27 15:59:18.778226 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:18.778206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"
Jul 27 15:59:18.781355 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:18.781336    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-m4h62\""
Jul 27 15:59:18.805350 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:18.805325    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"]
Jul 27 15:59:18.833602 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:18.833569    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr2fv\" (UniqueName: \"kubernetes.io/projected/87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0-kube-api-access-tr2fv\") pod \"limitador-operator-controller-manager-859d7b78bd-dpg2m\" (UID: \"87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"
Jul 27 15:59:18.934293 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:18.934208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr2fv\" (UniqueName: \"kubernetes.io/projected/87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0-kube-api-access-tr2fv\") pod \"limitador-operator-controller-manager-859d7b78bd-dpg2m\" (UID: \"87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"
Jul 27 15:59:18.954973 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:18.954938    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr2fv\" (UniqueName: \"kubernetes.io/projected/87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0-kube-api-access-tr2fv\") pod \"limitador-operator-controller-manager-859d7b78bd-dpg2m\" (UID: \"87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"
Jul 27 15:59:19.087982 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:19.087948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"
Jul 27 15:59:19.226362 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:19.226338    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"]
Jul 27 15:59:19.228240 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:59:19.228207    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ac4027_e5e8_4f47_9c2a_98d6be2a7fe0.slice/crio-593466bf253f06b3cf25fa81a3eb03135e2f41deb055c93578a657050504efb6 WatchSource:0}: Error finding container 593466bf253f06b3cf25fa81a3eb03135e2f41deb055c93578a657050504efb6: Status 404 returned error can't find the container with id 593466bf253f06b3cf25fa81a3eb03135e2f41deb055c93578a657050504efb6
Jul 27 15:59:19.280381 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:19.280350    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8" event={"ID":"7f9ef2c1-2fc2-472c-b49c-99606c2b8da6","Type":"ContainerStarted","Data":"488df67c95fd60180b90943fc8194fc10a1a18a3e64f3b9563a6d9a19d729182"}
Jul 27 15:59:19.280557 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:19.280420    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8"
Jul 27 15:59:19.281678 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:19.281658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m" event={"ID":"87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0","Type":"ContainerStarted","Data":"593466bf253f06b3cf25fa81a3eb03135e2f41deb055c93578a657050504efb6"}
Jul 27 15:59:19.302085 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:19.302043    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8" podStartSLOduration=2.074315533 podStartE2EDuration="4.302028766s" totalImagesPullingTime="2.227713233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:59:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:59:19.300938621 +0000 UTC m=+661.982003065" watchObservedRunningTime="2026-07-27 15:59:19.302028766 +0000 UTC m=+661.983093197"
Jul 27 15:59:22.297415 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:22.297378    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m" event={"ID":"87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0","Type":"ContainerStarted","Data":"9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561"}
Jul 27 15:59:22.297784 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:22.297474    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"
Jul 27 15:59:22.320867 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:22.320822    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m" podStartSLOduration=2.185237162 podStartE2EDuration="4.320808103s" totalImagesPullingTime="2.135570941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:59:22.319061444 +0000 UTC m=+665.000125873" watchObservedRunningTime="2026-07-27 15:59:22.320808103 +0000 UTC m=+665.001872533"
Jul 27 15:59:30.288902 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:30.288866    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9mlp8"
Jul 27 15:59:33.305051 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:33.305021    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"
Jul 27 15:59:33.799381 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:33.799349    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"]
Jul 27 15:59:33.799586 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:33.799561    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m" podUID="87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0" containerName="manager" containerID="cri-o://9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561" gracePeriod=2
Jul 27 15:59:33.807059 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:33.807033    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"]
Jul 27 15:59:33.840187 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:33.840152    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg"]
Jul 27 15:59:33.840539 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:33.840522    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0" containerName="manager"
Jul 27 15:59:33.840635 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:33.840541    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0" containerName="manager"
Jul 27 15:59:33.840690 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:33.840642    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0" containerName="manager"
Jul 27 15:59:33.843555 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:33.843535    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg"
Jul 27 15:59:33.856590 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:33.856563    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg"]
Jul 27 15:59:33.874957 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:59:33.874930    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-dpg2m\" is forbidden: User \"system:node:ip-10-0-141-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-146.ec2.internal' and this object" podUID="87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"
Jul 27 15:59:33.952115 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:33.952078    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dskcp\" (UniqueName: \"kubernetes.io/projected/1e7f1162-d953-4366-a568-6dea3f5f4649-kube-api-access-dskcp\") pod \"limitador-operator-controller-manager-859d7b78bd-sv8tg\" (UID: \"1e7f1162-d953-4366-a568-6dea3f5f4649\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg"
Jul 27 15:59:34.037062 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.037037    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"
Jul 27 15:59:34.052641 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.052585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dskcp\" (UniqueName: \"kubernetes.io/projected/1e7f1162-d953-4366-a568-6dea3f5f4649-kube-api-access-dskcp\") pod \"limitador-operator-controller-manager-859d7b78bd-sv8tg\" (UID: \"1e7f1162-d953-4366-a568-6dea3f5f4649\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg"
Jul 27 15:59:34.061608 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.061573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dskcp\" (UniqueName: \"kubernetes.io/projected/1e7f1162-d953-4366-a568-6dea3f5f4649-kube-api-access-dskcp\") pod \"limitador-operator-controller-manager-859d7b78bd-sv8tg\" (UID: \"1e7f1162-d953-4366-a568-6dea3f5f4649\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg"
Jul 27 15:59:34.153067 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.153033    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr2fv\" (UniqueName: \"kubernetes.io/projected/87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0-kube-api-access-tr2fv\") pod \"87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0\" (UID: \"87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0\") "
Jul 27 15:59:34.159983 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.159939    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0-kube-api-access-tr2fv" (OuterVolumeSpecName: "kube-api-access-tr2fv") pod "87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0" (UID: "87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0"). InnerVolumeSpecName "kube-api-access-tr2fv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:59:34.175227 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.175201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg"
Jul 27 15:59:34.254650 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.254619    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr2fv\" (UniqueName: \"kubernetes.io/projected/87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0-kube-api-access-tr2fv\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:34.306263 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.306173    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c97b659dd-fgxmf" podUID="896bad3d-352b-4287-81c6-d23290baa686" containerName="console" containerID="cri-o://82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda" gracePeriod=15
Jul 27 15:59:34.310350 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.310319    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg"]
Jul 27 15:59:34.312756 ip-10-0-141-146 kubenswrapper[2579]: W0727 15:59:34.312721    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e7f1162_d953_4366_a568_6dea3f5f4649.slice/crio-696510480d865904c745112d99f4b4abd8fad8b494b7586124423b3e1f51c52a WatchSource:0}: Error finding container 696510480d865904c745112d99f4b4abd8fad8b494b7586124423b3e1f51c52a: Status 404 returned error can't find the container with id 696510480d865904c745112d99f4b4abd8fad8b494b7586124423b3e1f51c52a
Jul 27 15:59:34.356867 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.356839    2579 generic.go:356] "Generic (PLEG): container finished" podID="87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0" containerID="9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561" exitCode=0
Jul 27 15:59:34.356976 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.356897    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dpg2m"
Jul 27 15:59:34.356976 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.356933    2579 scope.go:117] "RemoveContainer" containerID="9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561"
Jul 27 15:59:34.358336 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.358317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg" event={"ID":"1e7f1162-d953-4366-a568-6dea3f5f4649","Type":"ContainerStarted","Data":"696510480d865904c745112d99f4b4abd8fad8b494b7586124423b3e1f51c52a"}
Jul 27 15:59:34.417961 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.417940    2579 scope.go:117] "RemoveContainer" containerID="9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561"
Jul 27 15:59:34.418317 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:59:34.418290    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561\": container with ID starting with 9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561 not found: ID does not exist" containerID="9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561"
Jul 27 15:59:34.418383 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.418334    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561"} err="failed to get container status \"9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561\": rpc error: code = NotFound desc = could not find container \"9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561\": container with ID starting with 9627c8c260a51e6a7e615f3808f9bce5ed1c81f802587137b145e3037af11561 not found: ID does not exist"
Jul 27 15:59:34.545128 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.545099    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:59:34.658131 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.658059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-serving-cert\") pod \"896bad3d-352b-4287-81c6-d23290baa686\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") "
Jul 27 15:59:34.658131 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.658114    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-service-ca\") pod \"896bad3d-352b-4287-81c6-d23290baa686\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") "
Jul 27 15:59:34.658335 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.658141    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-console-config\") pod \"896bad3d-352b-4287-81c6-d23290baa686\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") "
Jul 27 15:59:34.658335 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.658171    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-oauth-config\") pod \"896bad3d-352b-4287-81c6-d23290baa686\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") "
Jul 27 15:59:34.658335 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.658195    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-trusted-ca-bundle\") pod \"896bad3d-352b-4287-81c6-d23290baa686\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") "
Jul 27 15:59:34.658335 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.658217    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-oauth-serving-cert\") pod \"896bad3d-352b-4287-81c6-d23290baa686\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") "
Jul 27 15:59:34.658335 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.658237    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gfg6\" (UniqueName: \"kubernetes.io/projected/896bad3d-352b-4287-81c6-d23290baa686-kube-api-access-8gfg6\") pod \"896bad3d-352b-4287-81c6-d23290baa686\" (UID: \"896bad3d-352b-4287-81c6-d23290baa686\") "
Jul 27 15:59:34.658658 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.658629    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-service-ca" (OuterVolumeSpecName: "service-ca") pod "896bad3d-352b-4287-81c6-d23290baa686" (UID: "896bad3d-352b-4287-81c6-d23290baa686"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:59:34.658747 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.658635    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-console-config" (OuterVolumeSpecName: "console-config") pod "896bad3d-352b-4287-81c6-d23290baa686" (UID: "896bad3d-352b-4287-81c6-d23290baa686"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:59:34.658747 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.658668    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "896bad3d-352b-4287-81c6-d23290baa686" (UID: "896bad3d-352b-4287-81c6-d23290baa686"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:59:34.658747 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.658679    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "896bad3d-352b-4287-81c6-d23290baa686" (UID: "896bad3d-352b-4287-81c6-d23290baa686"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 15:59:34.660186 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.660164    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "896bad3d-352b-4287-81c6-d23290baa686" (UID: "896bad3d-352b-4287-81c6-d23290baa686"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:59:34.660328 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.660313    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "896bad3d-352b-4287-81c6-d23290baa686" (UID: "896bad3d-352b-4287-81c6-d23290baa686"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 15:59:34.660372 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.660353    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/896bad3d-352b-4287-81c6-d23290baa686-kube-api-access-8gfg6" (OuterVolumeSpecName: "kube-api-access-8gfg6") pod "896bad3d-352b-4287-81c6-d23290baa686" (UID: "896bad3d-352b-4287-81c6-d23290baa686"). InnerVolumeSpecName "kube-api-access-8gfg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 15:59:34.758978 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.758952    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:34.758978 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.758975    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-service-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:34.758978 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.758984    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-console-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:34.759179 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.758992    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/896bad3d-352b-4287-81c6-d23290baa686-console-oauth-config\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:34.759179 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.759000    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-trusted-ca-bundle\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:34.759179 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.759008    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/896bad3d-352b-4287-81c6-d23290baa686-oauth-serving-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:34.759179 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:34.759017    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gfg6\" (UniqueName: \"kubernetes.io/projected/896bad3d-352b-4287-81c6-d23290baa686-kube-api-access-8gfg6\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 15:59:35.365613 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.365580    2579 generic.go:356] "Generic (PLEG): container finished" podID="896bad3d-352b-4287-81c6-d23290baa686" containerID="82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda" exitCode=0
Jul 27 15:59:35.366055 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.365628    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c97b659dd-fgxmf"
Jul 27 15:59:35.366055 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.365671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c97b659dd-fgxmf" event={"ID":"896bad3d-352b-4287-81c6-d23290baa686","Type":"ContainerDied","Data":"82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda"}
Jul 27 15:59:35.366055 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.365732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c97b659dd-fgxmf" event={"ID":"896bad3d-352b-4287-81c6-d23290baa686","Type":"ContainerDied","Data":"df3692c96aac3c2e0c792d10a0f38be1466c85e74229d7a9eeb339f9f6132151"}
Jul 27 15:59:35.366055 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.365764    2579 scope.go:117] "RemoveContainer" containerID="82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda"
Jul 27 15:59:35.367378 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.367353    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg" event={"ID":"1e7f1162-d953-4366-a568-6dea3f5f4649","Type":"ContainerStarted","Data":"29a09ece5be3380be2576e420dbd93c2fff2e389b2dbff91b255d08eabd4c75e"}
Jul 27 15:59:35.367492 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.367477    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg"
Jul 27 15:59:35.374678 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.374662    2579 scope.go:117] "RemoveContainer" containerID="82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda"
Jul 27 15:59:35.374911 ip-10-0-141-146 kubenswrapper[2579]: E0727 15:59:35.374893    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda\": container with ID starting with 82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda not found: ID does not exist" containerID="82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda"
Jul 27 15:59:35.374958 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.374922    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda"} err="failed to get container status \"82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda\": rpc error: code = NotFound desc = could not find container \"82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda\": container with ID starting with 82cd623f1cd0b67ddcf831d37669a38d3bd326072656570a145d93471c78eeda not found: ID does not exist"
Jul 27 15:59:35.388848 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.388808    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg" podStartSLOduration=2.388796625 podStartE2EDuration="2.388796625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 15:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 15:59:35.386811992 +0000 UTC m=+678.067876425" watchObservedRunningTime="2026-07-27 15:59:35.388796625 +0000 UTC m=+678.069861054"
Jul 27 15:59:35.401384 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.401362    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c97b659dd-fgxmf"]
Jul 27 15:59:35.405289 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.405266    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c97b659dd-fgxmf"]
Jul 27 15:59:35.929472 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.929440    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0" path="/var/lib/kubelet/pods/87ac4027-e5e8-4f47-9c2a-98d6be2a7fe0/volumes"
Jul 27 15:59:35.929824 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:35.929810    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="896bad3d-352b-4287-81c6-d23290baa686" path="/var/lib/kubelet/pods/896bad3d-352b-4287-81c6-d23290baa686/volumes"
Jul 27 15:59:46.375608 ip-10-0-141-146 kubenswrapper[2579]: I0727 15:59:46.375578    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sv8tg"
Jul 27 16:00:03.695680 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.695650    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"]
Jul 27 16:00:03.696169 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.695957    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="896bad3d-352b-4287-81c6-d23290baa686" containerName="console"
Jul 27 16:00:03.696169 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.695968    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="896bad3d-352b-4287-81c6-d23290baa686" containerName="console"
Jul 27 16:00:03.696169 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.696024    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="896bad3d-352b-4287-81c6-d23290baa686" containerName="console"
Jul 27 16:00:03.701942 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.701924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.704220 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.704198    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9m2bb\""
Jul 27 16:00:03.709057 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.709036    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"]
Jul 27 16:00:03.783327 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.783292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.783327 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.783330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.783582 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.783347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p28d\" (UniqueName: \"kubernetes.io/projected/dca93d49-78b3-4aca-975f-25bc6a68fbb8-kube-api-access-7p28d\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.783582 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.783380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.783582 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.783410    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.783582 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.783440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.783582 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.783507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.783582 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.783543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.783896 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.783589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.884635 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.884598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.884635 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.884636    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.884872 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.884653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.884872 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.884689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.884872 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.884725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.884872 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.884757    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.884872 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.884780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p28d\" (UniqueName: \"kubernetes.io/projected/dca93d49-78b3-4aca-975f-25bc6a68fbb8-kube-api-access-7p28d\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.884872 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.884819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.884872 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.884851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.885293 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.885124    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-workload-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.885293 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.885145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-data\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.885293 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.885202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-credential-socket\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.885446 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.885403    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-workload-certs\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.885638 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.885616    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.887262 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.887238    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-envoy\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.887399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.887385    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.893759 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.893737    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dca93d49-78b3-4aca-975f-25bc6a68fbb8-istio-token\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:03.894302 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:03.894284    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p28d\" (UniqueName: \"kubernetes.io/projected/dca93d49-78b3-4aca-975f-25bc6a68fbb8-kube-api-access-7p28d\") pod \"maas-default-gateway-openshift-default-c747fcbf8-xm9bx\" (UID: \"dca93d49-78b3-4aca-975f-25bc6a68fbb8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:04.012074 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:04.011992    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:04.157803 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:04.157773    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"]
Jul 27 16:00:04.159318 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:00:04.159294    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca93d49_78b3_4aca_975f_25bc6a68fbb8.slice/crio-1864dd500b3834cd4f4a31239488e510c3836baaf011607953b91a016dd2d073 WatchSource:0}: Error finding container 1864dd500b3834cd4f4a31239488e510c3836baaf011607953b91a016dd2d073: Status 404 returned error can't find the container with id 1864dd500b3834cd4f4a31239488e510c3836baaf011607953b91a016dd2d073
Jul 27 16:00:04.161473 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:04.161435    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:00:04.161555 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:04.161539    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:00:04.161599 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:04.161579    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:00:04.512937 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:04.512902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx" event={"ID":"dca93d49-78b3-4aca-975f-25bc6a68fbb8","Type":"ContainerStarted","Data":"d95bc67ca0c16907642b1f7f9baa0d782694b559d4dd01dc10787766c71c00cf"}
Jul 27 16:00:04.513125 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:04.512958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx" event={"ID":"dca93d49-78b3-4aca-975f-25bc6a68fbb8","Type":"ContainerStarted","Data":"1864dd500b3834cd4f4a31239488e510c3836baaf011607953b91a016dd2d073"}
Jul 27 16:00:04.538138 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:04.538082    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx" podStartSLOduration=1.538069267 podStartE2EDuration="1.538069267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:00:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:00:04.535519685 +0000 UTC m=+707.216584109" watchObservedRunningTime="2026-07-27 16:00:04.538069267 +0000 UTC m=+707.219133698"
Jul 27 16:00:05.012367 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.012333    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:05.016822 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.016801    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:05.518402 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.518369    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:05.519356 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.519341    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:00:05.674733 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.674700    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n27hv"]
Jul 27 16:00:05.678043 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.678026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:05.680307 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.680284    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 16:00:05.680413 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.680309    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-r6t56\""
Jul 27 16:00:05.687291 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.687260    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n27hv"]
Jul 27 16:00:05.696652 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.696627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fffd4f91-6d0a-4e14-9617-f39d5a650d12-config-file\") pod \"limitador-limitador-64c94fd64f-n27hv\" (UID: \"fffd4f91-6d0a-4e14-9617-f39d5a650d12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:05.696749 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.696688    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng868\" (UniqueName: \"kubernetes.io/projected/fffd4f91-6d0a-4e14-9617-f39d5a650d12-kube-api-access-ng868\") pod \"limitador-limitador-64c94fd64f-n27hv\" (UID: \"fffd4f91-6d0a-4e14-9617-f39d5a650d12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:05.769309 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.769230    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n27hv"]
Jul 27 16:00:05.798119 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.798069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fffd4f91-6d0a-4e14-9617-f39d5a650d12-config-file\") pod \"limitador-limitador-64c94fd64f-n27hv\" (UID: \"fffd4f91-6d0a-4e14-9617-f39d5a650d12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:05.798119 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.798108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng868\" (UniqueName: \"kubernetes.io/projected/fffd4f91-6d0a-4e14-9617-f39d5a650d12-kube-api-access-ng868\") pod \"limitador-limitador-64c94fd64f-n27hv\" (UID: \"fffd4f91-6d0a-4e14-9617-f39d5a650d12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:05.798760 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.798739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fffd4f91-6d0a-4e14-9617-f39d5a650d12-config-file\") pod \"limitador-limitador-64c94fd64f-n27hv\" (UID: \"fffd4f91-6d0a-4e14-9617-f39d5a650d12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:05.806518 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.806483    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng868\" (UniqueName: \"kubernetes.io/projected/fffd4f91-6d0a-4e14-9617-f39d5a650d12-kube-api-access-ng868\") pod \"limitador-limitador-64c94fd64f-n27hv\" (UID: \"fffd4f91-6d0a-4e14-9617-f39d5a650d12\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:05.989826 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:05.989793    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:06.120146 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:06.120118    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n27hv"]
Jul 27 16:00:06.121026 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:00:06.120989    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfffd4f91_6d0a_4e14_9617_f39d5a650d12.slice/crio-177f14b2a215baea83cc0f3ba1d1ec35889629c466b07afd411783f904323d2c WatchSource:0}: Error finding container 177f14b2a215baea83cc0f3ba1d1ec35889629c466b07afd411783f904323d2c: Status 404 returned error can't find the container with id 177f14b2a215baea83cc0f3ba1d1ec35889629c466b07afd411783f904323d2c
Jul 27 16:00:06.524257 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:06.524226    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv" event={"ID":"fffd4f91-6d0a-4e14-9617-f39d5a650d12","Type":"ContainerStarted","Data":"177f14b2a215baea83cc0f3ba1d1ec35889629c466b07afd411783f904323d2c"}
Jul 27 16:00:09.543646 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:09.543566    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv" event={"ID":"fffd4f91-6d0a-4e14-9617-f39d5a650d12","Type":"ContainerStarted","Data":"83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03"}
Jul 27 16:00:09.544032 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:09.543650    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:09.562370 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:09.562324    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv" podStartSLOduration=1.6691069280000002 podStartE2EDuration="4.562312872s" totalImagesPullingTime="2.893205944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:00:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:00:09.559295354 +0000 UTC m=+712.240359783" watchObservedRunningTime="2026-07-27 16:00:09.562312872 +0000 UTC m=+712.243377347"
Jul 27 16:00:20.549080 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:20.549048    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:22.349412 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:22.349377    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n27hv"]
Jul 27 16:00:22.349811 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:22.349571    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv" podUID="fffd4f91-6d0a-4e14-9617-f39d5a650d12" containerName="limitador" containerID="cri-o://83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03" gracePeriod=30
Jul 27 16:00:22.892785 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:22.892761    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:22.947333 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:22.947247    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng868\" (UniqueName: \"kubernetes.io/projected/fffd4f91-6d0a-4e14-9617-f39d5a650d12-kube-api-access-ng868\") pod \"fffd4f91-6d0a-4e14-9617-f39d5a650d12\" (UID: \"fffd4f91-6d0a-4e14-9617-f39d5a650d12\") "
Jul 27 16:00:22.947333 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:22.947319    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fffd4f91-6d0a-4e14-9617-f39d5a650d12-config-file\") pod \"fffd4f91-6d0a-4e14-9617-f39d5a650d12\" (UID: \"fffd4f91-6d0a-4e14-9617-f39d5a650d12\") "
Jul 27 16:00:22.947714 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:22.947680    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fffd4f91-6d0a-4e14-9617-f39d5a650d12-config-file" (OuterVolumeSpecName: "config-file") pod "fffd4f91-6d0a-4e14-9617-f39d5a650d12" (UID: "fffd4f91-6d0a-4e14-9617-f39d5a650d12"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:00:22.949303 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:22.949282    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fffd4f91-6d0a-4e14-9617-f39d5a650d12-kube-api-access-ng868" (OuterVolumeSpecName: "kube-api-access-ng868") pod "fffd4f91-6d0a-4e14-9617-f39d5a650d12" (UID: "fffd4f91-6d0a-4e14-9617-f39d5a650d12"). InnerVolumeSpecName "kube-api-access-ng868". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:00:23.048010 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.047969    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng868\" (UniqueName: \"kubernetes.io/projected/fffd4f91-6d0a-4e14-9617-f39d5a650d12-kube-api-access-ng868\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:00:23.048010 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.048000    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/fffd4f91-6d0a-4e14-9617-f39d5a650d12-config-file\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:00:23.612519 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.612466    2579 generic.go:356] "Generic (PLEG): container finished" podID="fffd4f91-6d0a-4e14-9617-f39d5a650d12" containerID="83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03" exitCode=0
Jul 27 16:00:23.612930 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.612526    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv"
Jul 27 16:00:23.612930 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.612535    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv" event={"ID":"fffd4f91-6d0a-4e14-9617-f39d5a650d12","Type":"ContainerDied","Data":"83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03"}
Jul 27 16:00:23.612930 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.612592    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-n27hv" event={"ID":"fffd4f91-6d0a-4e14-9617-f39d5a650d12","Type":"ContainerDied","Data":"177f14b2a215baea83cc0f3ba1d1ec35889629c466b07afd411783f904323d2c"}
Jul 27 16:00:23.612930 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.612617    2579 scope.go:117] "RemoveContainer" containerID="83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03"
Jul 27 16:00:23.621874 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.621852    2579 scope.go:117] "RemoveContainer" containerID="83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03"
Jul 27 16:00:23.622134 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:00:23.622116    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03\": container with ID starting with 83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03 not found: ID does not exist" containerID="83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03"
Jul 27 16:00:23.622178 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.622144    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03"} err="failed to get container status \"83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03\": rpc error: code = NotFound desc = could not find container \"83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03\": container with ID starting with 83b1f187ab1205f44e6c8ac821c69a3d7b832a55f1887ed6a02c4694651e6b03 not found: ID does not exist"
Jul 27 16:00:23.634742 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.634712    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n27hv"]
Jul 27 16:00:23.636998 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.636975    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-n27hv"]
Jul 27 16:00:23.930527 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:23.930434    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fffd4f91-6d0a-4e14-9617-f39d5a650d12" path="/var/lib/kubelet/pods/fffd4f91-6d0a-4e14-9617-f39d5a650d12/volumes"
Jul 27 16:00:28.381907 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.381873    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"]
Jul 27 16:00:28.382267 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.382195    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fffd4f91-6d0a-4e14-9617-f39d5a650d12" containerName="limitador"
Jul 27 16:00:28.382267 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.382205    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fffd4f91-6d0a-4e14-9617-f39d5a650d12" containerName="limitador"
Jul 27 16:00:28.382267 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.382253    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fffd4f91-6d0a-4e14-9617-f39d5a650d12" containerName="limitador"
Jul 27 16:00:28.386694 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.386674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"
Jul 27 16:00:28.390191 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.390167    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jkjt2\""
Jul 27 16:00:28.390641 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.390624    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 27 16:00:28.391032 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.391016    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 16:00:28.391092 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.391075    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 27 16:00:28.397039 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.397011    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"]
Jul 27 16:00:28.493837 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.493740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsllp\" (UniqueName: \"kubernetes.io/projected/91c5857c-5673-49f1-bdc2-fae31072c7b7-kube-api-access-qsllp\") pod \"postgres-69fb4594cf-97vh6\" (UID: \"91c5857c-5673-49f1-bdc2-fae31072c7b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"
Jul 27 16:00:28.494046 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.493864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/91c5857c-5673-49f1-bdc2-fae31072c7b7-data\") pod \"postgres-69fb4594cf-97vh6\" (UID: \"91c5857c-5673-49f1-bdc2-fae31072c7b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"
Jul 27 16:00:28.595058 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.595022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsllp\" (UniqueName: \"kubernetes.io/projected/91c5857c-5673-49f1-bdc2-fae31072c7b7-kube-api-access-qsllp\") pod \"postgres-69fb4594cf-97vh6\" (UID: \"91c5857c-5673-49f1-bdc2-fae31072c7b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"
Jul 27 16:00:28.595058 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.595063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/91c5857c-5673-49f1-bdc2-fae31072c7b7-data\") pod \"postgres-69fb4594cf-97vh6\" (UID: \"91c5857c-5673-49f1-bdc2-fae31072c7b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"
Jul 27 16:00:28.595431 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.595414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/91c5857c-5673-49f1-bdc2-fae31072c7b7-data\") pod \"postgres-69fb4594cf-97vh6\" (UID: \"91c5857c-5673-49f1-bdc2-fae31072c7b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"
Jul 27 16:00:28.611158 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.611131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsllp\" (UniqueName: \"kubernetes.io/projected/91c5857c-5673-49f1-bdc2-fae31072c7b7-kube-api-access-qsllp\") pod \"postgres-69fb4594cf-97vh6\" (UID: \"91c5857c-5673-49f1-bdc2-fae31072c7b7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"
Jul 27 16:00:28.697915 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.697828    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"
Jul 27 16:00:28.828610 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:28.828586    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"]
Jul 27 16:00:28.830242 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:00:28.830215    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c5857c_5673_49f1_bdc2_fae31072c7b7.slice/crio-6e2a14a22e5f5b02c708c84793b03177b451f98e8f8f4f39993442dead2288bb WatchSource:0}: Error finding container 6e2a14a22e5f5b02c708c84793b03177b451f98e8f8f4f39993442dead2288bb: Status 404 returned error can't find the container with id 6e2a14a22e5f5b02c708c84793b03177b451f98e8f8f4f39993442dead2288bb
Jul 27 16:00:29.643037 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:29.643001    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6" event={"ID":"91c5857c-5673-49f1-bdc2-fae31072c7b7","Type":"ContainerStarted","Data":"6e2a14a22e5f5b02c708c84793b03177b451f98e8f8f4f39993442dead2288bb"}
Jul 27 16:00:34.676812 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:34.676778    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6" event={"ID":"91c5857c-5673-49f1-bdc2-fae31072c7b7","Type":"ContainerStarted","Data":"ef58cd2457cd281d073865bed660d5c08b89b9c3701fd7029b61c8ab8ca5e819"}
Jul 27 16:00:34.677248 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:34.676905    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"
Jul 27 16:00:34.694535 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:34.694469    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6" podStartSLOduration=1.020395508 podStartE2EDuration="6.694455365s" totalImagesPullingTime="5.674059857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:00:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:00:34.693722791 +0000 UTC m=+737.374787223" watchObservedRunningTime="2026-07-27 16:00:34.694455365 +0000 UTC m=+737.375519794"
Jul 27 16:00:40.711340 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:40.711311    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-97vh6"
Jul 27 16:00:48.500063 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.500029    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-4sm95"]
Jul 27 16:00:48.503061 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.503041    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:00:48.505573 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.505550    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 27 16:00:48.505686 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.505554    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 27 16:00:48.505686 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.505637    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-v4948\""
Jul 27 16:00:48.512228 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.512208    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-4sm95"]
Jul 27 16:00:48.677209 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.677156    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/654a51dd-8fa9-4703-8167-98e759af1e29-webhook-cert\") pod \"maas-controller-7bf786f7f9-4sm95\" (UID: \"654a51dd-8fa9-4703-8167-98e759af1e29\") " pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:00:48.677209 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.677212    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf9kb\" (UniqueName: \"kubernetes.io/projected/654a51dd-8fa9-4703-8167-98e759af1e29-kube-api-access-zf9kb\") pod \"maas-controller-7bf786f7f9-4sm95\" (UID: \"654a51dd-8fa9-4703-8167-98e759af1e29\") " pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:00:48.778306 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.778268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/654a51dd-8fa9-4703-8167-98e759af1e29-webhook-cert\") pod \"maas-controller-7bf786f7f9-4sm95\" (UID: \"654a51dd-8fa9-4703-8167-98e759af1e29\") " pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:00:48.778529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.778314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf9kb\" (UniqueName: \"kubernetes.io/projected/654a51dd-8fa9-4703-8167-98e759af1e29-kube-api-access-zf9kb\") pod \"maas-controller-7bf786f7f9-4sm95\" (UID: \"654a51dd-8fa9-4703-8167-98e759af1e29\") " pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:00:48.780855 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.780826    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/654a51dd-8fa9-4703-8167-98e759af1e29-webhook-cert\") pod \"maas-controller-7bf786f7f9-4sm95\" (UID: \"654a51dd-8fa9-4703-8167-98e759af1e29\") " pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:00:48.787275 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.787243    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf9kb\" (UniqueName: \"kubernetes.io/projected/654a51dd-8fa9-4703-8167-98e759af1e29-kube-api-access-zf9kb\") pod \"maas-controller-7bf786f7f9-4sm95\" (UID: \"654a51dd-8fa9-4703-8167-98e759af1e29\") " pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:00:48.814846 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.814799    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:00:48.957663 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:48.957635    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-4sm95"]
Jul 27 16:00:48.960144 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:00:48.960110    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654a51dd_8fa9_4703_8167_98e759af1e29.slice/crio-7520d435a8d70df2ac4a190cf12cdd94bc86fde191564de3ce654ef4f16a2db2 WatchSource:0}: Error finding container 7520d435a8d70df2ac4a190cf12cdd94bc86fde191564de3ce654ef4f16a2db2: Status 404 returned error can't find the container with id 7520d435a8d70df2ac4a190cf12cdd94bc86fde191564de3ce654ef4f16a2db2
Jul 27 16:00:49.753182 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:49.753147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf786f7f9-4sm95" event={"ID":"654a51dd-8fa9-4703-8167-98e759af1e29","Type":"ContainerStarted","Data":"7520d435a8d70df2ac4a190cf12cdd94bc86fde191564de3ce654ef4f16a2db2"}
Jul 27 16:00:52.771143 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:52.771103    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf786f7f9-4sm95" event={"ID":"654a51dd-8fa9-4703-8167-98e759af1e29","Type":"ContainerStarted","Data":"c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287"}
Jul 27 16:00:52.771585 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:52.771264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:00:52.795839 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:00:52.795781    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bf786f7f9-4sm95" podStartSLOduration=1.83985239 podStartE2EDuration="4.795762964s" totalImagesPullingTime="2.955910574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:00:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:00:52.795474425 +0000 UTC m=+755.476538857" watchObservedRunningTime="2026-07-27 16:00:52.795762964 +0000 UTC m=+755.476827392"
Jul 27 16:01:03.778415 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:03.778382    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:01:25.281819 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.281781    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-vbq5q"]
Jul 27 16:01:25.286620 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.286598    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q"
Jul 27 16:01:25.288814 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.288793    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 27 16:01:25.288814 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.288813    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g2ppj\""
Jul 27 16:01:25.297174 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.297142    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-vbq5q"]
Jul 27 16:01:25.380192 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.380158    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwn77\" (UniqueName: \"kubernetes.io/projected/00315488-f29e-4a44-b58b-c9a8bd46a3fd-kube-api-access-vwn77\") pod \"payload-processing-5cc6cd444b-vbq5q\" (UID: \"00315488-f29e-4a44-b58b-c9a8bd46a3fd\") " pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q"
Jul 27 16:01:25.380357 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.380201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00315488-f29e-4a44-b58b-c9a8bd46a3fd-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-vbq5q\" (UID: \"00315488-f29e-4a44-b58b-c9a8bd46a3fd\") " pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q"
Jul 27 16:01:25.481258 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.481224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00315488-f29e-4a44-b58b-c9a8bd46a3fd-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-vbq5q\" (UID: \"00315488-f29e-4a44-b58b-c9a8bd46a3fd\") " pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q"
Jul 27 16:01:25.481419 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.481317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwn77\" (UniqueName: \"kubernetes.io/projected/00315488-f29e-4a44-b58b-c9a8bd46a3fd-kube-api-access-vwn77\") pod \"payload-processing-5cc6cd444b-vbq5q\" (UID: \"00315488-f29e-4a44-b58b-c9a8bd46a3fd\") " pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q"
Jul 27 16:01:25.482096 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.482072    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00315488-f29e-4a44-b58b-c9a8bd46a3fd-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-vbq5q\" (UID: \"00315488-f29e-4a44-b58b-c9a8bd46a3fd\") " pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q"
Jul 27 16:01:25.494683 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.494662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwn77\" (UniqueName: \"kubernetes.io/projected/00315488-f29e-4a44-b58b-c9a8bd46a3fd-kube-api-access-vwn77\") pod \"payload-processing-5cc6cd444b-vbq5q\" (UID: \"00315488-f29e-4a44-b58b-c9a8bd46a3fd\") " pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q"
Jul 27 16:01:25.596904 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.596823    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q"
Jul 27 16:01:25.938396 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.938373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-vbq5q"]
Jul 27 16:01:25.940333 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:01:25.940304    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00315488_f29e_4a44_b58b_c9a8bd46a3fd.slice/crio-01b8dcd3939a8923ac55bcdec4f2da932cacef745d33dc9e3fe3fc520085c95f WatchSource:0}: Error finding container 01b8dcd3939a8923ac55bcdec4f2da932cacef745d33dc9e3fe3fc520085c95f: Status 404 returned error can't find the container with id 01b8dcd3939a8923ac55bcdec4f2da932cacef745d33dc9e3fe3fc520085c95f
Jul 27 16:01:25.941889 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:25.941872    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 16:01:26.944577 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:26.944542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q" event={"ID":"00315488-f29e-4a44-b58b-c9a8bd46a3fd","Type":"ContainerStarted","Data":"01b8dcd3939a8923ac55bcdec4f2da932cacef745d33dc9e3fe3fc520085c95f"}
Jul 27 16:01:28.964663 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:28.964625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q" event={"ID":"00315488-f29e-4a44-b58b-c9a8bd46a3fd","Type":"ContainerStarted","Data":"53fd287d38059070526ebd5700ee1d61b110e61fc03f45f4bb51dfe18395498a"}
Jul 27 16:01:28.965923 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:28.965899    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q"
Jul 27 16:01:28.987573 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:28.987512    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q" podStartSLOduration=2.035227709 podStartE2EDuration="3.987477357s" totalImagesPullingTime="1.952249648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:01:28.984218262 +0000 UTC m=+791.665282709" watchObservedRunningTime="2026-07-27 16:01:28.987477357 +0000 UTC m=+791.668541788"
Jul 27 16:01:35.000889 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:35.000801    2579 generic.go:356] "Generic (PLEG): container finished" podID="dca93d49-78b3-4aca-975f-25bc6a68fbb8" containerID="d95bc67ca0c16907642b1f7f9baa0d782694b559d4dd01dc10787766c71c00cf" exitCode=0
Jul 27 16:01:35.000889 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:35.000861    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx" event={"ID":"dca93d49-78b3-4aca-975f-25bc6a68fbb8","Type":"ContainerDied","Data":"d95bc67ca0c16907642b1f7f9baa0d782694b559d4dd01dc10787766c71c00cf"}
Jul 27 16:01:35.001334 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:35.001183    2579 scope.go:117] "RemoveContainer" containerID="d95bc67ca0c16907642b1f7f9baa0d782694b559d4dd01dc10787766c71c00cf"
Jul 27 16:01:35.002088 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:35.002062    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:01:35.002142 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:35.002125    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:01:35.002179 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:35.002157    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:01:35.518970 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:35.518937    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:01:36.008413 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:36.008379    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx" event={"ID":"dca93d49-78b3-4aca-975f-25bc6a68fbb8","Type":"ContainerStarted","Data":"603edc8016724323380d157eade72e7560c9c5611b0a202931242559f8f4a556"}
Jul 27 16:01:36.013271 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:36.013247    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:01:36.014734 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:36.014708    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-xm9bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 27 16:01:36.014926 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:36.014899    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx" podUID="dca93d49-78b3-4aca-975f-25bc6a68fbb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 27 16:01:37.013265 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:37.013230    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-xm9bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 27 16:01:37.013763 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:37.013288    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx" podUID="dca93d49-78b3-4aca-975f-25bc6a68fbb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 27 16:01:38.013312 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:38.013278    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-xm9bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 27 16:01:38.013730 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:38.013328    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx" podUID="dca93d49-78b3-4aca-975f-25bc6a68fbb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 27 16:01:39.012698 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:39.012663    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-xm9bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 27 16:01:39.012875 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:39.012718    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx" podUID="dca93d49-78b3-4aca-975f-25bc6a68fbb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 27 16:01:40.012771 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:40.012689    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-c747fcbf8-xm9bx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Jul 27 16:01:40.012771 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:40.012740    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx" podUID="dca93d49-78b3-4aca-975f-25bc6a68fbb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Jul 27 16:01:40.979923 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:40.979892    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-vbq5q"
Jul 27 16:01:41.016256 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:41.016225    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:01:41.016710 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:41.016612    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:01:41.017378 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:41.017359    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-c747fcbf8-xm9bx"
Jul 27 16:01:53.291179 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.291146    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"]
Jul 27 16:01:53.293953 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.293930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.296910 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.296884    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9b5nx\""
Jul 27 16:01:53.297042 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.296925    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 16:01:53.297042 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.296958    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 27 16:01:53.297148 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.296957    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 16:01:53.307978 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.307953    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"]
Jul 27 16:01:53.412047 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.412020    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.412047 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.412053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxqn\" (UniqueName: \"kubernetes.io/projected/6617f656-b7e0-47f6-b1a1-ec741a265bf5-kube-api-access-2cxqn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.412234 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.412076    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6617f656-b7e0-47f6-b1a1-ec741a265bf5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.412234 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.412188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.412318 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.412235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.412318 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.412262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.512822 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.512793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6617f656-b7e0-47f6-b1a1-ec741a265bf5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.512985 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.512858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.512985 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.512899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.513101 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.513021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.513101 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.513092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.513208 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.513127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxqn\" (UniqueName: \"kubernetes.io/projected/6617f656-b7e0-47f6-b1a1-ec741a265bf5-kube-api-access-2cxqn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.513332 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.513317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.513387 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.513370    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.513455 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.513433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.515009 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.514983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6617f656-b7e0-47f6-b1a1-ec741a265bf5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.515255 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.515240    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6617f656-b7e0-47f6-b1a1-ec741a265bf5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.523561 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.523540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxqn\" (UniqueName: \"kubernetes.io/projected/6617f656-b7e0-47f6-b1a1-ec741a265bf5-kube-api-access-2cxqn\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kn9fw\" (UID: \"6617f656-b7e0-47f6-b1a1-ec741a265bf5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.605388 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.605313    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:01:53.743214 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:53.743188    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"]
Jul 27 16:01:53.745545 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:01:53.745491    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6617f656_b7e0_47f6_b1a1_ec741a265bf5.slice/crio-4456bce6b44d0c675fa0f09b042a4b37795a0d43d80bf0986f3e9a340602b49d WatchSource:0}: Error finding container 4456bce6b44d0c675fa0f09b042a4b37795a0d43d80bf0986f3e9a340602b49d: Status 404 returned error can't find the container with id 4456bce6b44d0c675fa0f09b042a4b37795a0d43d80bf0986f3e9a340602b49d
Jul 27 16:01:54.102599 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:54.102557    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw" event={"ID":"6617f656-b7e0-47f6-b1a1-ec741a265bf5","Type":"ContainerStarted","Data":"4456bce6b44d0c675fa0f09b042a4b37795a0d43d80bf0986f3e9a340602b49d"}
Jul 27 16:01:55.112131 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:55.112100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw" event={"ID":"6617f656-b7e0-47f6-b1a1-ec741a265bf5","Type":"ContainerStarted","Data":"eef91ce14f9ab6b82b02da13956662c9c1572e02f49f5e60c2d5994ebea5178e"}
Jul 27 16:01:55.132214 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:01:55.132139    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw" podStartSLOduration=1.168877837 podStartE2EDuration="2.132120969s" totalImagesPullingTime="963.243132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:01:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:01:55.131609095 +0000 UTC m=+817.812673537" watchObservedRunningTime="2026-07-27 16:01:55.132120969 +0000 UTC m=+817.813185403"
Jul 27 16:02:03.606145 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:03.606110    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:02:03.606692 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:03.606186    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:02:03.618544 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:03.618518    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:02:04.167874 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:04.167839    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kn9fw"
Jul 27 16:02:14.900266 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:14.900232    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"]
Jul 27 16:02:14.903850 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:14.903828    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:14.906081 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:14.906050    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 27 16:02:14.913269 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:14.913245    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"]
Jul 27 16:02:14.992893 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:14.992854    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:14.993087 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:14.992916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:14.993087 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:14.992963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:14.993087 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:14.993000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt5t2\" (UniqueName: \"kubernetes.io/projected/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-kube-api-access-gt5t2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:14.993087 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:14.993065    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:14.993253 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:14.993106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.093838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.093808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.094048 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.093861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.094048 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.093899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.094048 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.093940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt5t2\" (UniqueName: \"kubernetes.io/projected/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-kube-api-access-gt5t2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.094048 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.093976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.094048 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.094011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.094302 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.094268    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.094302 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.094284    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.094741 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.094320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.096121 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.096101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.096395 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.096377    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.102682 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.102660    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt5t2\" (UniqueName: \"kubernetes.io/projected/d6fdd852-1e8d-42ef-8e92-68bfb5035a66-kube-api-access-gt5t2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-zncpq\" (UID: \"d6fdd852-1e8d-42ef-8e92-68bfb5035a66\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.215369 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.215286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:15.354226 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:15.354201    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"]
Jul 27 16:02:15.356190 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:02:15.356163    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6fdd852_1e8d_42ef_8e92_68bfb5035a66.slice/crio-8a6092d9bd86422e86bf13be051c654cd2085fb14d5db9a9a6024a14d7428d56 WatchSource:0}: Error finding container 8a6092d9bd86422e86bf13be051c654cd2085fb14d5db9a9a6024a14d7428d56: Status 404 returned error can't find the container with id 8a6092d9bd86422e86bf13be051c654cd2085fb14d5db9a9a6024a14d7428d56
Jul 27 16:02:16.224052 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:16.224013    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq" event={"ID":"d6fdd852-1e8d-42ef-8e92-68bfb5035a66","Type":"ContainerStarted","Data":"19faa2d70cb7214a79a3b757ca5d4281de7cd6d0bd5e943dbd3fd5721b7de2b9"}
Jul 27 16:02:16.224447 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:16.224080    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq" event={"ID":"d6fdd852-1e8d-42ef-8e92-68bfb5035a66","Type":"ContainerStarted","Data":"8a6092d9bd86422e86bf13be051c654cd2085fb14d5db9a9a6024a14d7428d56"}
Jul 27 16:02:16.246794 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:16.246741    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq" podStartSLOduration=1.902918865 podStartE2EDuration="2.246725245s" totalImagesPullingTime="343.80638ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:02:16.245005867 +0000 UTC m=+838.926070297" watchObservedRunningTime="2026-07-27 16:02:16.246725245 +0000 UTC m=+838.927789675"
Jul 27 16:02:25.215394 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:25.215350    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:25.215898 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:25.215429    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:25.228004 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:25.227976    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:02:25.280996 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:02:25.280966    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-zncpq"
Jul 27 16:04:39.034319 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.034263    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-4sm95"]
Jul 27 16:04:39.035050 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.034543    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bf786f7f9-4sm95" podUID="654a51dd-8fa9-4703-8167-98e759af1e29" containerName="manager" containerID="cri-o://c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287" gracePeriod=30
Jul 27 16:04:39.284051 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.284023    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:04:39.369062 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.368953    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/654a51dd-8fa9-4703-8167-98e759af1e29-webhook-cert\") pod \"654a51dd-8fa9-4703-8167-98e759af1e29\" (UID: \"654a51dd-8fa9-4703-8167-98e759af1e29\") "
Jul 27 16:04:39.369062 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.369059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf9kb\" (UniqueName: \"kubernetes.io/projected/654a51dd-8fa9-4703-8167-98e759af1e29-kube-api-access-zf9kb\") pod \"654a51dd-8fa9-4703-8167-98e759af1e29\" (UID: \"654a51dd-8fa9-4703-8167-98e759af1e29\") "
Jul 27 16:04:39.371083 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.371052    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/654a51dd-8fa9-4703-8167-98e759af1e29-kube-api-access-zf9kb" (OuterVolumeSpecName: "kube-api-access-zf9kb") pod "654a51dd-8fa9-4703-8167-98e759af1e29" (UID: "654a51dd-8fa9-4703-8167-98e759af1e29"). InnerVolumeSpecName "kube-api-access-zf9kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:04:39.371178 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.371111    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/654a51dd-8fa9-4703-8167-98e759af1e29-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "654a51dd-8fa9-4703-8167-98e759af1e29" (UID: "654a51dd-8fa9-4703-8167-98e759af1e29"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 16:04:39.469879 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.469849    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf9kb\" (UniqueName: \"kubernetes.io/projected/654a51dd-8fa9-4703-8167-98e759af1e29-kube-api-access-zf9kb\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:04:39.469879 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.469876    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/654a51dd-8fa9-4703-8167-98e759af1e29-webhook-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:04:39.952673 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.952640    2579 generic.go:356] "Generic (PLEG): container finished" podID="654a51dd-8fa9-4703-8167-98e759af1e29" containerID="c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287" exitCode=0
Jul 27 16:04:39.952673 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.952672    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bf786f7f9-4sm95"
Jul 27 16:04:39.952847 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.952714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf786f7f9-4sm95" event={"ID":"654a51dd-8fa9-4703-8167-98e759af1e29","Type":"ContainerDied","Data":"c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287"}
Jul 27 16:04:39.952847 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.952763    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bf786f7f9-4sm95" event={"ID":"654a51dd-8fa9-4703-8167-98e759af1e29","Type":"ContainerDied","Data":"7520d435a8d70df2ac4a190cf12cdd94bc86fde191564de3ce654ef4f16a2db2"}
Jul 27 16:04:39.952847 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.952784    2579 scope.go:117] "RemoveContainer" containerID="c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287"
Jul 27 16:04:39.961599 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.961580    2579 scope.go:117] "RemoveContainer" containerID="c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287"
Jul 27 16:04:39.961856 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:04:39.961832    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287\": container with ID starting with c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287 not found: ID does not exist" containerID="c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287"
Jul 27 16:04:39.961947 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.961865    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287"} err="failed to get container status \"c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287\": rpc error: code = NotFound desc = could not find container \"c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287\": container with ID starting with c44ee872e1f2d1d3c6836bf48beb620663c87595287b494ff2e01c6547038287 not found: ID does not exist"
Jul 27 16:04:39.965296 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:04:39.965277    2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654a51dd_8fa9_4703_8167_98e759af1e29.slice\": RecentStats: unable to find data in memory cache]"
Jul 27 16:04:39.970682 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.970661    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-4sm95"]
Jul 27 16:04:39.975121 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:39.975102    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bf786f7f9-4sm95"]
Jul 27 16:04:41.930812 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:04:41.930776    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="654a51dd-8fa9-4703-8167-98e759af1e29" path="/var/lib/kubelet/pods/654a51dd-8fa9-4703-8167-98e759af1e29/volumes"
Jul 27 16:15:00.141696 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:00.141660    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29752815-krd9j"]
Jul 27 16:15:00.142116 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:00.141992    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="654a51dd-8fa9-4703-8167-98e759af1e29" containerName="manager"
Jul 27 16:15:00.142116 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:00.142002    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="654a51dd-8fa9-4703-8167-98e759af1e29" containerName="manager"
Jul 27 16:15:00.142116 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:00.142070    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="654a51dd-8fa9-4703-8167-98e759af1e29" containerName="manager"
Jul 27 16:15:00.144922 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:00.144905    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752815-krd9j"
Jul 27 16:15:00.147354 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:00.147328    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wqs6d\""
Jul 27 16:15:00.153238 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:00.152640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29752815-krd9j"]
Jul 27 16:15:00.156762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:00.156738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752815-krd9j"
Jul 27 16:15:00.289236 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:00.289210    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29752815-krd9j"]
Jul 27 16:15:00.290950 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:15:00.290916    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586856e2_5cf4_4f76_8469_cc03eb47c02f.slice/crio-07bb83a57635bb3cc9c05c3b795d2284795e7fda5b708ce1deb7d14bfecad266 WatchSource:0}: Error finding container 07bb83a57635bb3cc9c05c3b795d2284795e7fda5b708ce1deb7d14bfecad266: Status 404 returned error can't find the container with id 07bb83a57635bb3cc9c05c3b795d2284795e7fda5b708ce1deb7d14bfecad266
Jul 27 16:15:00.292881 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:00.292865    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 16:15:01.069840 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:01.069805    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752815-krd9j" event={"ID":"586856e2-5cf4-4f76-8469-cc03eb47c02f","Type":"ContainerStarted","Data":"07bb83a57635bb3cc9c05c3b795d2284795e7fda5b708ce1deb7d14bfecad266"}
Jul 27 16:15:02.193456 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.193418    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"]
Jul 27 16:15:02.199824 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.199799    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.202391 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.202368    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-80d812c7-kserve-self-signed-certs\""
Jul 27 16:15:02.208931 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.208905    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"]
Jul 27 16:15:02.316624 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.316585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-home\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.316807 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.316647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-kube-api-access-wcnvg\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.316807 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.316702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tls-certs\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.316807 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.316745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-dshm\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.316807 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.316784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-model-cache\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.317035 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.316834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tmp-dir\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.417646 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.417610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-home\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.417836 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.417670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-kube-api-access-wcnvg\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.417836 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.417724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tls-certs\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.417836 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.417771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-dshm\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.417836 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.417809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-model-cache\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.417836 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.417829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tmp-dir\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.418113 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.418037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-home\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.418207 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.418166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tmp-dir\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.418268 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.418223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-model-cache\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.420108 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.420069    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-dshm\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.420452 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.420433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tls-certs\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.427202 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.427182    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-kube-api-access-wcnvg\") pod \"e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") " pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.511463 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.511387    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:02.857865 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:02.857844    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"]
Jul 27 16:15:02.859482 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:15:02.859456    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2ab96ab_d7db_4a03_8a7b_9d593242a0a9.slice/crio-06dc02ab7fcd2d99846822674bbf0f5180aaf68804822b39de2128a3851b500c WatchSource:0}: Error finding container 06dc02ab7fcd2d99846822674bbf0f5180aaf68804822b39de2128a3851b500c: Status 404 returned error can't find the container with id 06dc02ab7fcd2d99846822674bbf0f5180aaf68804822b39de2128a3851b500c
Jul 27 16:15:03.082181 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:03.082152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5" event={"ID":"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9","Type":"ContainerStarted","Data":"1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64"}
Jul 27 16:15:03.082261 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:03.082197    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5" event={"ID":"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9","Type":"ContainerStarted","Data":"06dc02ab7fcd2d99846822674bbf0f5180aaf68804822b39de2128a3851b500c"}
Jul 27 16:15:03.098697 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:03.098660    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5" podStartSLOduration=1.098646241 podStartE2EDuration="1.098646241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:15:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:15:03.097558138 +0000 UTC m=+1605.778622568" watchObservedRunningTime="2026-07-27 16:15:03.098646241 +0000 UTC m=+1605.779710730"
Jul 27 16:15:04.087995 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:04.087963    2579 generic.go:356] "Generic (PLEG): container finished" podID="586856e2-5cf4-4f76-8469-cc03eb47c02f" containerID="ba64f69f9405100bb47da929f68577e59b8f6bb646630569d8b6b1bef500965c" exitCode=0
Jul 27 16:15:04.088340 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:04.088038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752815-krd9j" event={"ID":"586856e2-5cf4-4f76-8469-cc03eb47c02f","Type":"ContainerDied","Data":"ba64f69f9405100bb47da929f68577e59b8f6bb646630569d8b6b1bef500965c"}
Jul 27 16:15:05.220490 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:05.220465    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752815-krd9j"
Jul 27 16:15:06.101880 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:06.101853    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752815-krd9j"
Jul 27 16:15:06.102030 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:06.101854    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29752815-krd9j" event={"ID":"586856e2-5cf4-4f76-8469-cc03eb47c02f","Type":"ContainerDied","Data":"07bb83a57635bb3cc9c05c3b795d2284795e7fda5b708ce1deb7d14bfecad266"}
Jul 27 16:15:06.102030 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:06.101973    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="07bb83a57635bb3cc9c05c3b795d2284795e7fda5b708ce1deb7d14bfecad266"
Jul 27 16:15:12.511635 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:12.511528    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:12.511635 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:12.511595    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:12.523678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:12.523649    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:13.148730 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:13.148698    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:35.002571 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:35.002531    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"]
Jul 27 16:15:50.022056 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.021976    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5" podUID="b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" containerName="main" containerID="cri-o://1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64" gracePeriod=45
Jul 27 16:15:50.282813 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.282788    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:50.329874 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.329839    2579 generic.go:356] "Generic (PLEG): container finished" podID="b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" containerID="1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64" exitCode=0
Jul 27 16:15:50.330043 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.329883    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"
Jul 27 16:15:50.330043 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.329891    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5" event={"ID":"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9","Type":"ContainerDied","Data":"1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64"}
Jul 27 16:15:50.330043 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.329929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5" event={"ID":"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9","Type":"ContainerDied","Data":"06dc02ab7fcd2d99846822674bbf0f5180aaf68804822b39de2128a3851b500c"}
Jul 27 16:15:50.330043 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.329947    2579 scope.go:117] "RemoveContainer" containerID="1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64"
Jul 27 16:15:50.338309 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.338291    2579 scope.go:117] "RemoveContainer" containerID="1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64"
Jul 27 16:15:50.338598 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:15:50.338575    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64\": container with ID starting with 1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64 not found: ID does not exist" containerID="1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64"
Jul 27 16:15:50.338675 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.338608    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64"} err="failed to get container status \"1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64\": rpc error: code = NotFound desc = could not find container \"1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64\": container with ID starting with 1a04799f549b960a9f6e495c3b6cc6c8e178909822a2e8caff8d4813db8dab64 not found: ID does not exist"
Jul 27 16:15:50.414723 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.414686    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-dshm\") pod \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") "
Jul 27 16:15:50.414723 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.414726    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-model-cache\") pod \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") "
Jul 27 16:15:50.414967 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.414758    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tls-certs\") pod \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") "
Jul 27 16:15:50.414967 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.414784    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tmp-dir\") pod \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") "
Jul 27 16:15:50.414967 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.414840    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-home\") pod \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") "
Jul 27 16:15:50.414967 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.414867    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-kube-api-access-wcnvg\") pod \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\" (UID: \"b2ab96ab-d7db-4a03-8a7b-9d593242a0a9\") "
Jul 27 16:15:50.415171 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.415028    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-model-cache" (OuterVolumeSpecName: "model-cache") pod "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" (UID: "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:15:50.415171 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.415108    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" (UID: "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:15:50.415171 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.415122    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-home" (OuterVolumeSpecName: "home") pod "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" (UID: "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:15:50.415277 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.415170    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-model-cache\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:15:50.417054 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.417017    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-kube-api-access-wcnvg" (OuterVolumeSpecName: "kube-api-access-wcnvg") pod "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" (UID: "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9"). InnerVolumeSpecName "kube-api-access-wcnvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:15:50.417054 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.417036    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" (UID: "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 16:15:50.417240 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.417084    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-dshm" (OuterVolumeSpecName: "dshm") pod "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" (UID: "b2ab96ab-d7db-4a03-8a7b-9d593242a0a9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:15:50.515953 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.515914    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-dshm\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:15:50.515953 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.515944    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tls-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:15:50.516156 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.515973    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-tmp-dir\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:15:50.516156 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.515982    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-home\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:15:50.516156 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.515991    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcnvg\" (UniqueName: \"kubernetes.io/projected/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9-kube-api-access-wcnvg\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:15:50.653795 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.653764    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"]
Jul 27 16:15:50.655748 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:50.655722    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-80d812c7-kserve-7c8f45b975-6w7h5"]
Jul 27 16:15:51.930509 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:15:51.930465    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" path="/var/lib/kubelet/pods/b2ab96ab-d7db-4a03-8a7b-9d593242a0a9/volumes"
Jul 27 16:19:14.368278 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.368242    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"]
Jul 27 16:19:14.368762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.368603    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586856e2-5cf4-4f76-8469-cc03eb47c02f" containerName="cleanup"
Jul 27 16:19:14.368762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.368614    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="586856e2-5cf4-4f76-8469-cc03eb47c02f" containerName="cleanup"
Jul 27 16:19:14.368762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.368638    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" containerName="main"
Jul 27 16:19:14.368762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.368645    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" containerName="main"
Jul 27 16:19:14.368762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.368692    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="586856e2-5cf4-4f76-8469-cc03eb47c02f" containerName="cleanup"
Jul 27 16:19:14.368762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.368701    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2ab96ab-d7db-4a03-8a7b-9d593242a0a9" containerName="main"
Jul 27 16:19:14.371802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.371780    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.374386 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.374365    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9ab13729-openshift-default-dockercfg-sskn2\""
Jul 27 16:19:14.403100 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.403072    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"]
Jul 27 16:19:14.510872 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.510824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-envoy\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.511053 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.510885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istiod-ca-cert\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.511053 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.510963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-podinfo\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.511053 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.511006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-credential-socket\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.511053 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.511033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-data\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.511196 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.511096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-token\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.511196 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.511143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-certs\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.511196 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.511163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krj62\" (UniqueName: \"kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-kube-api-access-krj62\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.511291 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.511205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-socket\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.612662 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.612612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-token\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.612662 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.612673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-certs\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.612887 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.612780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krj62\" (UniqueName: \"kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-kube-api-access-krj62\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.612887 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.612825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-socket\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.612887 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.612851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-envoy\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.613062 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.612889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istiod-ca-cert\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.613062 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.612921    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-podinfo\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.613062 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.612951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-credential-socket\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.613062 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.612985    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-data\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.613287 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.613147    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-certs\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.613287 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.613179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-socket\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.613374 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.613346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-credential-socket\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.613409 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.613399    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-data\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.613712 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.613692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istiod-ca-cert\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.615191 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.615160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-envoy\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.615329 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.615310    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-podinfo\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.621927 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.621864    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-token\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.624392 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.624371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krj62\" (UniqueName: \"kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-kube-api-access-krj62\") pod \"e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") " pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.681633 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.681596    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:14.821281 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.821251    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"]
Jul 27 16:19:14.823067 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:19:14.823036    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d65a503_51fb_4118_b6e8_ed75cbd5ddf5.slice/crio-72d10439209e2a3bfe801a8cb4ca24e524e03525c1729ae6d2bb7bd041075532 WatchSource:0}: Error finding container 72d10439209e2a3bfe801a8cb4ca24e524e03525c1729ae6d2bb7bd041075532: Status 404 returned error can't find the container with id 72d10439209e2a3bfe801a8cb4ca24e524e03525c1729ae6d2bb7bd041075532
Jul 27 16:19:14.825411 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.825379    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:19:14.825540 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.825456    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:19:14.825617 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:14.825557    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:19:15.400392 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:15.400353    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" event={"ID":"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5","Type":"ContainerStarted","Data":"a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f"}
Jul 27 16:19:15.400833 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:15.400431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" event={"ID":"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5","Type":"ContainerStarted","Data":"72d10439209e2a3bfe801a8cb4ca24e524e03525c1729ae6d2bb7bd041075532"}
Jul 27 16:19:15.422348 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:15.422278    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" podStartSLOduration=1.4222614550000001 podStartE2EDuration="1.422261455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:19:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:19:15.421577712 +0000 UTC m=+1858.102642143" watchObservedRunningTime="2026-07-27 16:19:15.422261455 +0000 UTC m=+1858.103325886"
Jul 27 16:19:15.682563 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:15.682455    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:15.687512 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:15.687468    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:16.406047 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:16.406015    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:16.406968 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:16.406946    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:17.614863 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.614825    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"]
Jul 27 16:19:17.618251 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.618230    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"]
Jul 27 16:19:17.618377 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.618341    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:17.620415 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.620390    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9ab13729\""
Jul 27 16:19:17.620562 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.620437    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9ab13729-dockercfg-mxk6r\""
Jul 27 16:19:17.621651 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.621633    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:17.628639 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.628613    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"]
Jul 27 16:19:17.631686 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.631663    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"]
Jul 27 16:19:17.742593 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.742562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqjxt\" (UniqueName: \"kubernetes.io/projected/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-kube-api-access-zqjxt\") pod \"payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28\" (UID: \"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:17.742762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.742687    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a79e06c-8cba-447b-a434-2fd176a83ba1-plugins-config-volume\") pod \"payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8\" (UID: \"7a79e06c-8cba-447b-a434-2fd176a83ba1\") " pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:17.742762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.742712    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28\" (UID: \"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:17.742762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.742731    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm46b\" (UniqueName: \"kubernetes.io/projected/7a79e06c-8cba-447b-a434-2fd176a83ba1-kube-api-access-hm46b\") pod \"payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8\" (UID: \"7a79e06c-8cba-447b-a434-2fd176a83ba1\") " pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:17.844048 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.844001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqjxt\" (UniqueName: \"kubernetes.io/projected/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-kube-api-access-zqjxt\") pod \"payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28\" (UID: \"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:17.844234 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.844093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a79e06c-8cba-447b-a434-2fd176a83ba1-plugins-config-volume\") pod \"payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8\" (UID: \"7a79e06c-8cba-447b-a434-2fd176a83ba1\") " pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:17.844234 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.844114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28\" (UID: \"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:17.844234 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.844130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm46b\" (UniqueName: \"kubernetes.io/projected/7a79e06c-8cba-447b-a434-2fd176a83ba1-kube-api-access-hm46b\") pod \"payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8\" (UID: \"7a79e06c-8cba-447b-a434-2fd176a83ba1\") " pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:17.847321 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.847288    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9ab13729\""
Jul 27 16:19:17.855089 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.855060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a79e06c-8cba-447b-a434-2fd176a83ba1-plugins-config-volume\") pod \"payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8\" (UID: \"7a79e06c-8cba-447b-a434-2fd176a83ba1\") " pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:17.855203 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.855060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28\" (UID: \"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:17.856549 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.856519    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqjxt\" (UniqueName: \"kubernetes.io/projected/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-kube-api-access-zqjxt\") pod \"payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28\" (UID: \"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:17.856549 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.856531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm46b\" (UniqueName: \"kubernetes.io/projected/7a79e06c-8cba-447b-a434-2fd176a83ba1-kube-api-access-hm46b\") pod \"payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8\" (UID: \"7a79e06c-8cba-447b-a434-2fd176a83ba1\") " pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:17.933298 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.933226    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9ab13729-dockercfg-mxk6r\""
Jul 27 16:19:17.937891 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.937868    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:17.941628 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:17.941609    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:18.086851 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:18.086824    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"]
Jul 27 16:19:18.088262 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:19:18.088234    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a79e06c_8cba_447b_a434_2fd176a83ba1.slice/crio-d2f95a02d3720b133ca5436cf874c5eeb6b6c3523ebd84d883ea39a698ec1073 WatchSource:0}: Error finding container d2f95a02d3720b133ca5436cf874c5eeb6b6c3523ebd84d883ea39a698ec1073: Status 404 returned error can't find the container with id d2f95a02d3720b133ca5436cf874c5eeb6b6c3523ebd84d883ea39a698ec1073
Jul 27 16:19:18.313568 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:18.313536    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"]
Jul 27 16:19:18.316620 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:19:18.316589    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49274f8d_b1b4_43b0_9f3f_6bfd8c477a83.slice/crio-b962a847e78cc88982c33cce2def89107b825aa060fc8a878ce29cd1c3a30c18 WatchSource:0}: Error finding container b962a847e78cc88982c33cce2def89107b825aa060fc8a878ce29cd1c3a30c18: Status 404 returned error can't find the container with id b962a847e78cc88982c33cce2def89107b825aa060fc8a878ce29cd1c3a30c18
Jul 27 16:19:18.417842 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:18.417802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28" event={"ID":"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83","Type":"ContainerStarted","Data":"6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3"}
Jul 27 16:19:18.417985 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:18.417867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28" event={"ID":"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83","Type":"ContainerStarted","Data":"b962a847e78cc88982c33cce2def89107b825aa060fc8a878ce29cd1c3a30c18"}
Jul 27 16:19:18.417985 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:18.417899    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:18.419413 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:18.419392    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8" event={"ID":"7a79e06c-8cba-447b-a434-2fd176a83ba1","Type":"ContainerStarted","Data":"f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96"}
Jul 27 16:19:18.419528 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:18.419425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8" event={"ID":"7a79e06c-8cba-447b-a434-2fd176a83ba1","Type":"ContainerStarted","Data":"d2f95a02d3720b133ca5436cf874c5eeb6b6c3523ebd84d883ea39a698ec1073"}
Jul 27 16:19:18.419601 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:18.419584    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:18.439231 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:18.439184    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28" podStartSLOduration=1.4391696139999999 podStartE2EDuration="1.439169614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:19:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:19:18.43692212 +0000 UTC m=+1861.117986587" watchObservedRunningTime="2026-07-27 16:19:18.439169614 +0000 UTC m=+1861.120234371"
Jul 27 16:19:18.459526 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:18.457607    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8" podStartSLOduration=1.457586648 podStartE2EDuration="1.457586648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:19:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:19:18.45466545 +0000 UTC m=+1861.135729880" watchObservedRunningTime="2026-07-27 16:19:18.457586648 +0000 UTC m=+1861.138651081"
Jul 27 16:19:29.430692 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:29.430654    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:29.431123 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:29.430888    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:32.235805 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:32.235761    2579 patch_prober.go:28] interesting pod/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:47508->10.132.0.46:15021: read: connection reset by peer" start-of-body=
Jul 27 16:19:32.236194 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:32.235844    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:47508->10.132.0.46:15021: read: connection reset by peer"
Jul 27 16:19:32.501737 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:32.501640    2579 generic.go:356] "Generic (PLEG): container finished" podID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerID="a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f" exitCode=0
Jul 27 16:19:32.501737 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:32.501717    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" event={"ID":"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5","Type":"ContainerDied","Data":"a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f"}
Jul 27 16:19:32.502151 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:32.502135    2579 scope.go:117] "RemoveContainer" containerID="a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f"
Jul 27 16:19:32.503058 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:32.503035    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:19:32.503123 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:32.503111    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:19:32.503160 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:32.503145    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:19:33.509414 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:33.509381    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" event={"ID":"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5","Type":"ContainerStarted","Data":"3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc"}
Jul 27 16:19:33.681909 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:33.681867    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:33.682161 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:33.682136    2579 patch_prober.go:28] interesting pod/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 27 16:19:33.682225 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:33.682187    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 27 16:19:34.682273 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:34.682237    2579 patch_prober.go:28] interesting pod/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 27 16:19:34.682678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:34.682301    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 27 16:19:35.682092 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:35.682063    2579 patch_prober.go:28] interesting pod/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 27 16:19:35.682263 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:35.682111    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 27 16:19:36.682167 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:36.682126    2579 patch_prober.go:28] interesting pod/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Jul 27 16:19:36.682680 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:36.682185    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Jul 27 16:19:37.686036 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:37.686005    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:37.686482 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:37.686337    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:37.686916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:37.686899    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:19:52.943488 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:52.943448    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"]
Jul 27 16:19:52.944110 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:52.943710    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8" podUID="7a79e06c-8cba-447b-a434-2fd176a83ba1" containerName="payload-processing" containerID="cri-o://f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96" gracePeriod=30
Jul 27 16:19:52.951645 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:52.951616    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"]
Jul 27 16:19:52.951865 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:52.951820    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28" podUID="49274f8d-b1b4-43b0-9f3f-6bfd8c477a83" containerName="payload-pre-processing" containerID="cri-o://6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3" gracePeriod=30
Jul 27 16:19:53.213718 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.213694    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:53.238116 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.238092    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:53.360053 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.360023    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-plugins-config-volume\") pod \"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83\" (UID: \"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83\") "
Jul 27 16:19:53.360237 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.360081    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm46b\" (UniqueName: \"kubernetes.io/projected/7a79e06c-8cba-447b-a434-2fd176a83ba1-kube-api-access-hm46b\") pod \"7a79e06c-8cba-447b-a434-2fd176a83ba1\" (UID: \"7a79e06c-8cba-447b-a434-2fd176a83ba1\") "
Jul 27 16:19:53.360237 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.360118    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqjxt\" (UniqueName: \"kubernetes.io/projected/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-kube-api-access-zqjxt\") pod \"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83\" (UID: \"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83\") "
Jul 27 16:19:53.360237 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.360141    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a79e06c-8cba-447b-a434-2fd176a83ba1-plugins-config-volume\") pod \"7a79e06c-8cba-447b-a434-2fd176a83ba1\" (UID: \"7a79e06c-8cba-447b-a434-2fd176a83ba1\") "
Jul 27 16:19:53.360538 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.360509    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49274f8d-b1b4-43b0-9f3f-6bfd8c477a83" (UID: "49274f8d-b1b4-43b0-9f3f-6bfd8c477a83"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:19:53.360661 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.360576    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a79e06c-8cba-447b-a434-2fd176a83ba1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7a79e06c-8cba-447b-a434-2fd176a83ba1" (UID: "7a79e06c-8cba-447b-a434-2fd176a83ba1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:19:53.362302 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.362280    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-kube-api-access-zqjxt" (OuterVolumeSpecName: "kube-api-access-zqjxt") pod "49274f8d-b1b4-43b0-9f3f-6bfd8c477a83" (UID: "49274f8d-b1b4-43b0-9f3f-6bfd8c477a83"). InnerVolumeSpecName "kube-api-access-zqjxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:19:53.362399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.362312    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a79e06c-8cba-447b-a434-2fd176a83ba1-kube-api-access-hm46b" (OuterVolumeSpecName: "kube-api-access-hm46b") pod "7a79e06c-8cba-447b-a434-2fd176a83ba1" (UID: "7a79e06c-8cba-447b-a434-2fd176a83ba1"). InnerVolumeSpecName "kube-api-access-hm46b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:19:53.461721 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.461647    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:19:53.461721 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.461669    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm46b\" (UniqueName: \"kubernetes.io/projected/7a79e06c-8cba-447b-a434-2fd176a83ba1-kube-api-access-hm46b\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:19:53.461721 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.461677    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqjxt\" (UniqueName: \"kubernetes.io/projected/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83-kube-api-access-zqjxt\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:19:53.461721 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.461686    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7a79e06c-8cba-447b-a434-2fd176a83ba1-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:19:53.613235 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.613203    2579 generic.go:356] "Generic (PLEG): container finished" podID="49274f8d-b1b4-43b0-9f3f-6bfd8c477a83" containerID="6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3" exitCode=0
Jul 27 16:19:53.613395 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.613246    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"
Jul 27 16:19:53.613395 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.613288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28" event={"ID":"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83","Type":"ContainerDied","Data":"6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3"}
Jul 27 16:19:53.613395 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.613339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28" event={"ID":"49274f8d-b1b4-43b0-9f3f-6bfd8c477a83","Type":"ContainerDied","Data":"b962a847e78cc88982c33cce2def89107b825aa060fc8a878ce29cd1c3a30c18"}
Jul 27 16:19:53.613395 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.613366    2579 scope.go:117] "RemoveContainer" containerID="6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3"
Jul 27 16:19:53.614755 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.614721    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a79e06c-8cba-447b-a434-2fd176a83ba1" containerID="f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96" exitCode=0
Jul 27 16:19:53.614882 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.614749    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8" event={"ID":"7a79e06c-8cba-447b-a434-2fd176a83ba1","Type":"ContainerDied","Data":"f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96"}
Jul 27 16:19:53.614882 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.614767    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"
Jul 27 16:19:53.614882 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.614799    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8" event={"ID":"7a79e06c-8cba-447b-a434-2fd176a83ba1","Type":"ContainerDied","Data":"d2f95a02d3720b133ca5436cf874c5eeb6b6c3523ebd84d883ea39a698ec1073"}
Jul 27 16:19:53.622453 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.622438    2579 scope.go:117] "RemoveContainer" containerID="6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3"
Jul 27 16:19:53.622753 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:19:53.622730    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3\": container with ID starting with 6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3 not found: ID does not exist" containerID="6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3"
Jul 27 16:19:53.622839 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.622763    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3"} err="failed to get container status \"6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3\": rpc error: code = NotFound desc = could not find container \"6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3\": container with ID starting with 6c7285dd887a7a225f3990c41bf287a355e09fc67ff76f46df605de90e835de3 not found: ID does not exist"
Jul 27 16:19:53.622839 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.622780    2579 scope.go:117] "RemoveContainer" containerID="f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96"
Jul 27 16:19:53.631000 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.630985    2579 scope.go:117] "RemoveContainer" containerID="f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96"
Jul 27 16:19:53.631245 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:19:53.631225    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96\": container with ID starting with f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96 not found: ID does not exist" containerID="f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96"
Jul 27 16:19:53.631322 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.631251    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96"} err="failed to get container status \"f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96\": rpc error: code = NotFound desc = could not find container \"f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96\": container with ID starting with f31cba23e49e64dc01462bb8c4214c7473f507f046b702f39384c1b4e12fcc96 not found: ID does not exist"
Jul 27 16:19:53.640369 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.640348    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"]
Jul 27 16:19:53.643948 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.643925    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9ab13729-76f6fc4696-v5j28"]
Jul 27 16:19:53.654283 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.654264    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"]
Jul 27 16:19:53.658821 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.658803    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9ab13729-5c895b5688-4h6b8"]
Jul 27 16:19:53.930971 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.930940    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49274f8d-b1b4-43b0-9f3f-6bfd8c477a83" path="/var/lib/kubelet/pods/49274f8d-b1b4-43b0-9f3f-6bfd8c477a83/volumes"
Jul 27 16:19:53.931286 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:53.931273    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a79e06c-8cba-447b-a434-2fd176a83ba1" path="/var/lib/kubelet/pods/7a79e06c-8cba-447b-a434-2fd176a83ba1/volumes"
Jul 27 16:19:57.565615 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:57.565585    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"]
Jul 27 16:19:57.566054 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:57.565812    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy" containerID="cri-o://3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc" gracePeriod=30
Jul 27 16:19:58.647202 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.647170    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"]
Jul 27 16:19:58.647587 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.647521    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a79e06c-8cba-447b-a434-2fd176a83ba1" containerName="payload-processing"
Jul 27 16:19:58.647587 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.647534    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a79e06c-8cba-447b-a434-2fd176a83ba1" containerName="payload-processing"
Jul 27 16:19:58.647587 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.647546    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49274f8d-b1b4-43b0-9f3f-6bfd8c477a83" containerName="payload-pre-processing"
Jul 27 16:19:58.647587 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.647551    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="49274f8d-b1b4-43b0-9f3f-6bfd8c477a83" containerName="payload-pre-processing"
Jul 27 16:19:58.647724 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.647616    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a79e06c-8cba-447b-a434-2fd176a83ba1" containerName="payload-processing"
Jul 27 16:19:58.647724 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.647624    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="49274f8d-b1b4-43b0-9f3f-6bfd8c477a83" containerName="payload-pre-processing"
Jul 27 16:19:58.651374 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.651358    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.653827 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.653804    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-ed0533f9-gw-openshift-default-dockercfg-qvldr\""
Jul 27 16:19:58.667583 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.667551    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"]
Jul 27 16:19:58.799815 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.799777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-socket\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.799981 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.799825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff17605-0a30-4677-b7b5-0a0b32413a45-istiod-ca-cert\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.799981 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.799846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-envoy\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.800059 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.799972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-podinfo\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.800059 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.800010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-data\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.800059 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.800030    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f6lg\" (UniqueName: \"kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-kube-api-access-6f6lg\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.800155 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.800068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-certs\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.800155 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.800087    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-credential-socket\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.800155 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.800102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-token\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.901524 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-socket\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.901524 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff17605-0a30-4677-b7b5-0a0b32413a45-istiod-ca-cert\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.901524 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-envoy\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.901802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-podinfo\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.901802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-data\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.901802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f6lg\" (UniqueName: \"kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-kube-api-access-6f6lg\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.901802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-certs\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.901802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-credential-socket\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.901802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-token\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.902108 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-socket\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.902108 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901904    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-data\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.902108 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.901997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-credential-socket\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.902108 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.902038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-certs\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.902329 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.902314    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff17605-0a30-4677-b7b5-0a0b32413a45-istiod-ca-cert\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.903947 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.903921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-envoy\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.904087 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.904069    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-podinfo\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.916660 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.916636    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f6lg\" (UniqueName: \"kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-kube-api-access-6f6lg\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.917056 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.917037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-token\") pod \"e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") " pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:58.960559 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:58.960536    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:19:59.104083 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:59.104051    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"]
Jul 27 16:19:59.105448 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:19:59.105422    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff17605_0a30_4677_b7b5_0a0b32413a45.slice/crio-00ef8a34ca3fc74d14e68ab8b3b77c965a515c8bb9a5054bd1921ff393352487 WatchSource:0}: Error finding container 00ef8a34ca3fc74d14e68ab8b3b77c965a515c8bb9a5054bd1921ff393352487: Status 404 returned error can't find the container with id 00ef8a34ca3fc74d14e68ab8b3b77c965a515c8bb9a5054bd1921ff393352487
Jul 27 16:19:59.107539 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:59.107505    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:19:59.107618 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:59.107571    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:19:59.107618 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:59.107604    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:19:59.650368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:59.650339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" event={"ID":"aff17605-0a30-4677-b7b5-0a0b32413a45","Type":"ContainerStarted","Data":"949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2"}
Jul 27 16:19:59.650745 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:59.650389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" event={"ID":"aff17605-0a30-4677-b7b5-0a0b32413a45","Type":"ContainerStarted","Data":"00ef8a34ca3fc74d14e68ab8b3b77c965a515c8bb9a5054bd1921ff393352487"}
Jul 27 16:19:59.672643 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:59.672596    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" podStartSLOduration=1.6725832299999999 podStartE2EDuration="1.67258323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:19:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:19:59.672143978 +0000 UTC m=+1902.353208408" watchObservedRunningTime="2026-07-27 16:19:59.67258323 +0000 UTC m=+1902.353647659"
Jul 27 16:19:59.961210 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:19:59.961137    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:20:00.965794 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:00.965762    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:20:01.661973 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:01.661946    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:20:01.662929 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:01.662909    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:20:01.944240 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:01.944165    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"]
Jul 27 16:20:01.947305 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:01.947288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:01.949472 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:01.949448    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-ed0533f9\""
Jul 27 16:20:01.949628 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:01.949549    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-ed0533f9-dockercfg-w5f99\""
Jul 27 16:20:01.962235 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:01.962209    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"]
Jul 27 16:20:02.010361 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.010330    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"]
Jul 27 16:20:02.013596 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.013578    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:02.024145 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.024123    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"]
Jul 27 16:20:02.029639 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.029616    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pplcm\" (UniqueName: \"kubernetes.io/projected/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-kube-api-access-pplcm\") pod \"payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j\" (UID: \"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7\") " pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:02.029775 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.029649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-plugins-config-volume\") pod \"payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j\" (UID: \"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7\") " pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:02.130272 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.130231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4a02dd4-f759-42f5-a99d-6c8f409c075b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh\" (UID: \"c4a02dd4-f759-42f5-a99d-6c8f409c075b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:02.130440 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.130291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pplcm\" (UniqueName: \"kubernetes.io/projected/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-kube-api-access-pplcm\") pod \"payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j\" (UID: \"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7\") " pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:02.130440 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.130347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-plugins-config-volume\") pod \"payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j\" (UID: \"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7\") " pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:02.130440 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.130424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j759w\" (UniqueName: \"kubernetes.io/projected/c4a02dd4-f759-42f5-a99d-6c8f409c075b-kube-api-access-j759w\") pod \"payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh\" (UID: \"c4a02dd4-f759-42f5-a99d-6c8f409c075b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:02.131086 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.131064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-plugins-config-volume\") pod \"payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j\" (UID: \"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7\") " pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:02.142229 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.142198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pplcm\" (UniqueName: \"kubernetes.io/projected/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-kube-api-access-pplcm\") pod \"payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j\" (UID: \"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7\") " pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:02.231817 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.231723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j759w\" (UniqueName: \"kubernetes.io/projected/c4a02dd4-f759-42f5-a99d-6c8f409c075b-kube-api-access-j759w\") pod \"payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh\" (UID: \"c4a02dd4-f759-42f5-a99d-6c8f409c075b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:02.231817 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.231796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4a02dd4-f759-42f5-a99d-6c8f409c075b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh\" (UID: \"c4a02dd4-f759-42f5-a99d-6c8f409c075b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:02.232475 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.232454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4a02dd4-f759-42f5-a99d-6c8f409c075b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh\" (UID: \"c4a02dd4-f759-42f5-a99d-6c8f409c075b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:02.240681 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.240656    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j759w\" (UniqueName: \"kubernetes.io/projected/c4a02dd4-f759-42f5-a99d-6c8f409c075b-kube-api-access-j759w\") pod \"payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh\" (UID: \"c4a02dd4-f759-42f5-a99d-6c8f409c075b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:02.259072 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.259046    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:02.324399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.324371    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:02.411636 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.411605    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"]
Jul 27 16:20:02.668710 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.668677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j" event={"ID":"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7","Type":"ContainerStarted","Data":"26ed5fde4047dcaf87cc3b43b3dd3207774d100d5f4791be03840d2d304a03c0"}
Jul 27 16:20:02.668843 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.668738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j" event={"ID":"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7","Type":"ContainerStarted","Data":"ddab614c33959f255d2af5bde41d8e420775109de0aeb3d49f35c05f286303ab"}
Jul 27 16:20:02.669038 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.669010    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:02.682575 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.682552    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"]
Jul 27 16:20:02.684866 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:20:02.684818    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a02dd4_f759_42f5_a99d_6c8f409c075b.slice/crio-2530a2fe561a7b0498c78aab44da3141e92aa999cf2650b61825f515915e2765 WatchSource:0}: Error finding container 2530a2fe561a7b0498c78aab44da3141e92aa999cf2650b61825f515915e2765: Status 404 returned error can't find the container with id 2530a2fe561a7b0498c78aab44da3141e92aa999cf2650b61825f515915e2765
Jul 27 16:20:02.686355 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.686319    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j" podStartSLOduration=1.686305817 podStartE2EDuration="1.686305817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:20:02.684546766 +0000 UTC m=+1905.365611193" watchObservedRunningTime="2026-07-27 16:20:02.686305817 +0000 UTC m=+1905.367370283"
Jul 27 16:20:02.813845 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.813818    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:20:02.939595 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.939561    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-podinfo\") pod \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") "
Jul 27 16:20:02.939767 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.939615    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-token\") pod \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") "
Jul 27 16:20:02.939767 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.939639    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-certs\") pod \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") "
Jul 27 16:20:02.939767 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.939660    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-socket\") pod \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") "
Jul 27 16:20:02.939767 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.939706    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istiod-ca-cert\") pod \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") "
Jul 27 16:20:02.940046 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.939768    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-data\") pod \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") "
Jul 27 16:20:02.940046 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.939794    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-credential-socket\") pod \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") "
Jul 27 16:20:02.940046 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.939924    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" (UID: "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:20:02.940046 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.939950    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" (UID: "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:20:02.940245 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.940068    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" (UID: "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:20:02.940245 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.940103    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krj62\" (UniqueName: \"kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-kube-api-access-krj62\") pod \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") "
Jul 27 16:20:02.940245 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.940148    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" (UID: "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:20:02.940245 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.940204    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-envoy\") pod \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\" (UID: \"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5\") "
Jul 27 16:20:02.940489 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.940464    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:02.940644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.940492    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:02.940644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.940536    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:02.940644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.940551    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:02.940805 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.940685    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" (UID: "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:20:02.941796 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.941770    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" (UID: "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:20:02.941897 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.941879    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" (UID: "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:20:02.941942 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.941898    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-kube-api-access-krj62" (OuterVolumeSpecName: "kube-api-access-krj62") pod "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" (UID: "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5"). InnerVolumeSpecName "kube-api-access-krj62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:20:02.942125 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:02.942109    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" (UID: "3d65a503-51fb-4118-b6e8-ed75cbd5ddf5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:20:03.041874 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.041847    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:03.042185 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.041876    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:03.042185 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.041890    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krj62\" (UniqueName: \"kubernetes.io/projected/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-kube-api-access-krj62\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:03.042185 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.041903    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:03.042185 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.041917    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:03.675458 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.675426    2579 generic.go:356] "Generic (PLEG): container finished" podID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerID="3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc" exitCode=0
Jul 27 16:20:03.675664 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.675475    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"
Jul 27 16:20:03.675664 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.675525    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" event={"ID":"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5","Type":"ContainerDied","Data":"3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc"}
Jul 27 16:20:03.675664 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.675573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp" event={"ID":"3d65a503-51fb-4118-b6e8-ed75cbd5ddf5","Type":"ContainerDied","Data":"72d10439209e2a3bfe801a8cb4ca24e524e03525c1729ae6d2bb7bd041075532"}
Jul 27 16:20:03.675664 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.675601    2579 scope.go:117] "RemoveContainer" containerID="3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc"
Jul 27 16:20:03.677080 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.677050    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh" event={"ID":"c4a02dd4-f759-42f5-a99d-6c8f409c075b","Type":"ContainerStarted","Data":"b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2"}
Jul 27 16:20:03.677189 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.677107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh" event={"ID":"c4a02dd4-f759-42f5-a99d-6c8f409c075b","Type":"ContainerStarted","Data":"2530a2fe561a7b0498c78aab44da3141e92aa999cf2650b61825f515915e2765"}
Jul 27 16:20:03.677573 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.677553    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:03.685360 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.685345    2579 scope.go:117] "RemoveContainer" containerID="a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f"
Jul 27 16:20:03.693056 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.693040    2579 scope.go:117] "RemoveContainer" containerID="3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc"
Jul 27 16:20:03.693275 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:20:03.693260    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc\": container with ID starting with 3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc not found: ID does not exist" containerID="3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc"
Jul 27 16:20:03.693316 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.693281    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc"} err="failed to get container status \"3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc\": rpc error: code = NotFound desc = could not find container \"3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc\": container with ID starting with 3ccfd1edf8cc8151052c918fd772f1ad24b04be968b1913a19751048823131bc not found: ID does not exist"
Jul 27 16:20:03.693316 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.693296    2579 scope.go:117] "RemoveContainer" containerID="a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f"
Jul 27 16:20:03.693509 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:20:03.693480    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f\": container with ID starting with a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f not found: ID does not exist" containerID="a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f"
Jul 27 16:20:03.693553 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.693519    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f"} err="failed to get container status \"a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f\": rpc error: code = NotFound desc = could not find container \"a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f\": container with ID starting with a32c6771b47ac91ac4be9ab8cd322ceb60513c44620c689358fd3d34f5e88c9f not found: ID does not exist"
Jul 27 16:20:03.697379 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.697343    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh" podStartSLOduration=2.697332338 podStartE2EDuration="2.697332338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:20:03.696594608 +0000 UTC m=+1906.377659040" watchObservedRunningTime="2026-07-27 16:20:03.697332338 +0000 UTC m=+1906.378396795"
Jul 27 16:20:03.711534 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.711513    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"]
Jul 27 16:20:03.715920 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.715900    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9ab13729-openshift-default-85c79f75b4-gkhwp"]
Jul 27 16:20:03.930725 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:03.930649    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" path="/var/lib/kubelet/pods/3d65a503-51fb-4118-b6e8-ed75cbd5ddf5/volumes"
Jul 27 16:20:13.680234 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:13.680196    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:14.685785 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:14.685757    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:15.746577 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:15.746544    2579 generic.go:356] "Generic (PLEG): container finished" podID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerID="949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2" exitCode=0
Jul 27 16:20:15.746986 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:15.746627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" event={"ID":"aff17605-0a30-4677-b7b5-0a0b32413a45","Type":"ContainerDied","Data":"949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2"}
Jul 27 16:20:15.747064 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:15.747047    2579 scope.go:117] "RemoveContainer" containerID="949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2"
Jul 27 16:20:15.748102 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:15.748079    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:20:15.748173 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:15.748161    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:20:15.748209 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:15.748194    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:20:16.662264 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:16.662207    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:20:16.776510 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:16.776468    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" event={"ID":"aff17605-0a30-4677-b7b5-0a0b32413a45","Type":"ContainerStarted","Data":"33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05"}
Jul 27 16:20:16.961625 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:16.961526    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:20:16.962785 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:16.962754    2579 patch_prober.go:28] interesting pod/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 27 16:20:16.962912 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:16.962828    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 27 16:20:17.961136 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:17.961102    2579 patch_prober.go:28] interesting pod/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 27 16:20:17.961716 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:17.961686    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 27 16:20:18.961937 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:18.961900    2579 patch_prober.go:28] interesting pod/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 27 16:20:18.962536 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:18.962475    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 27 16:20:19.961152 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:19.961115    2579 patch_prober.go:28] interesting pod/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Jul 27 16:20:19.961349 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:19.961176    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Jul 27 16:20:20.964370 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:20.964341    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:20:20.964799 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:20.964763    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:20:20.965568 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:20.965546    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:20:26.161973 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.161936    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"]
Jul 27 16:20:26.162542 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.162474    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy"
Jul 27 16:20:26.162542 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.162511    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy"
Jul 27 16:20:26.162542 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.162528    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy"
Jul 27 16:20:26.162542 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.162536    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy"
Jul 27 16:20:26.162774 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.162629    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy"
Jul 27 16:20:26.162774 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.162643    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d65a503-51fb-4118-b6e8-ed75cbd5ddf5" containerName="istio-proxy"
Jul 27 16:20:26.165665 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.165643    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"
Jul 27 16:20:26.167924 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.167903    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wqs6d\""
Jul 27 16:20:26.175125 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.175087    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"]
Jul 27 16:20:26.238120 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.238093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x\" (UID: \"4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"
Jul 27 16:20:26.339535 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.339483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x\" (UID: \"4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"
Jul 27 16:20:26.340083 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.340064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x\" (UID: \"4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"
Jul 27 16:20:26.476342 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.476274    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"
Jul 27 16:20:26.603106 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.603081    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"]
Jul 27 16:20:26.605259 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:20:26.605230    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8cb8d3_2caf_4d29_8b7c_a48d6eaea5fe.slice/crio-5318d0670cb0a2834926abcf616649363d49a8425d6aaa7c749d4a09f709e94c WatchSource:0}: Error finding container 5318d0670cb0a2834926abcf616649363d49a8425d6aaa7c749d4a09f709e94c: Status 404 returned error can't find the container with id 5318d0670cb0a2834926abcf616649363d49a8425d6aaa7c749d4a09f709e94c
Jul 27 16:20:26.829685 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:26.829652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x" event={"ID":"4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe","Type":"ContainerStarted","Data":"5318d0670cb0a2834926abcf616649363d49a8425d6aaa7c749d4a09f709e94c"}
Jul 27 16:20:27.836209 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:27.836171    2579 generic.go:356] "Generic (PLEG): container finished" podID="4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe" containerID="69def8b36a8e9159a6ada89adceb6aed80a09bb84aa744fb7f0b10cb9657251e" exitCode=0
Jul 27 16:20:27.836618 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:27.836259    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x" event={"ID":"4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe","Type":"ContainerDied","Data":"69def8b36a8e9159a6ada89adceb6aed80a09bb84aa744fb7f0b10cb9657251e"}
Jul 27 16:20:28.974562 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:28.974538    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"
Jul 27 16:20:29.061906 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:29.061879    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe-maas-api-service-ca\") pod \"4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe\" (UID: \"4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe\") "
Jul 27 16:20:29.062205 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:29.062183    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe" (UID: "4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:20:29.162878 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:29.162815    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe-maas-api-service-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:29.847180 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:29.847148    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"
Jul 27 16:20:29.847345 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:29.847153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x" event={"ID":"4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe","Type":"ContainerDied","Data":"5318d0670cb0a2834926abcf616649363d49a8425d6aaa7c749d4a09f709e94c"}
Jul 27 16:20:29.847345 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:29.847276    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5318d0670cb0a2834926abcf616649363d49a8425d6aaa7c749d4a09f709e94c"
Jul 27 16:20:36.747310 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:36.747275    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"]
Jul 27 16:20:36.747701 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:36.747467    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j" podUID="ce66bf0e-52e9-40b0-b6bc-6986b7be92c7" containerName="payload-processing" containerID="cri-o://26ed5fde4047dcaf87cc3b43b3dd3207774d100d5f4791be03840d2d304a03c0" gracePeriod=30
Jul 27 16:20:36.781622 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:36.781594    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"]
Jul 27 16:20:36.781874 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:36.781828    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh" podUID="c4a02dd4-f759-42f5-a99d-6c8f409c075b" containerName="payload-pre-processing" containerID="cri-o://b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2" gracePeriod=30
Jul 27 16:20:36.884865 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:36.884833    2579 generic.go:356] "Generic (PLEG): container finished" podID="ce66bf0e-52e9-40b0-b6bc-6986b7be92c7" containerID="26ed5fde4047dcaf87cc3b43b3dd3207774d100d5f4791be03840d2d304a03c0" exitCode=0
Jul 27 16:20:36.884996 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:36.884908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j" event={"ID":"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7","Type":"ContainerDied","Data":"26ed5fde4047dcaf87cc3b43b3dd3207774d100d5f4791be03840d2d304a03c0"}
Jul 27 16:20:37.044279 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.044256    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:37.062015 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.061993    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:37.132665 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.132634    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pplcm\" (UniqueName: \"kubernetes.io/projected/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-kube-api-access-pplcm\") pod \"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7\" (UID: \"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7\") "
Jul 27 16:20:37.132812 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.132721    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4a02dd4-f759-42f5-a99d-6c8f409c075b-plugins-config-volume\") pod \"c4a02dd4-f759-42f5-a99d-6c8f409c075b\" (UID: \"c4a02dd4-f759-42f5-a99d-6c8f409c075b\") "
Jul 27 16:20:37.132917 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.132897    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j759w\" (UniqueName: \"kubernetes.io/projected/c4a02dd4-f759-42f5-a99d-6c8f409c075b-kube-api-access-j759w\") pod \"c4a02dd4-f759-42f5-a99d-6c8f409c075b\" (UID: \"c4a02dd4-f759-42f5-a99d-6c8f409c075b\") "
Jul 27 16:20:37.132995 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.132936    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-plugins-config-volume\") pod \"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7\" (UID: \"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7\") "
Jul 27 16:20:37.133089 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.133069    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4a02dd4-f759-42f5-a99d-6c8f409c075b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c4a02dd4-f759-42f5-a99d-6c8f409c075b" (UID: "c4a02dd4-f759-42f5-a99d-6c8f409c075b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:20:37.133289 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.133266    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4a02dd4-f759-42f5-a99d-6c8f409c075b-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:37.133408 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.133304    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ce66bf0e-52e9-40b0-b6bc-6986b7be92c7" (UID: "ce66bf0e-52e9-40b0-b6bc-6986b7be92c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:20:37.134694 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.134666    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-kube-api-access-pplcm" (OuterVolumeSpecName: "kube-api-access-pplcm") pod "ce66bf0e-52e9-40b0-b6bc-6986b7be92c7" (UID: "ce66bf0e-52e9-40b0-b6bc-6986b7be92c7"). InnerVolumeSpecName "kube-api-access-pplcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:20:37.134808 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.134791    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4a02dd4-f759-42f5-a99d-6c8f409c075b-kube-api-access-j759w" (OuterVolumeSpecName: "kube-api-access-j759w") pod "c4a02dd4-f759-42f5-a99d-6c8f409c075b" (UID: "c4a02dd4-f759-42f5-a99d-6c8f409c075b"). InnerVolumeSpecName "kube-api-access-j759w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:20:37.234627 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.234592    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pplcm\" (UniqueName: \"kubernetes.io/projected/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-kube-api-access-pplcm\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:37.234627 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.234624    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j759w\" (UniqueName: \"kubernetes.io/projected/c4a02dd4-f759-42f5-a99d-6c8f409c075b-kube-api-access-j759w\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:37.234627 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.234632    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:37.890816 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.890783    2579 generic.go:356] "Generic (PLEG): container finished" podID="c4a02dd4-f759-42f5-a99d-6c8f409c075b" containerID="b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2" exitCode=0
Jul 27 16:20:37.891232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.890837    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"
Jul 27 16:20:37.891232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.890864    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh" event={"ID":"c4a02dd4-f759-42f5-a99d-6c8f409c075b","Type":"ContainerDied","Data":"b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2"}
Jul 27 16:20:37.891232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.890932    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh" event={"ID":"c4a02dd4-f759-42f5-a99d-6c8f409c075b","Type":"ContainerDied","Data":"2530a2fe561a7b0498c78aab44da3141e92aa999cf2650b61825f515915e2765"}
Jul 27 16:20:37.891232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.890958    2579 scope.go:117] "RemoveContainer" containerID="b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2"
Jul 27 16:20:37.892413 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.892393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j" event={"ID":"ce66bf0e-52e9-40b0-b6bc-6986b7be92c7","Type":"ContainerDied","Data":"ddab614c33959f255d2af5bde41d8e420775109de0aeb3d49f35c05f286303ab"}
Jul 27 16:20:37.892481 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.892400    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"
Jul 27 16:20:37.899729 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.899711    2579 scope.go:117] "RemoveContainer" containerID="b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2"
Jul 27 16:20:37.900002 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:20:37.899972    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2\": container with ID starting with b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2 not found: ID does not exist" containerID="b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2"
Jul 27 16:20:37.900093 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.900012    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2"} err="failed to get container status \"b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2\": rpc error: code = NotFound desc = could not find container \"b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2\": container with ID starting with b42626f075c11dc8013e514c8d51a41d57b4f98bd64f8a7378003a5cec66e7b2 not found: ID does not exist"
Jul 27 16:20:37.900093 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.900028    2579 scope.go:117] "RemoveContainer" containerID="26ed5fde4047dcaf87cc3b43b3dd3207774d100d5f4791be03840d2d304a03c0"
Jul 27 16:20:37.930063 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.930043    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"]
Jul 27 16:20:37.950713 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.950693    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-ed0533f9-6c94cf5f49-ww82j"]
Jul 27 16:20:37.971132 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.971106    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"]
Jul 27 16:20:37.982080 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:37.982056    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-ed0533f9-59d7bf8664-9mrqh"]
Jul 27 16:20:39.930093 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:39.930057    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4a02dd4-f759-42f5-a99d-6c8f409c075b" path="/var/lib/kubelet/pods/c4a02dd4-f759-42f5-a99d-6c8f409c075b/volumes"
Jul 27 16:20:39.930460 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:39.930437    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce66bf0e-52e9-40b0-b6bc-6986b7be92c7" path="/var/lib/kubelet/pods/ce66bf0e-52e9-40b0-b6bc-6986b7be92c7/volumes"
Jul 27 16:20:41.250484 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:41.250453    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"]
Jul 27 16:20:41.254965 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:41.254944    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ed0533f9-8pr4x"]
Jul 27 16:20:41.387035 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:41.387003    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"]
Jul 27 16:20:41.387243 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:41.387219    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerName="istio-proxy" containerID="cri-o://33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05" gracePeriod=30
Jul 27 16:20:41.930111 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:41.930081    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe" path="/var/lib/kubelet/pods/4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe/volumes"
Jul 27 16:20:42.227959 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.227877    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"]
Jul 27 16:20:42.228324 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.228306    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a02dd4-f759-42f5-a99d-6c8f409c075b" containerName="payload-pre-processing"
Jul 27 16:20:42.228424 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.228327    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a02dd4-f759-42f5-a99d-6c8f409c075b" containerName="payload-pre-processing"
Jul 27 16:20:42.228424 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.228361    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe" containerName="revoke-keys"
Jul 27 16:20:42.228424 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.228369    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe" containerName="revoke-keys"
Jul 27 16:20:42.228424 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.228388    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce66bf0e-52e9-40b0-b6bc-6986b7be92c7" containerName="payload-processing"
Jul 27 16:20:42.228424 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.228396    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce66bf0e-52e9-40b0-b6bc-6986b7be92c7" containerName="payload-processing"
Jul 27 16:20:42.228707 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.228473    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a02dd4-f759-42f5-a99d-6c8f409c075b" containerName="payload-pre-processing"
Jul 27 16:20:42.228707 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.228487    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e8cb8d3-2caf-4d29-8b7c-a48d6eaea5fe" containerName="revoke-keys"
Jul 27 16:20:42.228707 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.228514    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce66bf0e-52e9-40b0-b6bc-6986b7be92c7" containerName="payload-processing"
Jul 27 16:20:42.231798 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.231778    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.234352 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.234331    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-09433aa9-openshift-default-dockercfg-5vrxz\""
Jul 27 16:20:42.238172 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.238146    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"]
Jul 27 16:20:42.277056 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.277031    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-podinfo\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.277347 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.277066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istiod-ca-cert\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.277347 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.277097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcwbd\" (UniqueName: \"kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-kube-api-access-mcwbd\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.277347 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.277166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-data\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.277347 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.277214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-envoy\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.277347 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.277240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-certs\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.277347 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.277259    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-token\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.277347 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.277275    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-credential-socket\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.277613 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.277352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-socket\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.377798 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.377767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-token\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.377994 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.377808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-credential-socket\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.377994 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.377841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-socket\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.377994 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.377900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-podinfo\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.377994 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.377932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istiod-ca-cert\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.377994 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.377966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcwbd\" (UniqueName: \"kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-kube-api-access-mcwbd\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.378253 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.378003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-data\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.378253 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.378055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-envoy\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.378253 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.378095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-certs\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.378416 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.378297    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-credential-socket\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.378416 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.378329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-data\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.378416 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.378353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-socket\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.378594 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.378458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-certs\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.378917 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.378895    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istiod-ca-cert\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.380418 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.380391    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-envoy\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.380517 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.380471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-podinfo\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.387082 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.387058    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-token\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.387608 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.387587    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcwbd\" (UniqueName: \"kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-kube-api-access-mcwbd\") pod \"e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") " pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.543698 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.543668    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:42.680970 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.680943    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"]
Jul 27 16:20:42.682528 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:20:42.682487    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe481ddf_f185_467a_b9d3_27e47a0e1d3c.slice/crio-f39e46bb1d8494edede2b8faa0ac5755dd50c2046499069de4f102197f60c1d6 WatchSource:0}: Error finding container f39e46bb1d8494edede2b8faa0ac5755dd50c2046499069de4f102197f60c1d6: Status 404 returned error can't find the container with id f39e46bb1d8494edede2b8faa0ac5755dd50c2046499069de4f102197f60c1d6
Jul 27 16:20:42.684739 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.684711    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:20:42.684793 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.684773    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:20:42.684836 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.684799    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:20:42.923984 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.923900    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" event={"ID":"be481ddf-f185-467a-b9d3-27e47a0e1d3c","Type":"ContainerStarted","Data":"f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134"}
Jul 27 16:20:42.923984 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.923963    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" event={"ID":"be481ddf-f185-467a-b9d3-27e47a0e1d3c","Type":"ContainerStarted","Data":"f39e46bb1d8494edede2b8faa0ac5755dd50c2046499069de4f102197f60c1d6"}
Jul 27 16:20:42.945837 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:42.945791    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" podStartSLOduration=0.945777656 podStartE2EDuration="945.777656ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:20:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:20:42.945588264 +0000 UTC m=+1945.626652695" watchObservedRunningTime="2026-07-27 16:20:42.945777656 +0000 UTC m=+1945.626842086"
Jul 27 16:20:43.544673 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:43.544642    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:43.549380 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:43.549355    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:43.931792 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:43.931716    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:43.931792 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:43.931792    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:45.609561 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.609521    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"]
Jul 27 16:20:45.613208 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.613186    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:20:45.615527 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.615491    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-09433aa9-dockercfg-tkhnn\""
Jul 27 16:20:45.615616 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.615529    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-09433aa9\""
Jul 27 16:20:45.632802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.632772    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"]
Jul 27 16:20:45.656552 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.656521    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"]
Jul 27 16:20:45.660127 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.660113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:20:45.672004 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.671972    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"]
Jul 27 16:20:45.711107 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.710846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/643beff6-c8a5-45f2-a2e6-d971820500e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr\" (UID: \"643beff6-c8a5-45f2-a2e6-d971820500e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:20:45.711107 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.710916    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwzqv\" (UniqueName: \"kubernetes.io/projected/643beff6-c8a5-45f2-a2e6-d971820500e9-kube-api-access-mwzqv\") pod \"payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr\" (UID: \"643beff6-c8a5-45f2-a2e6-d971820500e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:20:45.812368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.812333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/643beff6-c8a5-45f2-a2e6-d971820500e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr\" (UID: \"643beff6-c8a5-45f2-a2e6-d971820500e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:20:45.812580 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.812391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/264ff379-86b8-473f-a245-e42d089dbdc5-plugins-config-volume\") pod \"payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt\" (UID: \"264ff379-86b8-473f-a245-e42d089dbdc5\") " pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:20:45.812580 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.812420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwzqv\" (UniqueName: \"kubernetes.io/projected/643beff6-c8a5-45f2-a2e6-d971820500e9-kube-api-access-mwzqv\") pod \"payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr\" (UID: \"643beff6-c8a5-45f2-a2e6-d971820500e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:20:45.812580 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.812441    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlgvc\" (UniqueName: \"kubernetes.io/projected/264ff379-86b8-473f-a245-e42d089dbdc5-kube-api-access-jlgvc\") pod \"payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt\" (UID: \"264ff379-86b8-473f-a245-e42d089dbdc5\") " pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:20:45.813097 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.813076    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/643beff6-c8a5-45f2-a2e6-d971820500e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr\" (UID: \"643beff6-c8a5-45f2-a2e6-d971820500e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:20:45.820738 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.820717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwzqv\" (UniqueName: \"kubernetes.io/projected/643beff6-c8a5-45f2-a2e6-d971820500e9-kube-api-access-mwzqv\") pod \"payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr\" (UID: \"643beff6-c8a5-45f2-a2e6-d971820500e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:20:45.913447 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.913384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/264ff379-86b8-473f-a245-e42d089dbdc5-plugins-config-volume\") pod \"payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt\" (UID: \"264ff379-86b8-473f-a245-e42d089dbdc5\") " pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:20:45.913447 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.913411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlgvc\" (UniqueName: \"kubernetes.io/projected/264ff379-86b8-473f-a245-e42d089dbdc5-kube-api-access-jlgvc\") pod \"payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt\" (UID: \"264ff379-86b8-473f-a245-e42d089dbdc5\") " pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:20:45.914110 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.914088    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/264ff379-86b8-473f-a245-e42d089dbdc5-plugins-config-volume\") pod \"payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt\" (UID: \"264ff379-86b8-473f-a245-e42d089dbdc5\") " pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:20:45.923281 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.923263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:20:45.925928 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.925902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlgvc\" (UniqueName: \"kubernetes.io/projected/264ff379-86b8-473f-a245-e42d089dbdc5-kube-api-access-jlgvc\") pod \"payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt\" (UID: \"264ff379-86b8-473f-a245-e42d089dbdc5\") " pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:20:45.969846 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:45.969820    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:20:46.114397 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.114373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"]
Jul 27 16:20:46.115456 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:20:46.115422    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264ff379_86b8_473f_a245_e42d089dbdc5.slice/crio-fc899e2a6eec33ac606754a28328fca19323df4a2cf8a01ef5921570c575d47d WatchSource:0}: Error finding container fc899e2a6eec33ac606754a28328fca19323df4a2cf8a01ef5921570c575d47d: Status 404 returned error can't find the container with id fc899e2a6eec33ac606754a28328fca19323df4a2cf8a01ef5921570c575d47d
Jul 27 16:20:46.283972 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.283946    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"]
Jul 27 16:20:46.285269 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:20:46.285233    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643beff6_c8a5_45f2_a2e6_d971820500e9.slice/crio-510f5b2f92795fcf460cb3bba8c3935ca395a6768181935cff906585ce738744 WatchSource:0}: Error finding container 510f5b2f92795fcf460cb3bba8c3935ca395a6768181935cff906585ce738744: Status 404 returned error can't find the container with id 510f5b2f92795fcf460cb3bba8c3935ca395a6768181935cff906585ce738744
Jul 27 16:20:46.619747 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.619723    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:20:46.719541 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.719513    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-credential-socket\") pod \"aff17605-0a30-4677-b7b5-0a0b32413a45\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") "
Jul 27 16:20:46.719673 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.719546    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-token\") pod \"aff17605-0a30-4677-b7b5-0a0b32413a45\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") "
Jul 27 16:20:46.719673 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.719567    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff17605-0a30-4677-b7b5-0a0b32413a45-istiod-ca-cert\") pod \"aff17605-0a30-4677-b7b5-0a0b32413a45\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") "
Jul 27 16:20:46.719673 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.719597    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-envoy\") pod \"aff17605-0a30-4677-b7b5-0a0b32413a45\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") "
Jul 27 16:20:46.719823 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.719738    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-certs\") pod \"aff17605-0a30-4677-b7b5-0a0b32413a45\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") "
Jul 27 16:20:46.719823 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.719803    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-data\") pod \"aff17605-0a30-4677-b7b5-0a0b32413a45\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") "
Jul 27 16:20:46.719928 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.719820    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aff17605-0a30-4677-b7b5-0a0b32413a45" (UID: "aff17605-0a30-4677-b7b5-0a0b32413a45"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:20:46.719928 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.719842    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-podinfo\") pod \"aff17605-0a30-4677-b7b5-0a0b32413a45\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") "
Jul 27 16:20:46.719928 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.719894    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f6lg\" (UniqueName: \"kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-kube-api-access-6f6lg\") pod \"aff17605-0a30-4677-b7b5-0a0b32413a45\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") "
Jul 27 16:20:46.720095 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.719940    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-socket\") pod \"aff17605-0a30-4677-b7b5-0a0b32413a45\" (UID: \"aff17605-0a30-4677-b7b5-0a0b32413a45\") "
Jul 27 16:20:46.720095 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.719951    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff17605-0a30-4677-b7b5-0a0b32413a45-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aff17605-0a30-4677-b7b5-0a0b32413a45" (UID: "aff17605-0a30-4677-b7b5-0a0b32413a45"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:20:46.720095 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.720080    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aff17605-0a30-4677-b7b5-0a0b32413a45" (UID: "aff17605-0a30-4677-b7b5-0a0b32413a45"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:20:46.720302 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.720278    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aff17605-0a30-4677-b7b5-0a0b32413a45" (UID: "aff17605-0a30-4677-b7b5-0a0b32413a45"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:20:46.720376 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.720299    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:46.720376 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.720320    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff17605-0a30-4677-b7b5-0a0b32413a45-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:46.720376 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.720334    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:46.720897 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.720873    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-data" (OuterVolumeSpecName: "istio-data") pod "aff17605-0a30-4677-b7b5-0a0b32413a45" (UID: "aff17605-0a30-4677-b7b5-0a0b32413a45"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:20:46.721867 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.721847    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aff17605-0a30-4677-b7b5-0a0b32413a45" (UID: "aff17605-0a30-4677-b7b5-0a0b32413a45"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:20:46.721953 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.721892    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-token" (OuterVolumeSpecName: "istio-token") pod "aff17605-0a30-4677-b7b5-0a0b32413a45" (UID: "aff17605-0a30-4677-b7b5-0a0b32413a45"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:20:46.722186 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.722169    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aff17605-0a30-4677-b7b5-0a0b32413a45" (UID: "aff17605-0a30-4677-b7b5-0a0b32413a45"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:20:46.722186 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.722176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-kube-api-access-6f6lg" (OuterVolumeSpecName: "kube-api-access-6f6lg") pod "aff17605-0a30-4677-b7b5-0a0b32413a45" (UID: "aff17605-0a30-4677-b7b5-0a0b32413a45"). InnerVolumeSpecName "kube-api-access-6f6lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:20:46.821734 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.821714    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:46.821734 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.821734    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:46.821880 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.821743    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f6lg\" (UniqueName: \"kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-kube-api-access-6f6lg\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:46.821880 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.821753    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:46.821880 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.821762    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:46.821880 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.821770    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff17605-0a30-4677-b7b5-0a0b32413a45-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:20:46.950736 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.950698    2579 generic.go:356] "Generic (PLEG): container finished" podID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerID="33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05" exitCode=0
Jul 27 16:20:46.950878 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.950749    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"
Jul 27 16:20:46.950878 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.950783    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" event={"ID":"aff17605-0a30-4677-b7b5-0a0b32413a45","Type":"ContainerDied","Data":"33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05"}
Jul 27 16:20:46.950878 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.950849    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk" event={"ID":"aff17605-0a30-4677-b7b5-0a0b32413a45","Type":"ContainerDied","Data":"00ef8a34ca3fc74d14e68ab8b3b77c965a515c8bb9a5054bd1921ff393352487"}
Jul 27 16:20:46.951036 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.950882    2579 scope.go:117] "RemoveContainer" containerID="33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05"
Jul 27 16:20:46.952459 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.952439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt" event={"ID":"264ff379-86b8-473f-a245-e42d089dbdc5","Type":"ContainerStarted","Data":"c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9"}
Jul 27 16:20:46.952573 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.952475    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt" event={"ID":"264ff379-86b8-473f-a245-e42d089dbdc5","Type":"ContainerStarted","Data":"fc899e2a6eec33ac606754a28328fca19323df4a2cf8a01ef5921570c575d47d"}
Jul 27 16:20:46.952573 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.952540    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:20:46.954211 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.954174    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr" event={"ID":"643beff6-c8a5-45f2-a2e6-d971820500e9","Type":"ContainerStarted","Data":"2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8"}
Jul 27 16:20:46.954325 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.954219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr" event={"ID":"643beff6-c8a5-45f2-a2e6-d971820500e9","Type":"ContainerStarted","Data":"510f5b2f92795fcf460cb3bba8c3935ca395a6768181935cff906585ce738744"}
Jul 27 16:20:46.954325 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.954266    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:20:46.961361 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.961345    2579 scope.go:117] "RemoveContainer" containerID="949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2"
Jul 27 16:20:46.969156 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.969140    2579 scope.go:117] "RemoveContainer" containerID="33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05"
Jul 27 16:20:46.969388 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:20:46.969371    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05\": container with ID starting with 33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05 not found: ID does not exist" containerID="33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05"
Jul 27 16:20:46.969436 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.969397    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05"} err="failed to get container status \"33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05\": rpc error: code = NotFound desc = could not find container \"33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05\": container with ID starting with 33c862e12d5be90b9c3275ac74609e5f3facbdca0f9ab510c2a1f54c48a01f05 not found: ID does not exist"
Jul 27 16:20:46.969436 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.969414    2579 scope.go:117] "RemoveContainer" containerID="949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2"
Jul 27 16:20:46.969680 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:20:46.969663    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2\": container with ID starting with 949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2 not found: ID does not exist" containerID="949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2"
Jul 27 16:20:46.969745 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.969686    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2"} err="failed to get container status \"949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2\": rpc error: code = NotFound desc = could not find container \"949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2\": container with ID starting with 949afa520674ac645114431d37a4e78090a3c30938026cf14bc6a8f0fee37df2 not found: ID does not exist"
Jul 27 16:20:46.973503 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.973452    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr" podStartSLOduration=1.973440408 podStartE2EDuration="1.973440408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:20:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:20:46.970776531 +0000 UTC m=+1949.651840959" watchObservedRunningTime="2026-07-27 16:20:46.973440408 +0000 UTC m=+1949.654504837"
Jul 27 16:20:46.987788 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:46.987750    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt" podStartSLOduration=1.987738829 podStartE2EDuration="1.987738829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:20:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:20:46.987363953 +0000 UTC m=+1949.668428382" watchObservedRunningTime="2026-07-27 16:20:46.987738829 +0000 UTC m=+1949.668803257"
Jul 27 16:20:47.006857 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:47.006837    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"]
Jul 27 16:20:47.014212 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:47.014185    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-ed0533f9-gw-openshift-default-67f4ccf7b8-8khbk"]
Jul 27 16:20:47.930906 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:47.930870    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" path="/var/lib/kubelet/pods/aff17605-0a30-4677-b7b5-0a0b32413a45/volumes"
Jul 27 16:20:56.011929 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:56.011855    2579 generic.go:356] "Generic (PLEG): container finished" podID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerID="f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134" exitCode=0
Jul 27 16:20:56.011929 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:56.011895    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" event={"ID":"be481ddf-f185-467a-b9d3-27e47a0e1d3c","Type":"ContainerDied","Data":"f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134"}
Jul 27 16:20:56.012364 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:56.012295    2579 scope.go:117] "RemoveContainer" containerID="f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134"
Jul 27 16:20:56.013289 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:56.013249    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:20:56.013399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:56.013314    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:20:56.013399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:56.013346    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:20:57.019181 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:57.019144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" event={"ID":"be481ddf-f185-467a-b9d3-27e47a0e1d3c","Type":"ContainerStarted","Data":"5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0"}
Jul 27 16:20:57.544462 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:57.544423    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:57.545576 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:57.545552    2579 patch_prober.go:28] interesting pod/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 16:20:57.545698 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:57.545598    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 16:20:57.963874 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:57.963777    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr" podUID="643beff6-c8a5-45f2-a2e6-d971820500e9" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.54:9004: connect: connection refused"
Jul 27 16:20:57.964335 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:57.964314    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:20:58.545041 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:58.544999    2579 patch_prober.go:28] interesting pod/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 16:20:58.545448 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:58.545081    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 16:20:58.931419 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:58.931330    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:20:59.544835 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:59.544795    2579 patch_prober.go:28] interesting pod/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 16:20:59.545005 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:20:59.544852    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 16:21:00.544424 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:00.544385    2579 patch_prober.go:28] interesting pod/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 16:21:00.545037 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:00.544996    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 16:21:01.544543 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:01.544477    2579 patch_prober.go:28] interesting pod/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 16:21:01.545045 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:01.544571    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 16:21:02.544874 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:02.544832    2579 patch_prober.go:28] interesting pod/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 16:21:02.545385 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:02.544896    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 16:21:03.544124 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:03.544088    2579 patch_prober.go:28] interesting pod/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Jul 27 16:21:03.544389 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:03.544363    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Jul 27 16:21:04.548313 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:04.548283    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:21:04.549283 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:04.549261    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:21:05.924432 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:05.924392    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr" podUID="643beff6-c8a5-45f2-a2e6-d971820500e9" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.54:9004: connect: connection refused"
Jul 27 16:21:07.962559 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:07.962515    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr" podUID="643beff6-c8a5-45f2-a2e6-d971820500e9" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.54:9004: connect: connection refused"
Jul 27 16:21:17.963060 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:17.962986    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:21:20.808648 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:20.808616    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"]
Jul 27 16:21:20.809111 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:20.808873    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt" podUID="264ff379-86b8-473f-a245-e42d089dbdc5" containerName="payload-processing" containerID="cri-o://c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9" gracePeriod=30
Jul 27 16:21:20.817786 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:20.817749    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"]
Jul 27 16:21:20.817979 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:20.817956    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr" podUID="643beff6-c8a5-45f2-a2e6-d971820500e9" containerName="payload-pre-processing" containerID="cri-o://2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8" gracePeriod=30
Jul 27 16:21:21.074177 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.074154    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:21:21.105560 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.105538    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:21:21.120423 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.120401    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/264ff379-86b8-473f-a245-e42d089dbdc5-plugins-config-volume\") pod \"264ff379-86b8-473f-a245-e42d089dbdc5\" (UID: \"264ff379-86b8-473f-a245-e42d089dbdc5\") "
Jul 27 16:21:21.120532 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.120463    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlgvc\" (UniqueName: \"kubernetes.io/projected/264ff379-86b8-473f-a245-e42d089dbdc5-kube-api-access-jlgvc\") pod \"264ff379-86b8-473f-a245-e42d089dbdc5\" (UID: \"264ff379-86b8-473f-a245-e42d089dbdc5\") "
Jul 27 16:21:21.120780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.120758    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/264ff379-86b8-473f-a245-e42d089dbdc5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "264ff379-86b8-473f-a245-e42d089dbdc5" (UID: "264ff379-86b8-473f-a245-e42d089dbdc5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:21:21.122397 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.122378    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264ff379-86b8-473f-a245-e42d089dbdc5-kube-api-access-jlgvc" (OuterVolumeSpecName: "kube-api-access-jlgvc") pod "264ff379-86b8-473f-a245-e42d089dbdc5" (UID: "264ff379-86b8-473f-a245-e42d089dbdc5"). InnerVolumeSpecName "kube-api-access-jlgvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:21:21.156395 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.156370    2579 generic.go:356] "Generic (PLEG): container finished" podID="264ff379-86b8-473f-a245-e42d089dbdc5" containerID="c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9" exitCode=0
Jul 27 16:21:21.156533 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.156420    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"
Jul 27 16:21:21.156533 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.156516    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt" event={"ID":"264ff379-86b8-473f-a245-e42d089dbdc5","Type":"ContainerDied","Data":"c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9"}
Jul 27 16:21:21.156649 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.156577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt" event={"ID":"264ff379-86b8-473f-a245-e42d089dbdc5","Type":"ContainerDied","Data":"fc899e2a6eec33ac606754a28328fca19323df4a2cf8a01ef5921570c575d47d"}
Jul 27 16:21:21.156649 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.156609    2579 scope.go:117] "RemoveContainer" containerID="c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9"
Jul 27 16:21:21.157836 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.157813    2579 generic.go:356] "Generic (PLEG): container finished" podID="643beff6-c8a5-45f2-a2e6-d971820500e9" containerID="2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8" exitCode=0
Jul 27 16:21:21.157924 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.157863    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"
Jul 27 16:21:21.157924 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.157871    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr" event={"ID":"643beff6-c8a5-45f2-a2e6-d971820500e9","Type":"ContainerDied","Data":"2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8"}
Jul 27 16:21:21.157924 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.157919    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr" event={"ID":"643beff6-c8a5-45f2-a2e6-d971820500e9","Type":"ContainerDied","Data":"510f5b2f92795fcf460cb3bba8c3935ca395a6768181935cff906585ce738744"}
Jul 27 16:21:21.165830 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.165816    2579 scope.go:117] "RemoveContainer" containerID="c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9"
Jul 27 16:21:21.166038 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:21:21.166020    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9\": container with ID starting with c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9 not found: ID does not exist" containerID="c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9"
Jul 27 16:21:21.166090 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.166047    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9"} err="failed to get container status \"c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9\": rpc error: code = NotFound desc = could not find container \"c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9\": container with ID starting with c0920fbbba71df6c38252a753116bdbf5b6f01854ce9eb8fc901732dbfcba0f9 not found: ID does not exist"
Jul 27 16:21:21.166090 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.166063    2579 scope.go:117] "RemoveContainer" containerID="2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8"
Jul 27 16:21:21.173612 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.173595    2579 scope.go:117] "RemoveContainer" containerID="2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8"
Jul 27 16:21:21.173837 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:21:21.173822    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8\": container with ID starting with 2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8 not found: ID does not exist" containerID="2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8"
Jul 27 16:21:21.173887 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.173841    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8"} err="failed to get container status \"2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8\": rpc error: code = NotFound desc = could not find container \"2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8\": container with ID starting with 2527895b2606be2eb80541de689e70ef114f638f54b678d43d1c3ea095da8bb8 not found: ID does not exist"
Jul 27 16:21:21.178599 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.178510    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"]
Jul 27 16:21:21.180740 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.180722    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-09433aa9-77cf5b894d-2bhrt"]
Jul 27 16:21:21.221631 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.221612    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/643beff6-c8a5-45f2-a2e6-d971820500e9-plugins-config-volume\") pod \"643beff6-c8a5-45f2-a2e6-d971820500e9\" (UID: \"643beff6-c8a5-45f2-a2e6-d971820500e9\") "
Jul 27 16:21:21.221718 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.221711    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwzqv\" (UniqueName: \"kubernetes.io/projected/643beff6-c8a5-45f2-a2e6-d971820500e9-kube-api-access-mwzqv\") pod \"643beff6-c8a5-45f2-a2e6-d971820500e9\" (UID: \"643beff6-c8a5-45f2-a2e6-d971820500e9\") "
Jul 27 16:21:21.221862 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.221851    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/264ff379-86b8-473f-a245-e42d089dbdc5-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:21.221900 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.221864    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlgvc\" (UniqueName: \"kubernetes.io/projected/264ff379-86b8-473f-a245-e42d089dbdc5-kube-api-access-jlgvc\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:21.222011 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.221988    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/643beff6-c8a5-45f2-a2e6-d971820500e9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "643beff6-c8a5-45f2-a2e6-d971820500e9" (UID: "643beff6-c8a5-45f2-a2e6-d971820500e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:21:21.223608 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.223588    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/643beff6-c8a5-45f2-a2e6-d971820500e9-kube-api-access-mwzqv" (OuterVolumeSpecName: "kube-api-access-mwzqv") pod "643beff6-c8a5-45f2-a2e6-d971820500e9" (UID: "643beff6-c8a5-45f2-a2e6-d971820500e9"). InnerVolumeSpecName "kube-api-access-mwzqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:21:21.322899 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.322843    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwzqv\" (UniqueName: \"kubernetes.io/projected/643beff6-c8a5-45f2-a2e6-d971820500e9-kube-api-access-mwzqv\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:21.322899 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.322862    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/643beff6-c8a5-45f2-a2e6-d971820500e9-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:21.480858 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.480827    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"]
Jul 27 16:21:21.484358 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.484337    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-09433aa9-6f9c6d8544-dvhcr"]
Jul 27 16:21:21.935679 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.935649    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="264ff379-86b8-473f-a245-e42d089dbdc5" path="/var/lib/kubelet/pods/264ff379-86b8-473f-a245-e42d089dbdc5/volumes"
Jul 27 16:21:21.936018 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:21.935973    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="643beff6-c8a5-45f2-a2e6-d971820500e9" path="/var/lib/kubelet/pods/643beff6-c8a5-45f2-a2e6-d971820500e9/volumes"
Jul 27 16:21:26.771548 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:26.771512    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"]
Jul 27 16:21:26.772033 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:26.771705    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy" containerID="cri-o://5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0" gracePeriod=30
Jul 27 16:21:27.625583 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.625546    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"]
Jul 27 16:21:27.625931 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.625919    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264ff379-86b8-473f-a245-e42d089dbdc5" containerName="payload-processing"
Jul 27 16:21:27.625981 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.625933    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="264ff379-86b8-473f-a245-e42d089dbdc5" containerName="payload-processing"
Jul 27 16:21:27.625981 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.625949    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerName="istio-proxy"
Jul 27 16:21:27.625981 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.625955    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerName="istio-proxy"
Jul 27 16:21:27.625981 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.625962    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerName="istio-proxy"
Jul 27 16:21:27.625981 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.625968    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerName="istio-proxy"
Jul 27 16:21:27.625981 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.625982    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="643beff6-c8a5-45f2-a2e6-d971820500e9" containerName="payload-pre-processing"
Jul 27 16:21:27.626162 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.625987    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="643beff6-c8a5-45f2-a2e6-d971820500e9" containerName="payload-pre-processing"
Jul 27 16:21:27.626162 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.626038    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="264ff379-86b8-473f-a245-e42d089dbdc5" containerName="payload-processing"
Jul 27 16:21:27.626162 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.626046    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerName="istio-proxy"
Jul 27 16:21:27.626162 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.626052    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="643beff6-c8a5-45f2-a2e6-d971820500e9" containerName="payload-pre-processing"
Jul 27 16:21:27.626162 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.626058    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff17605-0a30-4677-b7b5-0a0b32413a45" containerName="istio-proxy"
Jul 27 16:21:27.630237 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.630218    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.632856 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.632834    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0a85b590-openshift-default-dockercfg-rpm6k\""
Jul 27 16:21:27.674005 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.673977    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"]
Jul 27 16:21:27.684312 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.684281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-envoy\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.684312 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.684310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006ab831-4b2c-47e4-a683-83067cc78233-istio-podinfo\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.684490 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.684340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-certs\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.684490 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.684357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tdzz\" (UniqueName: \"kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-kube-api-access-4tdzz\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.684490 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.684434    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-istio-token\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.684490 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.684473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006ab831-4b2c-47e4-a683-83067cc78233-istiod-ca-cert\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.684644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.684539    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-data\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.684644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.684572    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-socket\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.684644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.684587    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-credential-socket\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.785246 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-certs\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.785246 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tdzz\" (UniqueName: \"kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-kube-api-access-4tdzz\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.785780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-istio-token\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.785780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006ab831-4b2c-47e4-a683-83067cc78233-istiod-ca-cert\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.785780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785351    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-data\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.785780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-socket\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.785780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-credential-socket\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.785780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-envoy\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.785780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006ab831-4b2c-47e4-a683-83067cc78233-istio-podinfo\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.785780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-data\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.785780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-certs\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.786206 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-socket\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.786206 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.785975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-credential-socket\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.786206 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.786052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006ab831-4b2c-47e4-a683-83067cc78233-istiod-ca-cert\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.787864 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.787838    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-envoy\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.788080 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.788060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006ab831-4b2c-47e4-a683-83067cc78233-istio-podinfo\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.797805 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.797777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-istio-token\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.798168 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.798146    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tdzz\" (UniqueName: \"kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-kube-api-access-4tdzz\") pod \"e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") " pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:27.939867 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:27.939786    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:28.078685 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:28.078658    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"]
Jul 27 16:21:28.079991 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:21:28.079954    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod006ab831_4b2c_47e4_a683_83067cc78233.slice/crio-3c4dbba018566d256a72a27a4e8abe342a8102cf54036b16781cf481a7c31631 WatchSource:0}: Error finding container 3c4dbba018566d256a72a27a4e8abe342a8102cf54036b16781cf481a7c31631: Status 404 returned error can't find the container with id 3c4dbba018566d256a72a27a4e8abe342a8102cf54036b16781cf481a7c31631
Jul 27 16:21:28.081940 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:28.081910    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:21:28.082007 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:28.081978    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:21:28.082042 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:28.082007    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:21:28.199633 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:28.199540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" event={"ID":"006ab831-4b2c-47e4-a683-83067cc78233","Type":"ContainerStarted","Data":"d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457"}
Jul 27 16:21:28.199633 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:28.199607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" event={"ID":"006ab831-4b2c-47e4-a683-83067cc78233","Type":"ContainerStarted","Data":"3c4dbba018566d256a72a27a4e8abe342a8102cf54036b16781cf481a7c31631"}
Jul 27 16:21:28.226315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:28.226250    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" podStartSLOduration=1.2262301070000001 podStartE2EDuration="1.226230107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:21:28.222667076 +0000 UTC m=+1990.903731510" watchObservedRunningTime="2026-07-27 16:21:28.226230107 +0000 UTC m=+1990.907294537"
Jul 27 16:21:28.940219 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:28.940184    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:29.945060 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:29.945030    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:30.211014 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.210938    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:30.211985 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.211961    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:30.711568 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.711163    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"]
Jul 27 16:21:30.716446 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.716421    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:30.718671 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.718644    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0a85b590\""
Jul 27 16:21:30.718789 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.718774    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0a85b590-dockercfg-zfclv\""
Jul 27 16:21:30.728012 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.727989    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"]
Jul 27 16:21:30.752892 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.752865    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"]
Jul 27 16:21:30.756244 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.756227    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:30.781207 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.778004    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"]
Jul 27 16:21:30.815276 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.815243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f028d52-7be7-41bf-affd-10545da751a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr\" (UID: \"5f028d52-7be7-41bf-affd-10545da751a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:30.815442 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.815300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppdcj\" (UniqueName: \"kubernetes.io/projected/5f028d52-7be7-41bf-affd-10545da751a0-kube-api-access-ppdcj\") pod \"payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr\" (UID: \"5f028d52-7be7-41bf-affd-10545da751a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:30.815442 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.815330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8gzl\" (UniqueName: \"kubernetes.io/projected/fe84af54-040d-46f7-abdf-7e422ac440e2-kube-api-access-b8gzl\") pod \"payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4\" (UID: \"fe84af54-040d-46f7-abdf-7e422ac440e2\") " pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:30.815442 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.815380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe84af54-040d-46f7-abdf-7e422ac440e2-plugins-config-volume\") pod \"payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4\" (UID: \"fe84af54-040d-46f7-abdf-7e422ac440e2\") " pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:30.916882 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.916841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe84af54-040d-46f7-abdf-7e422ac440e2-plugins-config-volume\") pod \"payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4\" (UID: \"fe84af54-040d-46f7-abdf-7e422ac440e2\") " pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:30.917078 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.916904    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f028d52-7be7-41bf-affd-10545da751a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr\" (UID: \"5f028d52-7be7-41bf-affd-10545da751a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:30.917078 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.916935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppdcj\" (UniqueName: \"kubernetes.io/projected/5f028d52-7be7-41bf-affd-10545da751a0-kube-api-access-ppdcj\") pod \"payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr\" (UID: \"5f028d52-7be7-41bf-affd-10545da751a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:30.917078 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.916956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gzl\" (UniqueName: \"kubernetes.io/projected/fe84af54-040d-46f7-abdf-7e422ac440e2-kube-api-access-b8gzl\") pod \"payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4\" (UID: \"fe84af54-040d-46f7-abdf-7e422ac440e2\") " pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:30.917827 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.917802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe84af54-040d-46f7-abdf-7e422ac440e2-plugins-config-volume\") pod \"payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4\" (UID: \"fe84af54-040d-46f7-abdf-7e422ac440e2\") " pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:30.917888 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.917874    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f028d52-7be7-41bf-affd-10545da751a0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr\" (UID: \"5f028d52-7be7-41bf-affd-10545da751a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:30.931303 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.931273    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppdcj\" (UniqueName: \"kubernetes.io/projected/5f028d52-7be7-41bf-affd-10545da751a0-kube-api-access-ppdcj\") pod \"payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr\" (UID: \"5f028d52-7be7-41bf-affd-10545da751a0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:30.931408 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:30.931331    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8gzl\" (UniqueName: \"kubernetes.io/projected/fe84af54-040d-46f7-abdf-7e422ac440e2-kube-api-access-b8gzl\") pod \"payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4\" (UID: \"fe84af54-040d-46f7-abdf-7e422ac440e2\") " pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:31.027848 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:31.027821    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:31.065537 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:31.065486    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:31.182956 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:31.182877    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"]
Jul 27 16:21:31.187875 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:21:31.187850    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f028d52_7be7_41bf_affd_10545da751a0.slice/crio-a1fdb24495b11c542ae454e212839e5af858a0bd2fd6e850d6639a58c4abc0c1 WatchSource:0}: Error finding container a1fdb24495b11c542ae454e212839e5af858a0bd2fd6e850d6639a58c4abc0c1: Status 404 returned error can't find the container with id a1fdb24495b11c542ae454e212839e5af858a0bd2fd6e850d6639a58c4abc0c1
Jul 27 16:21:31.218209 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:31.218179    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"]
Jul 27 16:21:31.218686 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:31.218649    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr" event={"ID":"5f028d52-7be7-41bf-affd-10545da751a0","Type":"ContainerStarted","Data":"a1fdb24495b11c542ae454e212839e5af858a0bd2fd6e850d6639a58c4abc0c1"}
Jul 27 16:21:31.220483 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:21:31.220460    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe84af54_040d_46f7_abdf_7e422ac440e2.slice/crio-1f1bd3ccf500aec94ad3fa3d6d39ab6fa11661cf989eacc641a186e857c052ec WatchSource:0}: Error finding container 1f1bd3ccf500aec94ad3fa3d6d39ab6fa11661cf989eacc641a186e857c052ec: Status 404 returned error can't find the container with id 1f1bd3ccf500aec94ad3fa3d6d39ab6fa11661cf989eacc641a186e857c052ec
Jul 27 16:21:32.015304 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.015282    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:21:32.127803 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.127709    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcwbd\" (UniqueName: \"kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-kube-api-access-mcwbd\") pod \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") "
Jul 27 16:21:32.127803 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.127748    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istiod-ca-cert\") pod \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") "
Jul 27 16:21:32.127803 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.127781    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-certs\") pod \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") "
Jul 27 16:21:32.128346 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.127807    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-data\") pod \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") "
Jul 27 16:21:32.128346 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.127865    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-envoy\") pod \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") "
Jul 27 16:21:32.128346 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.127912    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-podinfo\") pod \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") "
Jul 27 16:21:32.128346 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.127946    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-credential-socket\") pod \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") "
Jul 27 16:21:32.128346 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.127970    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-token\") pod \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") "
Jul 27 16:21:32.128346 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.128020    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-socket\") pod \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\" (UID: \"be481ddf-f185-467a-b9d3-27e47a0e1d3c\") "
Jul 27 16:21:32.128346 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.128094    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be481ddf-f185-467a-b9d3-27e47a0e1d3c" (UID: "be481ddf-f185-467a-b9d3-27e47a0e1d3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:21:32.128346 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.128137    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be481ddf-f185-467a-b9d3-27e47a0e1d3c" (UID: "be481ddf-f185-467a-b9d3-27e47a0e1d3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:21:32.128346 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.128279    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be481ddf-f185-467a-b9d3-27e47a0e1d3c" (UID: "be481ddf-f185-467a-b9d3-27e47a0e1d3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:21:32.128346 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.128341    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:32.128758 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.128359    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:32.128758 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.128447    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be481ddf-f185-467a-b9d3-27e47a0e1d3c" (UID: "be481ddf-f185-467a-b9d3-27e47a0e1d3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:21:32.128902 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.128878    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-data" (OuterVolumeSpecName: "istio-data") pod "be481ddf-f185-467a-b9d3-27e47a0e1d3c" (UID: "be481ddf-f185-467a-b9d3-27e47a0e1d3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:21:32.130197 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.130177    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-token" (OuterVolumeSpecName: "istio-token") pod "be481ddf-f185-467a-b9d3-27e47a0e1d3c" (UID: "be481ddf-f185-467a-b9d3-27e47a0e1d3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:21:32.130308 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.130192    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be481ddf-f185-467a-b9d3-27e47a0e1d3c" (UID: "be481ddf-f185-467a-b9d3-27e47a0e1d3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:21:32.130381 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.130365    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-kube-api-access-mcwbd" (OuterVolumeSpecName: "kube-api-access-mcwbd") pod "be481ddf-f185-467a-b9d3-27e47a0e1d3c" (UID: "be481ddf-f185-467a-b9d3-27e47a0e1d3c"). InnerVolumeSpecName "kube-api-access-mcwbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:21:32.130381 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.130370    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be481ddf-f185-467a-b9d3-27e47a0e1d3c" (UID: "be481ddf-f185-467a-b9d3-27e47a0e1d3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:21:32.226054 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.226018    2579 generic.go:356] "Generic (PLEG): container finished" podID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerID="5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0" exitCode=0
Jul 27 16:21:32.226197 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.226075    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"
Jul 27 16:21:32.226197 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.226101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" event={"ID":"be481ddf-f185-467a-b9d3-27e47a0e1d3c","Type":"ContainerDied","Data":"5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0"}
Jul 27 16:21:32.226197 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.226161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g" event={"ID":"be481ddf-f185-467a-b9d3-27e47a0e1d3c","Type":"ContainerDied","Data":"f39e46bb1d8494edede2b8faa0ac5755dd50c2046499069de4f102197f60c1d6"}
Jul 27 16:21:32.226197 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.226193    2579 scope.go:117] "RemoveContainer" containerID="5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0"
Jul 27 16:21:32.227771 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.227746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4" event={"ID":"fe84af54-040d-46f7-abdf-7e422ac440e2","Type":"ContainerStarted","Data":"5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6"}
Jul 27 16:21:32.227897 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.227788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4" event={"ID":"fe84af54-040d-46f7-abdf-7e422ac440e2","Type":"ContainerStarted","Data":"1f1bd3ccf500aec94ad3fa3d6d39ab6fa11661cf989eacc641a186e857c052ec"}
Jul 27 16:21:32.227897 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.227847    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:32.228893 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.228874    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcwbd\" (UniqueName: \"kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-kube-api-access-mcwbd\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:32.229018 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.228896    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:32.229018 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.228910    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:32.229018 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.228923    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:32.229018 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.228935    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:32.229018 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.228948    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be481ddf-f185-467a-b9d3-27e47a0e1d3c-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:32.229018 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.228959    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be481ddf-f185-467a-b9d3-27e47a0e1d3c-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:32.229520 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.229483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr" event={"ID":"5f028d52-7be7-41bf-affd-10545da751a0","Type":"ContainerStarted","Data":"47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0"}
Jul 27 16:21:32.229680 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.229661    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:32.235995 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.235980    2579 scope.go:117] "RemoveContainer" containerID="f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134"
Jul 27 16:21:32.243959 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.243941    2579 scope.go:117] "RemoveContainer" containerID="5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0"
Jul 27 16:21:32.244222 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:21:32.244204    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0\": container with ID starting with 5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0 not found: ID does not exist" containerID="5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0"
Jul 27 16:21:32.244287 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.244231    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0"} err="failed to get container status \"5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0\": rpc error: code = NotFound desc = could not find container \"5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0\": container with ID starting with 5ecadf92e31a6a4fac5ed317f9a9745ba79d4ec04cb8bdf56c84e50a39337fa0 not found: ID does not exist"
Jul 27 16:21:32.244287 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.244249    2579 scope.go:117] "RemoveContainer" containerID="f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134"
Jul 27 16:21:32.244480 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:21:32.244465    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134\": container with ID starting with f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134 not found: ID does not exist" containerID="f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134"
Jul 27 16:21:32.244589 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.244486    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134"} err="failed to get container status \"f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134\": rpc error: code = NotFound desc = could not find container \"f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134\": container with ID starting with f2406603d57d11eee49e695b9f5521aac2ec15e0736f3390b31063e35312c134 not found: ID does not exist"
Jul 27 16:21:32.249689 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.249651    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4" podStartSLOduration=2.249639721 podStartE2EDuration="2.249639721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:21:32.247781088 +0000 UTC m=+1994.928845516" watchObservedRunningTime="2026-07-27 16:21:32.249639721 +0000 UTC m=+1994.930704150"
Jul 27 16:21:32.278887 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.278849    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr" podStartSLOduration=2.278836708 podStartE2EDuration="2.278836708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:21:32.276442065 +0000 UTC m=+1994.957506495" watchObservedRunningTime="2026-07-27 16:21:32.278836708 +0000 UTC m=+1994.959901137"
Jul 27 16:21:32.295231 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.295209    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"]
Jul 27 16:21:32.302414 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:32.302395    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-09433aa9-openshift-default-c49bfc556-qf62g"]
Jul 27 16:21:33.930126 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:33.930095    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" path="/var/lib/kubelet/pods/be481ddf-f185-467a-b9d3-27e47a0e1d3c/volumes"
Jul 27 16:21:39.289657 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.289621    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"]
Jul 27 16:21:39.290143 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.290127    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy"
Jul 27 16:21:39.290143 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.290143    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy"
Jul 27 16:21:39.290325 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.290154    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy"
Jul 27 16:21:39.290325 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.290163    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy"
Jul 27 16:21:39.290325 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.290242    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy"
Jul 27 16:21:39.290325 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.290254    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="be481ddf-f185-467a-b9d3-27e47a0e1d3c" containerName="istio-proxy"
Jul 27 16:21:39.295723 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.295703    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"
Jul 27 16:21:39.298474 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.298452    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wqs6d\""
Jul 27 16:21:39.301083 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.301030    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"]
Jul 27 16:21:39.398657 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.398611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a2cad5c-b5a4-4635-9617-37aaf9ca11ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w\" (UID: \"1a2cad5c-b5a4-4635-9617-37aaf9ca11ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"
Jul 27 16:21:39.500174 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.500136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a2cad5c-b5a4-4635-9617-37aaf9ca11ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w\" (UID: \"1a2cad5c-b5a4-4635-9617-37aaf9ca11ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"
Jul 27 16:21:39.500748 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.500730    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a2cad5c-b5a4-4635-9617-37aaf9ca11ac-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w\" (UID: \"1a2cad5c-b5a4-4635-9617-37aaf9ca11ac\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"
Jul 27 16:21:39.616559 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.616433    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"
Jul 27 16:21:39.750841 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:39.750811    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"]
Jul 27 16:21:39.752482 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:21:39.752449    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a2cad5c_b5a4_4635_9617_37aaf9ca11ac.slice/crio-e43bb301a4a80f96fe6ae91487c7d22ee620f38a4c0c5dba1688a711da541764 WatchSource:0}: Error finding container e43bb301a4a80f96fe6ae91487c7d22ee620f38a4c0c5dba1688a711da541764: Status 404 returned error can't find the container with id e43bb301a4a80f96fe6ae91487c7d22ee620f38a4c0c5dba1688a711da541764
Jul 27 16:21:40.285461 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:40.285421    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w" event={"ID":"1a2cad5c-b5a4-4635-9617-37aaf9ca11ac","Type":"ContainerStarted","Data":"92a6a5fcd0d4e695c010f260cca8643942b375b5aa3433a1fcaa2574be05eacf"}
Jul 27 16:21:40.285631 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:40.285507    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w" event={"ID":"1a2cad5c-b5a4-4635-9617-37aaf9ca11ac","Type":"ContainerStarted","Data":"e43bb301a4a80f96fe6ae91487c7d22ee620f38a4c0c5dba1688a711da541764"}
Jul 27 16:21:40.308130 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:40.308080    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w" podStartSLOduration=1.30806481 podStartE2EDuration="1.30806481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:21:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:21:40.307005383 +0000 UTC m=+2002.988069835" watchObservedRunningTime="2026-07-27 16:21:40.30806481 +0000 UTC m=+2002.989129277"
Jul 27 16:21:41.291837 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:41.291805    2579 generic.go:356] "Generic (PLEG): container finished" podID="006ab831-4b2c-47e4-a683-83067cc78233" containerID="d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457" exitCode=0
Jul 27 16:21:41.292053 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:41.291881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" event={"ID":"006ab831-4b2c-47e4-a683-83067cc78233","Type":"ContainerDied","Data":"d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457"}
Jul 27 16:21:41.292377 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:41.292322    2579 scope.go:117] "RemoveContainer" containerID="d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457"
Jul 27 16:21:41.293477 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:41.293456    2579 generic.go:356] "Generic (PLEG): container finished" podID="1a2cad5c-b5a4-4635-9617-37aaf9ca11ac" containerID="92a6a5fcd0d4e695c010f260cca8643942b375b5aa3433a1fcaa2574be05eacf" exitCode=0
Jul 27 16:21:41.293597 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:41.293477    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:21:41.293597 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:41.293535    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w" event={"ID":"1a2cad5c-b5a4-4635-9617-37aaf9ca11ac","Type":"ContainerDied","Data":"92a6a5fcd0d4e695c010f260cca8643942b375b5aa3433a1fcaa2574be05eacf"}
Jul 27 16:21:41.293597 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:41.293562    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:21:41.293597 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:41.293593    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:21:42.300691 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:42.300657    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" event={"ID":"006ab831-4b2c-47e4-a683-83067cc78233","Type":"ContainerStarted","Data":"fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6"}
Jul 27 16:21:42.432063 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:42.432041    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"
Jul 27 16:21:42.528448 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:42.528423    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a2cad5c-b5a4-4635-9617-37aaf9ca11ac-maas-api-service-ca\") pod \"1a2cad5c-b5a4-4635-9617-37aaf9ca11ac\" (UID: \"1a2cad5c-b5a4-4635-9617-37aaf9ca11ac\") "
Jul 27 16:21:42.528774 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:42.528752    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a2cad5c-b5a4-4635-9617-37aaf9ca11ac-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1a2cad5c-b5a4-4635-9617-37aaf9ca11ac" (UID: "1a2cad5c-b5a4-4635-9617-37aaf9ca11ac"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:21:42.629378 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:42.629314    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a2cad5c-b5a4-4635-9617-37aaf9ca11ac-maas-api-service-ca\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:42.941042 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:42.940944    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:42.942145 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:42.942117    2579 patch_prober.go:28] interesting pod/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 27 16:21:42.942255 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:42.942166    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 27 16:21:43.238203 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:43.238113    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:43.238203 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:43.238199    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:43.308020 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:43.307995    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"
Jul 27 16:21:43.308464 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:43.308028    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w" event={"ID":"1a2cad5c-b5a4-4635-9617-37aaf9ca11ac","Type":"ContainerDied","Data":"e43bb301a4a80f96fe6ae91487c7d22ee620f38a4c0c5dba1688a711da541764"}
Jul 27 16:21:43.308464 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:43.308081    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e43bb301a4a80f96fe6ae91487c7d22ee620f38a4c0c5dba1688a711da541764"
Jul 27 16:21:43.940825 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:43.940793    2579 patch_prober.go:28] interesting pod/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 27 16:21:43.941002 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:43.940852    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 27 16:21:44.940579 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:44.940544    2579 patch_prober.go:28] interesting pod/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 27 16:21:44.940948 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:44.940605    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 27 16:21:45.211713 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:45.211631    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:45.940379 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:45.940344    2579 patch_prober.go:28] interesting pod/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 27 16:21:45.940590 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:45.940393    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 27 16:21:46.940400 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:46.940363    2579 patch_prober.go:28] interesting pod/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 27 16:21:46.940794 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:46.940423    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 27 16:21:47.944348 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:47.944318    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:47.945212 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:47.945195    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:50.829288 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:50.829255    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"]
Jul 27 16:21:50.829713 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:50.829528    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4" podUID="fe84af54-040d-46f7-abdf-7e422ac440e2" containerName="payload-processing" containerID="cri-o://5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6" gracePeriod=30
Jul 27 16:21:50.841207 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:50.841182    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"]
Jul 27 16:21:50.841431 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:50.841404    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr" podUID="5f028d52-7be7-41bf-affd-10545da751a0" containerName="payload-pre-processing" containerID="cri-o://47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0" gracePeriod=30
Jul 27 16:21:51.116643 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.116618    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:51.119856 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.119839    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:51.206962 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.206932    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe84af54-040d-46f7-abdf-7e422ac440e2-plugins-config-volume\") pod \"fe84af54-040d-46f7-abdf-7e422ac440e2\" (UID: \"fe84af54-040d-46f7-abdf-7e422ac440e2\") "
Jul 27 16:21:51.207141 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.207079    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8gzl\" (UniqueName: \"kubernetes.io/projected/fe84af54-040d-46f7-abdf-7e422ac440e2-kube-api-access-b8gzl\") pod \"fe84af54-040d-46f7-abdf-7e422ac440e2\" (UID: \"fe84af54-040d-46f7-abdf-7e422ac440e2\") "
Jul 27 16:21:51.207287 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.207264    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe84af54-040d-46f7-abdf-7e422ac440e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fe84af54-040d-46f7-abdf-7e422ac440e2" (UID: "fe84af54-040d-46f7-abdf-7e422ac440e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:21:51.209098 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.209078    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe84af54-040d-46f7-abdf-7e422ac440e2-kube-api-access-b8gzl" (OuterVolumeSpecName: "kube-api-access-b8gzl") pod "fe84af54-040d-46f7-abdf-7e422ac440e2" (UID: "fe84af54-040d-46f7-abdf-7e422ac440e2"). InnerVolumeSpecName "kube-api-access-b8gzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:21:51.308435 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.308406    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f028d52-7be7-41bf-affd-10545da751a0-plugins-config-volume\") pod \"5f028d52-7be7-41bf-affd-10545da751a0\" (UID: \"5f028d52-7be7-41bf-affd-10545da751a0\") "
Jul 27 16:21:51.308608 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.308516    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppdcj\" (UniqueName: \"kubernetes.io/projected/5f028d52-7be7-41bf-affd-10545da751a0-kube-api-access-ppdcj\") pod \"5f028d52-7be7-41bf-affd-10545da751a0\" (UID: \"5f028d52-7be7-41bf-affd-10545da751a0\") "
Jul 27 16:21:51.308692 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.308677    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8gzl\" (UniqueName: \"kubernetes.io/projected/fe84af54-040d-46f7-abdf-7e422ac440e2-kube-api-access-b8gzl\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:51.308692 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.308688    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe84af54-040d-46f7-abdf-7e422ac440e2-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:51.308854 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.308832    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f028d52-7be7-41bf-affd-10545da751a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5f028d52-7be7-41bf-affd-10545da751a0" (UID: "5f028d52-7be7-41bf-affd-10545da751a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:21:51.310543 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.310524    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f028d52-7be7-41bf-affd-10545da751a0-kube-api-access-ppdcj" (OuterVolumeSpecName: "kube-api-access-ppdcj") pod "5f028d52-7be7-41bf-affd-10545da751a0" (UID: "5f028d52-7be7-41bf-affd-10545da751a0"). InnerVolumeSpecName "kube-api-access-ppdcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:21:51.351755 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.351688    2579 generic.go:356] "Generic (PLEG): container finished" podID="5f028d52-7be7-41bf-affd-10545da751a0" containerID="47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0" exitCode=0
Jul 27 16:21:51.351755 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.351731    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"
Jul 27 16:21:51.351916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.351767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr" event={"ID":"5f028d52-7be7-41bf-affd-10545da751a0","Type":"ContainerDied","Data":"47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0"}
Jul 27 16:21:51.351916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.351835    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr" event={"ID":"5f028d52-7be7-41bf-affd-10545da751a0","Type":"ContainerDied","Data":"a1fdb24495b11c542ae454e212839e5af858a0bd2fd6e850d6639a58c4abc0c1"}
Jul 27 16:21:51.351916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.351858    2579 scope.go:117] "RemoveContainer" containerID="47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0"
Jul 27 16:21:51.353228 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.353209    2579 generic.go:356] "Generic (PLEG): container finished" podID="fe84af54-040d-46f7-abdf-7e422ac440e2" containerID="5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6" exitCode=0
Jul 27 16:21:51.353315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.353240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4" event={"ID":"fe84af54-040d-46f7-abdf-7e422ac440e2","Type":"ContainerDied","Data":"5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6"}
Jul 27 16:21:51.353315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.353261    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"
Jul 27 16:21:51.353315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.353299    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4" event={"ID":"fe84af54-040d-46f7-abdf-7e422ac440e2","Type":"ContainerDied","Data":"1f1bd3ccf500aec94ad3fa3d6d39ab6fa11661cf989eacc641a186e857c052ec"}
Jul 27 16:21:51.362185 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.362166    2579 scope.go:117] "RemoveContainer" containerID="47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0"
Jul 27 16:21:51.362440 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:21:51.362422    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0\": container with ID starting with 47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0 not found: ID does not exist" containerID="47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0"
Jul 27 16:21:51.362519 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.362447    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0"} err="failed to get container status \"47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0\": rpc error: code = NotFound desc = could not find container \"47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0\": container with ID starting with 47b3296dc2cba9c09e9e3e02bf8721e25e4ecee636d216e6aff1bc974ff4f7b0 not found: ID does not exist"
Jul 27 16:21:51.362519 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.362464    2579 scope.go:117] "RemoveContainer" containerID="5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6"
Jul 27 16:21:51.370342 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.370307    2579 scope.go:117] "RemoveContainer" containerID="5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6"
Jul 27 16:21:51.370631 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:21:51.370612    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6\": container with ID starting with 5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6 not found: ID does not exist" containerID="5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6"
Jul 27 16:21:51.370689 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.370637    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6"} err="failed to get container status \"5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6\": rpc error: code = NotFound desc = could not find container \"5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6\": container with ID starting with 5ef238f911de4ab2bf23eb7aae8580d7987f583a89781a0b326fd4ca1eed14a6 not found: ID does not exist"
Jul 27 16:21:51.380936 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.380914    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"]
Jul 27 16:21:51.387897 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.387879    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0a85b590-7c475d56f4-645v4"]
Jul 27 16:21:51.398459 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.398436    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"]
Jul 27 16:21:51.404607 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.404589    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0a85b590-7d78b8649b-g5nsr"]
Jul 27 16:21:51.409846 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.409827    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppdcj\" (UniqueName: \"kubernetes.io/projected/5f028d52-7be7-41bf-affd-10545da751a0-kube-api-access-ppdcj\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:51.409898 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.409849    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f028d52-7be7-41bf-affd-10545da751a0-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:51.930617 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.930588    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f028d52-7be7-41bf-affd-10545da751a0" path="/var/lib/kubelet/pods/5f028d52-7be7-41bf-affd-10545da751a0/volumes"
Jul 27 16:21:51.930986 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:51.930965    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe84af54-040d-46f7-abdf-7e422ac440e2" path="/var/lib/kubelet/pods/fe84af54-040d-46f7-abdf-7e422ac440e2/volumes"
Jul 27 16:21:54.375897 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:54.375863    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"]
Jul 27 16:21:54.379515 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:54.379482    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0a85b590-wgt5w"]
Jul 27 16:21:54.518307 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:54.518279    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"]
Jul 27 16:21:54.518537 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:54.518512    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy" containerID="cri-o://fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6" gracePeriod=30
Jul 27 16:21:55.930944 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:55.930906    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a2cad5c-b5a4-4635-9617-37aaf9ca11ac" path="/var/lib/kubelet/pods/1a2cad5c-b5a4-4635-9617-37aaf9ca11ac/volumes"
Jul 27 16:21:59.774941 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.774917    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:21:59.884187 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884099    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-socket\") pod \"006ab831-4b2c-47e4-a683-83067cc78233\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") "
Jul 27 16:21:59.884187 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884137    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-credential-socket\") pod \"006ab831-4b2c-47e4-a683-83067cc78233\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") "
Jul 27 16:21:59.884187 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884179    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006ab831-4b2c-47e4-a683-83067cc78233-istio-podinfo\") pod \"006ab831-4b2c-47e4-a683-83067cc78233\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") "
Jul 27 16:21:59.884467 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884226    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-certs\") pod \"006ab831-4b2c-47e4-a683-83067cc78233\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") "
Jul 27 16:21:59.884467 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884252    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-envoy\") pod \"006ab831-4b2c-47e4-a683-83067cc78233\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") "
Jul 27 16:21:59.884467 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884273    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-istio-token\") pod \"006ab831-4b2c-47e4-a683-83067cc78233\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") "
Jul 27 16:21:59.884467 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884314    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-data\") pod \"006ab831-4b2c-47e4-a683-83067cc78233\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") "
Jul 27 16:21:59.884467 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884370    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tdzz\" (UniqueName: \"kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-kube-api-access-4tdzz\") pod \"006ab831-4b2c-47e4-a683-83067cc78233\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") "
Jul 27 16:21:59.884467 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884379    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "006ab831-4b2c-47e4-a683-83067cc78233" (UID: "006ab831-4b2c-47e4-a683-83067cc78233"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:21:59.884467 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884421    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006ab831-4b2c-47e4-a683-83067cc78233-istiod-ca-cert\") pod \"006ab831-4b2c-47e4-a683-83067cc78233\" (UID: \"006ab831-4b2c-47e4-a683-83067cc78233\") "
Jul 27 16:21:59.884913 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884523    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "006ab831-4b2c-47e4-a683-83067cc78233" (UID: "006ab831-4b2c-47e4-a683-83067cc78233"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:21:59.884913 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884544    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "006ab831-4b2c-47e4-a683-83067cc78233" (UID: "006ab831-4b2c-47e4-a683-83067cc78233"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:21:59.884913 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884765    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:59.884913 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884787    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:59.884913 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884804    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:59.884913 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.884847    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/006ab831-4b2c-47e4-a683-83067cc78233-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "006ab831-4b2c-47e4-a683-83067cc78233" (UID: "006ab831-4b2c-47e4-a683-83067cc78233"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:21:59.885266 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.885243    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-data" (OuterVolumeSpecName: "istio-data") pod "006ab831-4b2c-47e4-a683-83067cc78233" (UID: "006ab831-4b2c-47e4-a683-83067cc78233"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:21:59.886598 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.886566    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-istio-token" (OuterVolumeSpecName: "istio-token") pod "006ab831-4b2c-47e4-a683-83067cc78233" (UID: "006ab831-4b2c-47e4-a683-83067cc78233"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:21:59.886706 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.886602    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-kube-api-access-4tdzz" (OuterVolumeSpecName: "kube-api-access-4tdzz") pod "006ab831-4b2c-47e4-a683-83067cc78233" (UID: "006ab831-4b2c-47e4-a683-83067cc78233"). InnerVolumeSpecName "kube-api-access-4tdzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:21:59.886784 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.886765    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "006ab831-4b2c-47e4-a683-83067cc78233" (UID: "006ab831-4b2c-47e4-a683-83067cc78233"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:21:59.886854 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.886840    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/006ab831-4b2c-47e4-a683-83067cc78233-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "006ab831-4b2c-47e4-a683-83067cc78233" (UID: "006ab831-4b2c-47e4-a683-83067cc78233"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:21:59.986133 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.986109    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/006ab831-4b2c-47e4-a683-83067cc78233-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:59.986133 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.986134    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/006ab831-4b2c-47e4-a683-83067cc78233-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:59.986290 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.986143    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:59.986290 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.986152    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:59.986290 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.986160    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/006ab831-4b2c-47e4-a683-83067cc78233-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:21:59.986290 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:21:59.986186    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tdzz\" (UniqueName: \"kubernetes.io/projected/006ab831-4b2c-47e4-a683-83067cc78233-kube-api-access-4tdzz\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:22:00.404595 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.404556    2579 generic.go:356] "Generic (PLEG): container finished" podID="006ab831-4b2c-47e4-a683-83067cc78233" containerID="fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6" exitCode=0
Jul 27 16:22:00.404774 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.404610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" event={"ID":"006ab831-4b2c-47e4-a683-83067cc78233","Type":"ContainerDied","Data":"fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6"}
Jul 27 16:22:00.404774 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.404678    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2" event={"ID":"006ab831-4b2c-47e4-a683-83067cc78233","Type":"ContainerDied","Data":"3c4dbba018566d256a72a27a4e8abe342a8102cf54036b16781cf481a7c31631"}
Jul 27 16:22:00.404774 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.404624    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"
Jul 27 16:22:00.404952 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.404704    2579 scope.go:117] "RemoveContainer" containerID="fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6"
Jul 27 16:22:00.413855 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.413845    2579 scope.go:117] "RemoveContainer" containerID="d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457"
Jul 27 16:22:00.421812 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.421791    2579 scope.go:117] "RemoveContainer" containerID="fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6"
Jul 27 16:22:00.422066 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:22:00.422036    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6\": container with ID starting with fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6 not found: ID does not exist" containerID="fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6"
Jul 27 16:22:00.422136 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.422070    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6"} err="failed to get container status \"fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6\": rpc error: code = NotFound desc = could not find container \"fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6\": container with ID starting with fbfbc8be62db8a108b8fd1725cb2798ffbc65527448f8085263be8f854d1dec6 not found: ID does not exist"
Jul 27 16:22:00.422136 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.422088    2579 scope.go:117] "RemoveContainer" containerID="d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457"
Jul 27 16:22:00.422313 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:22:00.422297    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457\": container with ID starting with d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457 not found: ID does not exist" containerID="d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457"
Jul 27 16:22:00.422366 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.422318    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457"} err="failed to get container status \"d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457\": rpc error: code = NotFound desc = could not find container \"d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457\": container with ID starting with d24f70254475b6f87a353eccb59df1bf1d94169e6f92671a1fdd3b8009975457 not found: ID does not exist"
Jul 27 16:22:00.430652 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.430622    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"]
Jul 27 16:22:00.444802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:00.444781    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0a85b590-openshift-default-769f97dc76-v5ch2"]
Jul 27 16:22:01.930534 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:22:01.930477    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="006ab831-4b2c-47e4-a683-83067cc78233" path="/var/lib/kubelet/pods/006ab831-4b2c-47e4-a683-83067cc78233/volumes"
Jul 27 16:23:37.128839 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.128805    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"]
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129155    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2cad5c-b5a4-4635-9617-37aaf9ca11ac" containerName="revoke-keys"
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129167    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2cad5c-b5a4-4635-9617-37aaf9ca11ac" containerName="revoke-keys"
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129180    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe84af54-040d-46f7-abdf-7e422ac440e2" containerName="payload-processing"
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129186    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe84af54-040d-46f7-abdf-7e422ac440e2" containerName="payload-processing"
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129195    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy"
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129201    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy"
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129214    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f028d52-7be7-41bf-affd-10545da751a0" containerName="payload-pre-processing"
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129220    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f028d52-7be7-41bf-affd-10545da751a0" containerName="payload-pre-processing"
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129271    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f028d52-7be7-41bf-affd-10545da751a0" containerName="payload-pre-processing"
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129280    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy"
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129293    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe84af54-040d-46f7-abdf-7e422ac440e2" containerName="payload-processing"
Jul 27 16:23:37.129328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.129302    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2cad5c-b5a4-4635-9617-37aaf9ca11ac" containerName="revoke-keys"
Jul 27 16:23:37.132339 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.132322    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.134872 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.134847    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-43178a25-openshift-default-dockercfg-cvr86\""
Jul 27 16:23:37.153489 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.153456    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"]
Jul 27 16:23:37.306443 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.306407    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-envoy\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.306644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.306455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-token\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.306644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.306480    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-data\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.306644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.306588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-podinfo\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.306644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.306624    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istiod-ca-cert\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.306791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.306654    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-socket\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.306791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.306691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-credential-socket\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.306791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.306707    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-certs\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.306791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.306722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhgvr\" (UniqueName: \"kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-kube-api-access-hhgvr\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.407453 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.407364    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-credential-socket\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.407453 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.407404    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-certs\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.407453 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.407427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhgvr\" (UniqueName: \"kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-kube-api-access-hhgvr\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.407791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.407458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-envoy\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.407791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.407513    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-token\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.407791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.407547    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-data\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.407791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.407603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-podinfo\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.407791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.407641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istiod-ca-cert\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.407791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.407690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-socket\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.408082 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.407847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-credential-socket\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.408082 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.407986    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-data\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.408082 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.408005    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-certs\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.408082 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.408027    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-socket\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.408374 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.408352    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istiod-ca-cert\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.409959 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.409932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-envoy\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.410070 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.410017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-podinfo\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.415802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.415778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-token\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.415935 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.415843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhgvr\" (UniqueName: \"kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-kube-api-access-hhgvr\") pod \"e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") " pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.442462 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.442433    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:37.581394 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.581368    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"]
Jul 27 16:23:37.583566 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:23:37.583538    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a39eea7_d4e2_4a5a_b497_02ece9e94de7.slice/crio-b4d9393977ca627a63b9c13503334f322bd824a9fc3b5581cd8d4f8beea8390b WatchSource:0}: Error finding container b4d9393977ca627a63b9c13503334f322bd824a9fc3b5581cd8d4f8beea8390b: Status 404 returned error can't find the container with id b4d9393977ca627a63b9c13503334f322bd824a9fc3b5581cd8d4f8beea8390b
Jul 27 16:23:37.585699 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.585667    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:23:37.585821 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.585752    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:23:37.585821 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.585800    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:23:37.903691 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.903656    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" event={"ID":"1a39eea7-d4e2-4a5a-b497-02ece9e94de7","Type":"ContainerStarted","Data":"26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168"}
Jul 27 16:23:37.903851 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.903736    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" event={"ID":"1a39eea7-d4e2-4a5a-b497-02ece9e94de7","Type":"ContainerStarted","Data":"b4d9393977ca627a63b9c13503334f322bd824a9fc3b5581cd8d4f8beea8390b"}
Jul 27 16:23:37.940689 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:37.940633    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" podStartSLOduration=0.94061754 podStartE2EDuration="940.61754ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:23:37.938003901 +0000 UTC m=+2120.619068332" watchObservedRunningTime="2026-07-27 16:23:37.94061754 +0000 UTC m=+2120.621681969"
Jul 27 16:23:38.442912 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:38.442876    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:38.447608 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:38.447585    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:38.908811 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:38.908780    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:38.909879 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:38.909858    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:40.858003 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:40.857966    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"]
Jul 27 16:23:40.858411 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:40.858325    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy"
Jul 27 16:23:40.858411 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:40.858336    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy"
Jul 27 16:23:40.858411 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:40.858408    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="006ab831-4b2c-47e4-a683-83067cc78233" containerName="istio-proxy"
Jul 27 16:23:40.861570 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:40.861550    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:23:40.863802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:40.863775    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-43178a25-dockercfg-s79gf\""
Jul 27 16:23:40.863911 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:40.863877    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-43178a25\""
Jul 27 16:23:40.872122 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:40.872093    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"]
Jul 27 16:23:40.875666 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:40.875643    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"]
Jul 27 16:23:40.878967 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:40.878950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:23:40.890282 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:40.890254    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"]
Jul 27 16:23:41.041615 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.041580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzjmb\" (UniqueName: \"kubernetes.io/projected/de8a1fa2-4697-4f84-9688-01659254b865-kube-api-access-qzjmb\") pod \"payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq\" (UID: \"de8a1fa2-4697-4f84-9688-01659254b865\") " pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:23:41.041800 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.041622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8a1fa2-4697-4f84-9688-01659254b865-plugins-config-volume\") pod \"payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq\" (UID: \"de8a1fa2-4697-4f84-9688-01659254b865\") " pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:23:41.041800 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.041739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13e0de01-aa97-4bf5-a450-a9caa480ce70-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt\" (UID: \"13e0de01-aa97-4bf5-a450-a9caa480ce70\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:23:41.041922 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.041828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd8zc\" (UniqueName: \"kubernetes.io/projected/13e0de01-aa97-4bf5-a450-a9caa480ce70-kube-api-access-nd8zc\") pod \"payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt\" (UID: \"13e0de01-aa97-4bf5-a450-a9caa480ce70\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:23:41.143001 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.142906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzjmb\" (UniqueName: \"kubernetes.io/projected/de8a1fa2-4697-4f84-9688-01659254b865-kube-api-access-qzjmb\") pod \"payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq\" (UID: \"de8a1fa2-4697-4f84-9688-01659254b865\") " pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:23:41.143001 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.142943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8a1fa2-4697-4f84-9688-01659254b865-plugins-config-volume\") pod \"payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq\" (UID: \"de8a1fa2-4697-4f84-9688-01659254b865\") " pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:23:41.143001 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.142970    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13e0de01-aa97-4bf5-a450-a9caa480ce70-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt\" (UID: \"13e0de01-aa97-4bf5-a450-a9caa480ce70\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:23:41.143001 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.142997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd8zc\" (UniqueName: \"kubernetes.io/projected/13e0de01-aa97-4bf5-a450-a9caa480ce70-kube-api-access-nd8zc\") pod \"payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt\" (UID: \"13e0de01-aa97-4bf5-a450-a9caa480ce70\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:23:41.143833 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.143810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13e0de01-aa97-4bf5-a450-a9caa480ce70-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt\" (UID: \"13e0de01-aa97-4bf5-a450-a9caa480ce70\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:23:41.144025 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.144002    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8a1fa2-4697-4f84-9688-01659254b865-plugins-config-volume\") pod \"payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq\" (UID: \"de8a1fa2-4697-4f84-9688-01659254b865\") " pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:23:41.154856 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.154830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd8zc\" (UniqueName: \"kubernetes.io/projected/13e0de01-aa97-4bf5-a450-a9caa480ce70-kube-api-access-nd8zc\") pod \"payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt\" (UID: \"13e0de01-aa97-4bf5-a450-a9caa480ce70\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:23:41.154950 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.154880    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzjmb\" (UniqueName: \"kubernetes.io/projected/de8a1fa2-4697-4f84-9688-01659254b865-kube-api-access-qzjmb\") pod \"payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq\" (UID: \"de8a1fa2-4697-4f84-9688-01659254b865\") " pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:23:41.174835 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.174810    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:23:41.192037 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.191987    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:23:41.325993 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.325962    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"]
Jul 27 16:23:41.329621 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:23:41.329594    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13e0de01_aa97_4bf5_a450_a9caa480ce70.slice/crio-5cb07633be05e09b3b798edcca5305b28e5a9b13e989b5e3ef3d025dc35ad7ca WatchSource:0}: Error finding container 5cb07633be05e09b3b798edcca5305b28e5a9b13e989b5e3ef3d025dc35ad7ca: Status 404 returned error can't find the container with id 5cb07633be05e09b3b798edcca5305b28e5a9b13e989b5e3ef3d025dc35ad7ca
Jul 27 16:23:41.356877 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.356847    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"]
Jul 27 16:23:41.364721 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:23:41.364685    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8a1fa2_4697_4f84_9688_01659254b865.slice/crio-0cac3efdd9e19e5445aa875c9d0545c98323cd2b9d232b07778564bb2e3d3c17 WatchSource:0}: Error finding container 0cac3efdd9e19e5445aa875c9d0545c98323cd2b9d232b07778564bb2e3d3c17: Status 404 returned error can't find the container with id 0cac3efdd9e19e5445aa875c9d0545c98323cd2b9d232b07778564bb2e3d3c17
Jul 27 16:23:41.932704 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.932672    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt" event={"ID":"13e0de01-aa97-4bf5-a450-a9caa480ce70","Type":"ContainerStarted","Data":"14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10"}
Jul 27 16:23:41.933106 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.932721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt" event={"ID":"13e0de01-aa97-4bf5-a450-a9caa480ce70","Type":"ContainerStarted","Data":"5cb07633be05e09b3b798edcca5305b28e5a9b13e989b5e3ef3d025dc35ad7ca"}
Jul 27 16:23:41.933106 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.932738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq" event={"ID":"de8a1fa2-4697-4f84-9688-01659254b865","Type":"ContainerStarted","Data":"64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5"}
Jul 27 16:23:41.933106 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.932757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq" event={"ID":"de8a1fa2-4697-4f84-9688-01659254b865","Type":"ContainerStarted","Data":"0cac3efdd9e19e5445aa875c9d0545c98323cd2b9d232b07778564bb2e3d3c17"}
Jul 27 16:23:41.933106 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.932776    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:23:41.933106 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.932791    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:23:41.947916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.947815    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt" podStartSLOduration=1.9477954400000002 podStartE2EDuration="1.94779544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:23:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:23:41.947558496 +0000 UTC m=+2124.628622925" watchObservedRunningTime="2026-07-27 16:23:41.94779544 +0000 UTC m=+2124.628859875"
Jul 27 16:23:41.966390 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:41.966327    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq" podStartSLOduration=1.96630485 podStartE2EDuration="1.96630485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:23:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:23:41.96336147 +0000 UTC m=+2124.644425900" watchObservedRunningTime="2026-07-27 16:23:41.96630485 +0000 UTC m=+2124.647369283"
Jul 27 16:23:52.939014 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:52.938978    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:23:53.910402 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:53.910358    2579 patch_prober.go:28] interesting pod/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 27 16:23:53.910652 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:53.910435    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 27 16:23:53.944669 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:53.944635    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:23:54.006239 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:54.006206    2579 generic.go:356] "Generic (PLEG): container finished" podID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerID="26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168" exitCode=0
Jul 27 16:23:54.006422 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:54.006285    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" event={"ID":"1a39eea7-d4e2-4a5a-b497-02ece9e94de7","Type":"ContainerDied","Data":"26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168"}
Jul 27 16:23:54.006761 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:54.006744    2579 scope.go:117] "RemoveContainer" containerID="26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168"
Jul 27 16:23:54.007814 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:54.007787    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:23:54.007906 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:54.007891    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:23:54.007947 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:54.007935    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:23:55.014285 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:55.014248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" event={"ID":"1a39eea7-d4e2-4a5a-b497-02ece9e94de7","Type":"ContainerStarted","Data":"43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b"}
Jul 27 16:23:55.443250 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:55.443203    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:55.443669 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:55.443642    2579 patch_prober.go:28] interesting pod/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 27 16:23:55.443886 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:55.443860    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 27 16:23:56.443368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:56.443313    2579 patch_prober.go:28] interesting pod/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 27 16:23:56.443933 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:56.443395    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 27 16:23:57.443269 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:57.443220    2579 patch_prober.go:28] interesting pod/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 27 16:23:57.443533 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:57.443307    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 27 16:23:58.456521 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:58.445946    2579 patch_prober.go:28] interesting pod/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Jul 27 16:23:58.456521 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:58.446013    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Jul 27 16:23:59.447595 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:59.447562    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:59.447914 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:59.447893    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:23:59.448636 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:23:59.448612    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:24:02.464982 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.464944    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"]
Jul 27 16:24:02.465483 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.465151    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq" podUID="de8a1fa2-4697-4f84-9688-01659254b865" containerName="payload-processing" containerID="cri-o://64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5" gracePeriod=30
Jul 27 16:24:02.475077 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.475048    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"]
Jul 27 16:24:02.475295 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.475272    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt" podUID="13e0de01-aa97-4bf5-a450-a9caa480ce70" containerName="payload-pre-processing" containerID="cri-o://14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10" gracePeriod=30
Jul 27 16:24:02.732332 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.732308    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:24:02.766692 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.766660    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:24:02.839137 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.839103    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd8zc\" (UniqueName: \"kubernetes.io/projected/13e0de01-aa97-4bf5-a450-a9caa480ce70-kube-api-access-nd8zc\") pod \"13e0de01-aa97-4bf5-a450-a9caa480ce70\" (UID: \"13e0de01-aa97-4bf5-a450-a9caa480ce70\") "
Jul 27 16:24:02.839137 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.839142    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzjmb\" (UniqueName: \"kubernetes.io/projected/de8a1fa2-4697-4f84-9688-01659254b865-kube-api-access-qzjmb\") pod \"de8a1fa2-4697-4f84-9688-01659254b865\" (UID: \"de8a1fa2-4697-4f84-9688-01659254b865\") "
Jul 27 16:24:02.839402 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.839205    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13e0de01-aa97-4bf5-a450-a9caa480ce70-plugins-config-volume\") pod \"13e0de01-aa97-4bf5-a450-a9caa480ce70\" (UID: \"13e0de01-aa97-4bf5-a450-a9caa480ce70\") "
Jul 27 16:24:02.839402 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.839238    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8a1fa2-4697-4f84-9688-01659254b865-plugins-config-volume\") pod \"de8a1fa2-4697-4f84-9688-01659254b865\" (UID: \"de8a1fa2-4697-4f84-9688-01659254b865\") "
Jul 27 16:24:02.839676 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.839650    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13e0de01-aa97-4bf5-a450-a9caa480ce70-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "13e0de01-aa97-4bf5-a450-a9caa480ce70" (UID: "13e0de01-aa97-4bf5-a450-a9caa480ce70"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:24:02.839742 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.839678    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de8a1fa2-4697-4f84-9688-01659254b865-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de8a1fa2-4697-4f84-9688-01659254b865" (UID: "de8a1fa2-4697-4f84-9688-01659254b865"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:24:02.841257 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.841237    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de8a1fa2-4697-4f84-9688-01659254b865-kube-api-access-qzjmb" (OuterVolumeSpecName: "kube-api-access-qzjmb") pod "de8a1fa2-4697-4f84-9688-01659254b865" (UID: "de8a1fa2-4697-4f84-9688-01659254b865"). InnerVolumeSpecName "kube-api-access-qzjmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:24:02.841307 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.841277    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13e0de01-aa97-4bf5-a450-a9caa480ce70-kube-api-access-nd8zc" (OuterVolumeSpecName: "kube-api-access-nd8zc") pod "13e0de01-aa97-4bf5-a450-a9caa480ce70" (UID: "13e0de01-aa97-4bf5-a450-a9caa480ce70"). InnerVolumeSpecName "kube-api-access-nd8zc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:24:02.939982 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.939941    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/13e0de01-aa97-4bf5-a450-a9caa480ce70-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:02.939982 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.939971    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de8a1fa2-4697-4f84-9688-01659254b865-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:02.939982 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.939982    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd8zc\" (UniqueName: \"kubernetes.io/projected/13e0de01-aa97-4bf5-a450-a9caa480ce70-kube-api-access-nd8zc\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:02.939982 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:02.939991    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzjmb\" (UniqueName: \"kubernetes.io/projected/de8a1fa2-4697-4f84-9688-01659254b865-kube-api-access-qzjmb\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:03.059053 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.059009    2579 generic.go:356] "Generic (PLEG): container finished" podID="13e0de01-aa97-4bf5-a450-a9caa480ce70" containerID="14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10" exitCode=0
Jul 27 16:24:03.059236 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.059081    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"
Jul 27 16:24:03.059236 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.059100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt" event={"ID":"13e0de01-aa97-4bf5-a450-a9caa480ce70","Type":"ContainerDied","Data":"14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10"}
Jul 27 16:24:03.059236 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.059196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt" event={"ID":"13e0de01-aa97-4bf5-a450-a9caa480ce70","Type":"ContainerDied","Data":"5cb07633be05e09b3b798edcca5305b28e5a9b13e989b5e3ef3d025dc35ad7ca"}
Jul 27 16:24:03.059236 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.059222    2579 scope.go:117] "RemoveContainer" containerID="14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10"
Jul 27 16:24:03.060677 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.060657    2579 generic.go:356] "Generic (PLEG): container finished" podID="de8a1fa2-4697-4f84-9688-01659254b865" containerID="64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5" exitCode=0
Jul 27 16:24:03.060806 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.060724    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"
Jul 27 16:24:03.060806 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.060743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq" event={"ID":"de8a1fa2-4697-4f84-9688-01659254b865","Type":"ContainerDied","Data":"64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5"}
Jul 27 16:24:03.060806 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.060798    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq" event={"ID":"de8a1fa2-4697-4f84-9688-01659254b865","Type":"ContainerDied","Data":"0cac3efdd9e19e5445aa875c9d0545c98323cd2b9d232b07778564bb2e3d3c17"}
Jul 27 16:24:03.068284 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.068267    2579 scope.go:117] "RemoveContainer" containerID="14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10"
Jul 27 16:24:03.068647 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:24:03.068623    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10\": container with ID starting with 14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10 not found: ID does not exist" containerID="14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10"
Jul 27 16:24:03.068726 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.068662    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10"} err="failed to get container status \"14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10\": rpc error: code = NotFound desc = could not find container \"14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10\": container with ID starting with 14636a788572b3732f9aec094ad7ac7cc89e8fc18243d998f98329646567bb10 not found: ID does not exist"
Jul 27 16:24:03.068726 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.068687    2579 scope.go:117] "RemoveContainer" containerID="64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5"
Jul 27 16:24:03.077406 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.077390    2579 scope.go:117] "RemoveContainer" containerID="64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5"
Jul 27 16:24:03.077680 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:24:03.077664    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5\": container with ID starting with 64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5 not found: ID does not exist" containerID="64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5"
Jul 27 16:24:03.077721 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.077687    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5"} err="failed to get container status \"64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5\": rpc error: code = NotFound desc = could not find container \"64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5\": container with ID starting with 64b860bc17febe1bee57faf65610a86a1c72f82fab1d2482de91be5c4fc479d5 not found: ID does not exist"
Jul 27 16:24:03.085487 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.085462    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"]
Jul 27 16:24:03.089235 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.089212    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-43178a25-7d75cf8dd8-f6qnt"]
Jul 27 16:24:03.101009 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.100921    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"]
Jul 27 16:24:03.103151 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.103131    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-43178a25-7d4694b4cd-rv2nq"]
Jul 27 16:24:03.930802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.930771    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13e0de01-aa97-4bf5-a450-a9caa480ce70" path="/var/lib/kubelet/pods/13e0de01-aa97-4bf5-a450-a9caa480ce70/volumes"
Jul 27 16:24:03.931180 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:03.931137    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de8a1fa2-4697-4f84-9688-01659254b865" path="/var/lib/kubelet/pods/de8a1fa2-4697-4f84-9688-01659254b865/volumes"
Jul 27 16:24:13.750900 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:13.750815    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"]
Jul 27 16:24:13.751464 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:13.751052    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy" containerID="cri-o://43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b" gracePeriod=30
Jul 27 16:24:14.450844 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:14.450803    2579 patch_prober.go:28] interesting pod/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 16:24:14.451016 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:14.450869    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 16:24:19.009532 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.009487    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:24:19.078037 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.077995    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-envoy\") pod \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") "
Jul 27 16:24:19.078037 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078036    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhgvr\" (UniqueName: \"kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-kube-api-access-hhgvr\") pod \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") "
Jul 27 16:24:19.078307 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078093    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-socket\") pod \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") "
Jul 27 16:24:19.078307 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078112    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-certs\") pod \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") "
Jul 27 16:24:19.078418 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078343    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-podinfo\") pod \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") "
Jul 27 16:24:19.078418 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078375    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a39eea7-d4e2-4a5a-b497-02ece9e94de7" (UID: "1a39eea7-d4e2-4a5a-b497-02ece9e94de7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:24:19.078559 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078392    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-token\") pod \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") "
Jul 27 16:24:19.078559 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078438    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a39eea7-d4e2-4a5a-b497-02ece9e94de7" (UID: "1a39eea7-d4e2-4a5a-b497-02ece9e94de7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:24:19.078559 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078455    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istiod-ca-cert\") pod \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") "
Jul 27 16:24:19.078559 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078520    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-data\") pod \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") "
Jul 27 16:24:19.078559 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078556    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-credential-socket\") pod \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\" (UID: \"1a39eea7-d4e2-4a5a-b497-02ece9e94de7\") "
Jul 27 16:24:19.078867 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078797    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a39eea7-d4e2-4a5a-b497-02ece9e94de7" (UID: "1a39eea7-d4e2-4a5a-b497-02ece9e94de7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:24:19.078927 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078891    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:19.078927 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078907    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:19.079042 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078985    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a39eea7-d4e2-4a5a-b497-02ece9e94de7" (UID: "1a39eea7-d4e2-4a5a-b497-02ece9e94de7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:24:19.079042 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.078994    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:19.079342 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.079320    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a39eea7-d4e2-4a5a-b497-02ece9e94de7" (UID: "1a39eea7-d4e2-4a5a-b497-02ece9e94de7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:24:19.080405 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.080382    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a39eea7-d4e2-4a5a-b497-02ece9e94de7" (UID: "1a39eea7-d4e2-4a5a-b497-02ece9e94de7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:24:19.080405 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.080380    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a39eea7-d4e2-4a5a-b497-02ece9e94de7" (UID: "1a39eea7-d4e2-4a5a-b497-02ece9e94de7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:24:19.080799 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.080775    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-kube-api-access-hhgvr" (OuterVolumeSpecName: "kube-api-access-hhgvr") pod "1a39eea7-d4e2-4a5a-b497-02ece9e94de7" (UID: "1a39eea7-d4e2-4a5a-b497-02ece9e94de7"). InnerVolumeSpecName "kube-api-access-hhgvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:24:19.080799 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.080775    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a39eea7-d4e2-4a5a-b497-02ece9e94de7" (UID: "1a39eea7-d4e2-4a5a-b497-02ece9e94de7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:24:19.150605 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.150567    2579 generic.go:356] "Generic (PLEG): container finished" podID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerID="43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b" exitCode=0
Jul 27 16:24:19.150796 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.150624    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"
Jul 27 16:24:19.150796 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.150661    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" event={"ID":"1a39eea7-d4e2-4a5a-b497-02ece9e94de7","Type":"ContainerDied","Data":"43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b"}
Jul 27 16:24:19.150796 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.150741    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8" event={"ID":"1a39eea7-d4e2-4a5a-b497-02ece9e94de7","Type":"ContainerDied","Data":"b4d9393977ca627a63b9c13503334f322bd824a9fc3b5581cd8d4f8beea8390b"}
Jul 27 16:24:19.150796 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.150766    2579 scope.go:117] "RemoveContainer" containerID="43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b"
Jul 27 16:24:19.160026 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.160008    2579 scope.go:117] "RemoveContainer" containerID="26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168"
Jul 27 16:24:19.168325 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.168304    2579 scope.go:117] "RemoveContainer" containerID="43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b"
Jul 27 16:24:19.168633 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:24:19.168610    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b\": container with ID starting with 43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b not found: ID does not exist" containerID="43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b"
Jul 27 16:24:19.168692 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.168647    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b"} err="failed to get container status \"43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b\": rpc error: code = NotFound desc = could not find container \"43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b\": container with ID starting with 43130f4fd0586defd39dbb2765106a79e8b99e23807a23ed17f37df5593a5c8b not found: ID does not exist"
Jul 27 16:24:19.168692 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.168666    2579 scope.go:117] "RemoveContainer" containerID="26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168"
Jul 27 16:24:19.168917 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:24:19.168892    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168\": container with ID starting with 26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168 not found: ID does not exist" containerID="26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168"
Jul 27 16:24:19.168975 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.168927    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168"} err="failed to get container status \"26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168\": rpc error: code = NotFound desc = could not find container \"26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168\": container with ID starting with 26b68ce127ddf4747fed3e5eedb63bc7c618de1e8721fc153874f33d7b04d168 not found: ID does not exist"
Jul 27 16:24:19.173542 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.173516    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"]
Jul 27 16:24:19.180139 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.180116    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:19.180139 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.180139    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhgvr\" (UniqueName: \"kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-kube-api-access-hhgvr\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:19.180300 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.180151    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:19.180300 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.180161    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:19.180300 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.180162    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-43178a25-openshift-default-6f6675f5cb-xvhx8"]
Jul 27 16:24:19.180300 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.180169    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:19.180300 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.180224    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a39eea7-d4e2-4a5a-b497-02ece9e94de7-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:24:19.930762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:19.930729    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" path="/var/lib/kubelet/pods/1a39eea7-d4e2-4a5a-b497-02ece9e94de7/volumes"
Jul 27 16:24:33.930708 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.930679    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"]
Jul 27 16:24:33.931092 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931026    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13e0de01-aa97-4bf5-a450-a9caa480ce70" containerName="payload-pre-processing"
Jul 27 16:24:33.931092 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931040    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e0de01-aa97-4bf5-a450-a9caa480ce70" containerName="payload-pre-processing"
Jul 27 16:24:33.931092 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931051    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy"
Jul 27 16:24:33.931092 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931056    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy"
Jul 27 16:24:33.931092 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931065    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy"
Jul 27 16:24:33.931092 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931071    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy"
Jul 27 16:24:33.931092 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931088    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de8a1fa2-4697-4f84-9688-01659254b865" containerName="payload-processing"
Jul 27 16:24:33.931092 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931094    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8a1fa2-4697-4f84-9688-01659254b865" containerName="payload-processing"
Jul 27 16:24:33.931345 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931152    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="de8a1fa2-4697-4f84-9688-01659254b865" containerName="payload-processing"
Jul 27 16:24:33.931345 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931160    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy"
Jul 27 16:24:33.931345 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931169    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a39eea7-d4e2-4a5a-b497-02ece9e94de7" containerName="istio-proxy"
Jul 27 16:24:33.931345 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.931179    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="13e0de01-aa97-4bf5-a450-a9caa480ce70" containerName="payload-pre-processing"
Jul 27 16:24:33.934021 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.934002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:33.936199 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.936178    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e1cdb3d5-openshift-default-dockercfg-89n6q\""
Jul 27 16:24:33.942745 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:33.942717    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"]
Jul 27 16:24:34.110723 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.110687    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-socket\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.110907 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.110728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-certs\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.110907 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.110800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-data\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.110907 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.110833    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr72g\" (UniqueName: \"kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-kube-api-access-pr72g\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.110907 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.110863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-credential-socket\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.111104 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.110912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-podinfo\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.111104 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.110937    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istiod-ca-cert\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.111104 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.110975    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-envoy\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.111104 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.111028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-token\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.212641 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.212519    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr72g\" (UniqueName: \"kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-kube-api-access-pr72g\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.212641 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.212587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-credential-socket\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.212641 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.212635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-podinfo\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.212940 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.212652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istiod-ca-cert\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.212940 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.212681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-envoy\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.212940 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.212704    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-token\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.212940 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.212741    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-socket\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.212940 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.212766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-certs\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.212940 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.212826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-data\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.213264 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.213135    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-credential-socket\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.213264 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.213221    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-data\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.213379 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.213279    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-socket\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.213379 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.213333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-certs\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.213512 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.213443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istiod-ca-cert\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.215067 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.215045    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-envoy\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.215285 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.215267    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-podinfo\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.221039 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.221015    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-token\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.221121 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.221040    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr72g\" (UniqueName: \"kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-kube-api-access-pr72g\") pod \"e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") " pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.246850 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.246821    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:34.386236 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.386209    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"]
Jul 27 16:24:34.388132 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:24:34.388095    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a99ecb8_a458_4a61_a4c8_0b060dc0a83e.slice/crio-f9c8fc2d14e3f6f0c96db0718bf2f2886c9afb7a621cb9219ae7eb4ecec353ce WatchSource:0}: Error finding container f9c8fc2d14e3f6f0c96db0718bf2f2886c9afb7a621cb9219ae7eb4ecec353ce: Status 404 returned error can't find the container with id f9c8fc2d14e3f6f0c96db0718bf2f2886c9afb7a621cb9219ae7eb4ecec353ce
Jul 27 16:24:34.390185 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.390153    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:24:34.390262 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.390218    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:24:34.390262 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:34.390246    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:24:35.240322 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:35.240283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" event={"ID":"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e","Type":"ContainerStarted","Data":"6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015"}
Jul 27 16:24:35.240760 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:35.240339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" event={"ID":"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e","Type":"ContainerStarted","Data":"f9c8fc2d14e3f6f0c96db0718bf2f2886c9afb7a621cb9219ae7eb4ecec353ce"}
Jul 27 16:24:35.247903 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:35.247885    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:35.252680 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:35.252652    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:35.270751 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:35.270701    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" podStartSLOduration=2.270685365 podStartE2EDuration="2.270685365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:35.267404295 +0000 UTC m=+2177.948468750" watchObservedRunningTime="2026-07-27 16:24:35.270685365 +0000 UTC m=+2177.951749795"
Jul 27 16:24:36.245885 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:36.245849    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:36.246910 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:36.246888    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:38.229871 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.229835    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"]
Jul 27 16:24:38.233112 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.233089    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:24:38.235339 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.235316    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e1cdb3d5-dockercfg-5mklk\""
Jul 27 16:24:38.235460 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.235343    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e1cdb3d5\""
Jul 27 16:24:38.242550 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.242523    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"]
Jul 27 16:24:38.278213 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.278167    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"]
Jul 27 16:24:38.282035 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.282010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:24:38.289635 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.289604    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"]
Jul 27 16:24:38.351976 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.351928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4rll\" (UniqueName: \"kubernetes.io/projected/6b6039c9-a50e-4b25-a4cc-f3b997961727-kube-api-access-n4rll\") pod \"payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf\" (UID: \"6b6039c9-a50e-4b25-a4cc-f3b997961727\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:24:38.351976 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.351973    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b6039c9-a50e-4b25-a4cc-f3b997961727-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf\" (UID: \"6b6039c9-a50e-4b25-a4cc-f3b997961727\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:24:38.453322 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.453285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtr7l\" (UniqueName: \"kubernetes.io/projected/60017919-e768-4f0e-99df-6d08e16f2b61-kube-api-access-gtr7l\") pod \"payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z\" (UID: \"60017919-e768-4f0e-99df-6d08e16f2b61\") " pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:24:38.453515 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.453406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60017919-e768-4f0e-99df-6d08e16f2b61-plugins-config-volume\") pod \"payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z\" (UID: \"60017919-e768-4f0e-99df-6d08e16f2b61\") " pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:24:38.453515 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.453474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4rll\" (UniqueName: \"kubernetes.io/projected/6b6039c9-a50e-4b25-a4cc-f3b997961727-kube-api-access-n4rll\") pod \"payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf\" (UID: \"6b6039c9-a50e-4b25-a4cc-f3b997961727\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:24:38.453742 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.453559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b6039c9-a50e-4b25-a4cc-f3b997961727-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf\" (UID: \"6b6039c9-a50e-4b25-a4cc-f3b997961727\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:24:38.454395 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.454372    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b6039c9-a50e-4b25-a4cc-f3b997961727-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf\" (UID: \"6b6039c9-a50e-4b25-a4cc-f3b997961727\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:24:38.462313 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.462288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4rll\" (UniqueName: \"kubernetes.io/projected/6b6039c9-a50e-4b25-a4cc-f3b997961727-kube-api-access-n4rll\") pod \"payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf\" (UID: \"6b6039c9-a50e-4b25-a4cc-f3b997961727\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:24:38.545171 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.545143    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:24:38.554534 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.554486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtr7l\" (UniqueName: \"kubernetes.io/projected/60017919-e768-4f0e-99df-6d08e16f2b61-kube-api-access-gtr7l\") pod \"payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z\" (UID: \"60017919-e768-4f0e-99df-6d08e16f2b61\") " pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:24:38.554676 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.554612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60017919-e768-4f0e-99df-6d08e16f2b61-plugins-config-volume\") pod \"payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z\" (UID: \"60017919-e768-4f0e-99df-6d08e16f2b61\") " pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:24:38.555278 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.555255    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60017919-e768-4f0e-99df-6d08e16f2b61-plugins-config-volume\") pod \"payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z\" (UID: \"60017919-e768-4f0e-99df-6d08e16f2b61\") " pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:24:38.563107 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.563074    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtr7l\" (UniqueName: \"kubernetes.io/projected/60017919-e768-4f0e-99df-6d08e16f2b61-kube-api-access-gtr7l\") pod \"payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z\" (UID: \"60017919-e768-4f0e-99df-6d08e16f2b61\") " pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:24:38.597852 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.597815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:24:38.687344 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.687312    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"]
Jul 27 16:24:38.688363 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:24:38.688334    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6039c9_a50e_4b25_a4cc_f3b997961727.slice/crio-af4b36df6500ad388ccf7c412e8bd8e3be4636e29a885f8670ce145e8d0ba2ad WatchSource:0}: Error finding container af4b36df6500ad388ccf7c412e8bd8e3be4636e29a885f8670ce145e8d0ba2ad: Status 404 returned error can't find the container with id af4b36df6500ad388ccf7c412e8bd8e3be4636e29a885f8670ce145e8d0ba2ad
Jul 27 16:24:38.757640 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:38.757611    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"]
Jul 27 16:24:38.757750 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:24:38.757660    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60017919_e768_4f0e_99df_6d08e16f2b61.slice/crio-4723ccc79ecc6491f7c271734b955c950e257faca6776a6570f7f5f8374a405c WatchSource:0}: Error finding container 4723ccc79ecc6491f7c271734b955c950e257faca6776a6570f7f5f8374a405c: Status 404 returned error can't find the container with id 4723ccc79ecc6491f7c271734b955c950e257faca6776a6570f7f5f8374a405c
Jul 27 16:24:39.268005 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:39.267893    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf" event={"ID":"6b6039c9-a50e-4b25-a4cc-f3b997961727","Type":"ContainerStarted","Data":"458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232"}
Jul 27 16:24:39.268005 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:39.267966    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:24:39.268005 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:39.267996    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf" event={"ID":"6b6039c9-a50e-4b25-a4cc-f3b997961727","Type":"ContainerStarted","Data":"af4b36df6500ad388ccf7c412e8bd8e3be4636e29a885f8670ce145e8d0ba2ad"}
Jul 27 16:24:39.269509 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:39.269462    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z" event={"ID":"60017919-e768-4f0e-99df-6d08e16f2b61","Type":"ContainerStarted","Data":"bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e"}
Jul 27 16:24:39.269620 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:39.269538    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:24:39.269620 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:39.269556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z" event={"ID":"60017919-e768-4f0e-99df-6d08e16f2b61","Type":"ContainerStarted","Data":"4723ccc79ecc6491f7c271734b955c950e257faca6776a6570f7f5f8374a405c"}
Jul 27 16:24:39.286322 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:39.286270    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf" podStartSLOduration=1.28625433 podStartE2EDuration="1.28625433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:39.284431951 +0000 UTC m=+2181.965496382" watchObservedRunningTime="2026-07-27 16:24:39.28625433 +0000 UTC m=+2181.967318797"
Jul 27 16:24:39.305042 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:39.304974    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z" podStartSLOduration=1.304959212 podStartE2EDuration="1.304959212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:24:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:24:39.30273629 +0000 UTC m=+2181.983800736" watchObservedRunningTime="2026-07-27 16:24:39.304959212 +0000 UTC m=+2181.986023641"
Jul 27 16:24:50.277193 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:50.277156    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:24:50.277679 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:50.277567    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:24:51.709382 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:51.709344    2579 patch_prober.go:28] interesting pod/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": read tcp 10.132.0.2:60404->10.132.0.63:15021: read: connection reset by peer" start-of-body=
Jul 27 16:24:51.709804 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:51.709437    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": read tcp 10.132.0.2:60404->10.132.0.63:15021: read: connection reset by peer"
Jul 27 16:24:52.341810 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:52.341776    2579 generic.go:356] "Generic (PLEG): container finished" podID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerID="6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015" exitCode=0
Jul 27 16:24:52.342001 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:52.341850    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" event={"ID":"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e","Type":"ContainerDied","Data":"6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015"}
Jul 27 16:24:52.342287 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:52.342269    2579 scope.go:117] "RemoveContainer" containerID="6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015"
Jul 27 16:24:52.343297 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:52.343273    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:24:52.343352 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:52.343338    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:24:52.343395 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:52.343369    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:24:53.349659 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:53.349624    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" event={"ID":"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e","Type":"ContainerStarted","Data":"3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba"}
Jul 27 16:24:54.247134 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:54.247095    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:24:54.247461 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:54.247436    2579 patch_prober.go:28] interesting pod/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 27 16:24:54.247545 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:54.247488    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 27 16:24:55.247912 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:55.247867    2579 patch_prober.go:28] interesting pod/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 27 16:24:55.248337 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:55.247961    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 27 16:24:56.247477 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:56.247429    2579 patch_prober.go:28] interesting pod/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 27 16:24:56.247714 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:56.247518    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 27 16:24:57.247637 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:57.247584    2579 patch_prober.go:28] interesting pod/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 27 16:24:57.248166 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:57.247663    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 27 16:24:58.248080 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:58.248042    2579 patch_prober.go:28] interesting pod/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 27 16:24:58.248710 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:58.248678    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 27 16:24:59.248046 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:59.248005    2579 patch_prober.go:28] interesting pod/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 27 16:24:59.248363 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:24:59.248333    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 27 16:25:00.250944 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:00.250906    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:25:00.251322 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:00.251204    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:25:00.251909 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:00.251890    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:25:37.125043 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.125002    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"]
Jul 27 16:25:37.125573 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.125309    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z" podUID="60017919-e768-4f0e-99df-6d08e16f2b61" containerName="payload-processing" containerID="cri-o://bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e" gracePeriod=30
Jul 27 16:25:37.134468 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.134439    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"]
Jul 27 16:25:37.134764 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.134732    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf" podUID="6b6039c9-a50e-4b25-a4cc-f3b997961727" containerName="payload-pre-processing" containerID="cri-o://458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232" gracePeriod=30
Jul 27 16:25:37.426658 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.426634    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:25:37.429478 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.429458    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:25:37.585284 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.585246    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b6039c9-a50e-4b25-a4cc-f3b997961727-plugins-config-volume\") pod \"6b6039c9-a50e-4b25-a4cc-f3b997961727\" (UID: \"6b6039c9-a50e-4b25-a4cc-f3b997961727\") "
Jul 27 16:25:37.585507 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.585293    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60017919-e768-4f0e-99df-6d08e16f2b61-plugins-config-volume\") pod \"60017919-e768-4f0e-99df-6d08e16f2b61\" (UID: \"60017919-e768-4f0e-99df-6d08e16f2b61\") "
Jul 27 16:25:37.585507 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.585373    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4rll\" (UniqueName: \"kubernetes.io/projected/6b6039c9-a50e-4b25-a4cc-f3b997961727-kube-api-access-n4rll\") pod \"6b6039c9-a50e-4b25-a4cc-f3b997961727\" (UID: \"6b6039c9-a50e-4b25-a4cc-f3b997961727\") "
Jul 27 16:25:37.585507 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.585394    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtr7l\" (UniqueName: \"kubernetes.io/projected/60017919-e768-4f0e-99df-6d08e16f2b61-kube-api-access-gtr7l\") pod \"60017919-e768-4f0e-99df-6d08e16f2b61\" (UID: \"60017919-e768-4f0e-99df-6d08e16f2b61\") "
Jul 27 16:25:37.585684 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.585649    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b6039c9-a50e-4b25-a4cc-f3b997961727-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6b6039c9-a50e-4b25-a4cc-f3b997961727" (UID: "6b6039c9-a50e-4b25-a4cc-f3b997961727"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:25:37.585790 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.585765    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60017919-e768-4f0e-99df-6d08e16f2b61-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "60017919-e768-4f0e-99df-6d08e16f2b61" (UID: "60017919-e768-4f0e-99df-6d08e16f2b61"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:25:37.587589 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.587557    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b6039c9-a50e-4b25-a4cc-f3b997961727-kube-api-access-n4rll" (OuterVolumeSpecName: "kube-api-access-n4rll") pod "6b6039c9-a50e-4b25-a4cc-f3b997961727" (UID: "6b6039c9-a50e-4b25-a4cc-f3b997961727"). InnerVolumeSpecName "kube-api-access-n4rll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:25:37.587705 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.587607    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60017919-e768-4f0e-99df-6d08e16f2b61-kube-api-access-gtr7l" (OuterVolumeSpecName: "kube-api-access-gtr7l") pod "60017919-e768-4f0e-99df-6d08e16f2b61" (UID: "60017919-e768-4f0e-99df-6d08e16f2b61"). InnerVolumeSpecName "kube-api-access-gtr7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:25:37.598347 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.598319    2579 generic.go:356] "Generic (PLEG): container finished" podID="6b6039c9-a50e-4b25-a4cc-f3b997961727" containerID="458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232" exitCode=0
Jul 27 16:25:37.598485 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.598365    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"
Jul 27 16:25:37.598485 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.598373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf" event={"ID":"6b6039c9-a50e-4b25-a4cc-f3b997961727","Type":"ContainerDied","Data":"458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232"}
Jul 27 16:25:37.598485 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.598427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf" event={"ID":"6b6039c9-a50e-4b25-a4cc-f3b997961727","Type":"ContainerDied","Data":"af4b36df6500ad388ccf7c412e8bd8e3be4636e29a885f8670ce145e8d0ba2ad"}
Jul 27 16:25:37.598485 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.598453    2579 scope.go:117] "RemoveContainer" containerID="458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232"
Jul 27 16:25:37.599817 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.599797    2579 generic.go:356] "Generic (PLEG): container finished" podID="60017919-e768-4f0e-99df-6d08e16f2b61" containerID="bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e" exitCode=0
Jul 27 16:25:37.599932 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.599836    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"
Jul 27 16:25:37.599932 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.599870    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z" event={"ID":"60017919-e768-4f0e-99df-6d08e16f2b61","Type":"ContainerDied","Data":"bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e"}
Jul 27 16:25:37.599932 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.599919    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z" event={"ID":"60017919-e768-4f0e-99df-6d08e16f2b61","Type":"ContainerDied","Data":"4723ccc79ecc6491f7c271734b955c950e257faca6776a6570f7f5f8374a405c"}
Jul 27 16:25:37.608917 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.608893    2579 scope.go:117] "RemoveContainer" containerID="458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232"
Jul 27 16:25:37.609206 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:25:37.609187    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232\": container with ID starting with 458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232 not found: ID does not exist" containerID="458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232"
Jul 27 16:25:37.609289 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.609214    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232"} err="failed to get container status \"458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232\": rpc error: code = NotFound desc = could not find container \"458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232\": container with ID starting with 458d77c51c968f46376555bc9065de019dd94a30676fe65e1a11bc2b0d211232 not found: ID does not exist"
Jul 27 16:25:37.609289 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.609232    2579 scope.go:117] "RemoveContainer" containerID="bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e"
Jul 27 16:25:37.617581 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.617563    2579 scope.go:117] "RemoveContainer" containerID="bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e"
Jul 27 16:25:37.617841 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:25:37.617820    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e\": container with ID starting with bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e not found: ID does not exist" containerID="bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e"
Jul 27 16:25:37.617905 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.617847    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e"} err="failed to get container status \"bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e\": rpc error: code = NotFound desc = could not find container \"bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e\": container with ID starting with bb7572a0a56d1c4034332d70d0859eea421934ea2e4e0dd7e9f914010c36318e not found: ID does not exist"
Jul 27 16:25:37.621076 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.621054    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"]
Jul 27 16:25:37.625387 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.625364    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-e1cdb3d5-5bfcbbf96d-srvzf"]
Jul 27 16:25:37.636901 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.636877    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"]
Jul 27 16:25:37.642559 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.642539    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e1cdb3d5-85ccb787c4-pk82z"]
Jul 27 16:25:37.686212 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.686138    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4rll\" (UniqueName: \"kubernetes.io/projected/6b6039c9-a50e-4b25-a4cc-f3b997961727-kube-api-access-n4rll\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:25:37.686212 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.686162    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtr7l\" (UniqueName: \"kubernetes.io/projected/60017919-e768-4f0e-99df-6d08e16f2b61-kube-api-access-gtr7l\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:25:37.686212 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.686174    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6b6039c9-a50e-4b25-a4cc-f3b997961727-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:25:37.686212 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.686183    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/60017919-e768-4f0e-99df-6d08e16f2b61-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:25:37.930510 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.930473    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60017919-e768-4f0e-99df-6d08e16f2b61" path="/var/lib/kubelet/pods/60017919-e768-4f0e-99df-6d08e16f2b61/volumes"
Jul 27 16:25:37.930861 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:25:37.930848    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b6039c9-a50e-4b25-a4cc-f3b997961727" path="/var/lib/kubelet/pods/6b6039c9-a50e-4b25-a4cc-f3b997961727/volumes"
Jul 27 16:26:34.552767 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:34.552727    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"]
Jul 27 16:26:34.553264 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:34.552957    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy" containerID="cri-o://3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba" gracePeriod=30
Jul 27 16:26:39.802681 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.802657    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:26:39.830315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.830209    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-podinfo\") pod \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") "
Jul 27 16:26:39.830315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.830252    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-envoy\") pod \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") "
Jul 27 16:26:39.830528 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.830350    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr72g\" (UniqueName: \"kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-kube-api-access-pr72g\") pod \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") "
Jul 27 16:26:39.830528 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.830381    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-token\") pod \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") "
Jul 27 16:26:39.830528 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.830414    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istiod-ca-cert\") pod \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") "
Jul 27 16:26:39.830528 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.830449    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-socket\") pod \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") "
Jul 27 16:26:39.830528 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.830479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-certs\") pod \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") "
Jul 27 16:26:39.830528 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.830516    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-data\") pod \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") "
Jul 27 16:26:39.830817 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.830549    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-credential-socket\") pod \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\" (UID: \"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e\") "
Jul 27 16:26:39.830871 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.830837    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" (UID: "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:26:39.831020 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.830992    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" (UID: "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:26:39.831106 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.831062    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" (UID: "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:26:39.831364 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.831338    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" (UID: "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:26:39.831830 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.831802    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" (UID: "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:26:39.833381 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.833356    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-kube-api-access-pr72g" (OuterVolumeSpecName: "kube-api-access-pr72g") pod "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" (UID: "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e"). InnerVolumeSpecName "kube-api-access-pr72g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:26:39.833612 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.833595    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" (UID: "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:26:39.833741 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.833721    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" (UID: "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:26:39.833788 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.833731    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" (UID: "9a99ecb8-a458-4a61-a4c8-0b060dc0a83e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:26:39.931240 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.931213    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:26:39.931240 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.931238    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:26:39.931240 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.931250    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:26:39.931484 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.931263    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:26:39.931484 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.931275    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:26:39.931484 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.931285    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr72g\" (UniqueName: \"kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-kube-api-access-pr72g\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:26:39.931484 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.931298    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:26:39.931484 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.931309    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:26:39.931484 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.931320    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:26:39.934716 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.934688    2579 generic.go:356] "Generic (PLEG): container finished" podID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerID="3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba" exitCode=0
Jul 27 16:26:39.934866 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.934736    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"
Jul 27 16:26:39.934866 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.934766    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" event={"ID":"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e","Type":"ContainerDied","Data":"3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba"}
Jul 27 16:26:39.934866 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.934816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv" event={"ID":"9a99ecb8-a458-4a61-a4c8-0b060dc0a83e","Type":"ContainerDied","Data":"f9c8fc2d14e3f6f0c96db0718bf2f2886c9afb7a621cb9219ae7eb4ecec353ce"}
Jul 27 16:26:39.934866 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.934838    2579 scope.go:117] "RemoveContainer" containerID="3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba"
Jul 27 16:26:39.944329 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.944312    2579 scope.go:117] "RemoveContainer" containerID="6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015"
Jul 27 16:26:39.951959 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.951942    2579 scope.go:117] "RemoveContainer" containerID="3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba"
Jul 27 16:26:39.952223 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:26:39.952192    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba\": container with ID starting with 3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba not found: ID does not exist" containerID="3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba"
Jul 27 16:26:39.952267 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.952231    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba"} err="failed to get container status \"3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba\": rpc error: code = NotFound desc = could not find container \"3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba\": container with ID starting with 3ab544f482546ca1a5dd43279a350da1a9303b8a620578bfc5408861405c12ba not found: ID does not exist"
Jul 27 16:26:39.952267 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.952249    2579 scope.go:117] "RemoveContainer" containerID="6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015"
Jul 27 16:26:39.952483 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:26:39.952465    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015\": container with ID starting with 6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015 not found: ID does not exist" containerID="6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015"
Jul 27 16:26:39.952550 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.952488    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015"} err="failed to get container status \"6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015\": rpc error: code = NotFound desc = could not find container \"6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015\": container with ID starting with 6108e35c8314696e90abab4e9de881635370aa9cd6897cd897e10b578637b015 not found: ID does not exist"
Jul 27 16:26:39.960586 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.960562    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"]
Jul 27 16:26:39.969130 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:39.969106    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e1cdb3d5-openshift-default-859954fc8d-hflkv"]
Jul 27 16:26:41.930147 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:26:41.930102    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" path="/var/lib/kubelet/pods/9a99ecb8-a458-4a61-a4c8-0b060dc0a83e/volumes"
Jul 27 16:27:18.995521 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:18.995433    2579 scope.go:117] "RemoveContainer" containerID="69def8b36a8e9159a6ada89adceb6aed80a09bb84aa744fb7f0b10cb9657251e"
Jul 27 16:27:31.716863 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.716827    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"]
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717174    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy"
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717185    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy"
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717199    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy"
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717204    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy"
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717216    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60017919-e768-4f0e-99df-6d08e16f2b61" containerName="payload-processing"
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717223    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="60017919-e768-4f0e-99df-6d08e16f2b61" containerName="payload-processing"
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717231    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b6039c9-a50e-4b25-a4cc-f3b997961727" containerName="payload-pre-processing"
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717238    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b6039c9-a50e-4b25-a4cc-f3b997961727" containerName="payload-pre-processing"
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717296    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy"
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717303    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b6039c9-a50e-4b25-a4cc-f3b997961727" containerName="payload-pre-processing"
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717311    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="60017919-e768-4f0e-99df-6d08e16f2b61" containerName="payload-processing"
Jul 27 16:27:31.717330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.717316    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a99ecb8-a458-4a61-a4c8-0b060dc0a83e" containerName="istio-proxy"
Jul 27 16:27:31.720301 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.720284    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.722449 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.722426    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-8cec93-openshift-default-dockercfg-lgphv\""
Jul 27 16:27:31.731717 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.731695    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"]
Jul 27 16:27:31.785065 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.785027    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-data\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.785065 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.785064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-certs\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.785323 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.785148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istiod-ca-cert\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.785323 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.785191    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-socket\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.785323 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.785218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-envoy\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.785323 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.785243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-podinfo\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.785323 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.785318    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnh92\" (UniqueName: \"kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-kube-api-access-lnh92\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.785487 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.785345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-credential-socket\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.785487 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.785415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-token\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886108 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istiod-ca-cert\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886108 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-socket\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-envoy\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-podinfo\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886194    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnh92\" (UniqueName: \"kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-kube-api-access-lnh92\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-credential-socket\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-token\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886315    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-data\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-certs\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886755 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886621    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-socket\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886755 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-credential-socket\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886827 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886787    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-certs\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886827 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-data\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.886948 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.886930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istiod-ca-cert\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.888487 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.888461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-envoy\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.889014 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.888986    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-podinfo\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.895756 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.895736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-token\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:31.895958 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:31.895933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnh92\" (UniqueName: \"kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-kube-api-access-lnh92\") pod \"e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") " pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:32.030591 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:32.030564    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:32.183003 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:32.182966    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"]
Jul 27 16:27:32.188332 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:32.188282    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:32.188428 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:32.188375    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:32.188428 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:32.188416    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:32.211712 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:32.211667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" event={"ID":"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa","Type":"ContainerStarted","Data":"5b47f8da850e390599a3d5cfc0afbf8055dfe9e3c4674694032631e1955002cd"}
Jul 27 16:27:33.218679 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:33.218641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" event={"ID":"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa","Type":"ContainerStarted","Data":"d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37"}
Jul 27 16:27:33.242676 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:33.242622    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" podStartSLOduration=2.242606357 podStartE2EDuration="2.242606357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:27:33.241015275 +0000 UTC m=+2355.922079706" watchObservedRunningTime="2026-07-27 16:27:33.242606357 +0000 UTC m=+2355.923670787"
Jul 27 16:27:34.031581 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:34.031544    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:34.036200 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:34.036175    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:34.223636 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:34.223602    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:34.224548 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:34.224491    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:36.036795 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.036762    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"]
Jul 27 16:27:36.040229 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.040210    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:27:36.042685 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.042662    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-8cec93-dockercfg-vcp4m\""
Jul 27 16:27:36.042815 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.042804    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-8cec93\""
Jul 27 16:27:36.052289 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.052264    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"]
Jul 27 16:27:36.070642 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.070605    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"]
Jul 27 16:27:36.073790 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.073769    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:27:36.090655 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.090619    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"]
Jul 27 16:27:36.122553 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.122518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg5x9\" (UniqueName: \"kubernetes.io/projected/967a5362-7248-4473-baf0-e844e55855b5-kube-api-access-bg5x9\") pod \"payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg\" (UID: \"967a5362-7248-4473-baf0-e844e55855b5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:27:36.122553 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.122555    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/967a5362-7248-4473-baf0-e844e55855b5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg\" (UID: \"967a5362-7248-4473-baf0-e844e55855b5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:27:36.122818 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.122621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff1a1105-e142-47be-8a29-01ef89de2c9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg\" (UID: \"ff1a1105-e142-47be-8a29-01ef89de2c9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:27:36.122818 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.122723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrnmn\" (UniqueName: \"kubernetes.io/projected/ff1a1105-e142-47be-8a29-01ef89de2c9f-kube-api-access-hrnmn\") pod \"payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg\" (UID: \"ff1a1105-e142-47be-8a29-01ef89de2c9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:27:36.223872 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.223839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg5x9\" (UniqueName: \"kubernetes.io/projected/967a5362-7248-4473-baf0-e844e55855b5-kube-api-access-bg5x9\") pod \"payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg\" (UID: \"967a5362-7248-4473-baf0-e844e55855b5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:27:36.223872 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.223874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/967a5362-7248-4473-baf0-e844e55855b5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg\" (UID: \"967a5362-7248-4473-baf0-e844e55855b5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:27:36.224104 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.223898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff1a1105-e142-47be-8a29-01ef89de2c9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg\" (UID: \"ff1a1105-e142-47be-8a29-01ef89de2c9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:27:36.224104 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.223927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrnmn\" (UniqueName: \"kubernetes.io/projected/ff1a1105-e142-47be-8a29-01ef89de2c9f-kube-api-access-hrnmn\") pod \"payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg\" (UID: \"ff1a1105-e142-47be-8a29-01ef89de2c9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:27:36.224568 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.224545    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/967a5362-7248-4473-baf0-e844e55855b5-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg\" (UID: \"967a5362-7248-4473-baf0-e844e55855b5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:27:36.224634 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.224618    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff1a1105-e142-47be-8a29-01ef89de2c9f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg\" (UID: \"ff1a1105-e142-47be-8a29-01ef89de2c9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:27:36.233171 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.233132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg5x9\" (UniqueName: \"kubernetes.io/projected/967a5362-7248-4473-baf0-e844e55855b5-kube-api-access-bg5x9\") pod \"payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg\" (UID: \"967a5362-7248-4473-baf0-e844e55855b5\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:27:36.233315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.233227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrnmn\" (UniqueName: \"kubernetes.io/projected/ff1a1105-e142-47be-8a29-01ef89de2c9f-kube-api-access-hrnmn\") pod \"payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg\" (UID: \"ff1a1105-e142-47be-8a29-01ef89de2c9f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:27:36.351289 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.351188    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:27:36.383490 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.383458    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:27:36.496197 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.496169    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"]
Jul 27 16:27:36.497870 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:27:36.497839    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod967a5362_7248_4473_baf0_e844e55855b5.slice/crio-dcc39cbcfb0e5192e65b247d8407a6e5f7da552f3cf94802ee2200630b4a6222 WatchSource:0}: Error finding container dcc39cbcfb0e5192e65b247d8407a6e5f7da552f3cf94802ee2200630b4a6222: Status 404 returned error can't find the container with id dcc39cbcfb0e5192e65b247d8407a6e5f7da552f3cf94802ee2200630b4a6222
Jul 27 16:27:36.537179 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:36.537146    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"]
Jul 27 16:27:36.537722 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:27:36.537700    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff1a1105_e142_47be_8a29_01ef89de2c9f.slice/crio-889f0eae65401130194017e62005fa15a4c65d546ce07a40cfb455c0043450b7 WatchSource:0}: Error finding container 889f0eae65401130194017e62005fa15a4c65d546ce07a40cfb455c0043450b7: Status 404 returned error can't find the container with id 889f0eae65401130194017e62005fa15a4c65d546ce07a40cfb455c0043450b7
Jul 27 16:27:37.241320 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:37.241268    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg" event={"ID":"ff1a1105-e142-47be-8a29-01ef89de2c9f","Type":"ContainerStarted","Data":"45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a"}
Jul 27 16:27:37.241802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:37.241338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:27:37.241802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:37.241363    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg" event={"ID":"ff1a1105-e142-47be-8a29-01ef89de2c9f","Type":"ContainerStarted","Data":"889f0eae65401130194017e62005fa15a4c65d546ce07a40cfb455c0043450b7"}
Jul 27 16:27:37.243310 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:37.243277    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg" event={"ID":"967a5362-7248-4473-baf0-e844e55855b5","Type":"ContainerStarted","Data":"b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a"}
Jul 27 16:27:37.243454 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:37.243339    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:27:37.243454 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:37.243365    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg" event={"ID":"967a5362-7248-4473-baf0-e844e55855b5","Type":"ContainerStarted","Data":"dcc39cbcfb0e5192e65b247d8407a6e5f7da552f3cf94802ee2200630b4a6222"}
Jul 27 16:27:37.258514 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:37.258457    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg" podStartSLOduration=1.258441364 podStartE2EDuration="1.258441364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:27:37.257581238 +0000 UTC m=+2359.938645669" watchObservedRunningTime="2026-07-27 16:27:37.258441364 +0000 UTC m=+2359.939505794"
Jul 27 16:27:37.275072 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:37.275013    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg" podStartSLOduration=1.274992682 podStartE2EDuration="1.274992682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:27:37.272549485 +0000 UTC m=+2359.953613920" watchObservedRunningTime="2026-07-27 16:27:37.274992682 +0000 UTC m=+2359.956057115"
Jul 27 16:27:40.379840 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.379803    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"]
Jul 27 16:27:40.383432 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.383411    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.385817 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.385791    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f385e1-openshift-default-dockercfg-jhsr9\""
Jul 27 16:27:40.404584 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.404552    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"]
Jul 27 16:27:40.460157 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.460115    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23dfea6f-170d-46e8-8545-dac5a678deed-istio-podinfo\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.460370 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.460182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-socket\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.460370 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.460228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-data\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.460370 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.460254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-istio-token\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.460370 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.460301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23dfea6f-170d-46e8-8545-dac5a678deed-istiod-ca-cert\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.460370 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.460346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-envoy\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.460730 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.460378    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-credential-socket\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.460730 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.460408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-certs\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.460730 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.460438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r297\" (UniqueName: \"kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-kube-api-access-8r297\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.561617 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.561576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-envoy\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.561838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.561641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-credential-socket\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.561838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.561674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-certs\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.561838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.561702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r297\" (UniqueName: \"kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-kube-api-access-8r297\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.561838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.561788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23dfea6f-170d-46e8-8545-dac5a678deed-istio-podinfo\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.562057 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.561858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-socket\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.562057 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.561909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-data\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.562057 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.561935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-istio-token\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.562057 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.561989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23dfea6f-170d-46e8-8545-dac5a678deed-istiod-ca-cert\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.562282 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.562190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-certs\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.562345 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.562330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-credential-socket\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.562638 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.562607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-data\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.562830 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.562708    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-socket\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.563084 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.563064    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23dfea6f-170d-46e8-8545-dac5a678deed-istiod-ca-cert\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.564191 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.564170    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-envoy\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.564628 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.564606    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23dfea6f-170d-46e8-8545-dac5a678deed-istio-podinfo\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.570445 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.570417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-istio-token\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.570935 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.570914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r297\" (UniqueName: \"kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-kube-api-access-8r297\") pod \"e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") " pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.694765 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.694674    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:40.847508 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.847468    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"]
Jul 27 16:27:40.849788 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:27:40.849758    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23dfea6f_170d_46e8_8545_dac5a678deed.slice/crio-e1da9df7071a4b1cc7299cbf7018dade571dc5760a22c0968688631f009c16df WatchSource:0}: Error finding container e1da9df7071a4b1cc7299cbf7018dade571dc5760a22c0968688631f009c16df: Status 404 returned error can't find the container with id e1da9df7071a4b1cc7299cbf7018dade571dc5760a22c0968688631f009c16df
Jul 27 16:27:40.852609 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.852570    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:40.852690 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.852656    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:40.852729 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:40.852697    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:41.273383 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:41.273329    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" event={"ID":"23dfea6f-170d-46e8-8545-dac5a678deed","Type":"ContainerStarted","Data":"5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6"}
Jul 27 16:27:41.273597 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:41.273419    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" event={"ID":"23dfea6f-170d-46e8-8545-dac5a678deed","Type":"ContainerStarted","Data":"e1da9df7071a4b1cc7299cbf7018dade571dc5760a22c0968688631f009c16df"}
Jul 27 16:27:41.297927 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:41.297862    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" podStartSLOduration=1.297846555 podStartE2EDuration="1.297846555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:27:41.294954478 +0000 UTC m=+2363.976018919" watchObservedRunningTime="2026-07-27 16:27:41.297846555 +0000 UTC m=+2363.978910985"
Jul 27 16:27:41.695567 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:41.695465    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:41.700441 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:41.700416    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:42.279055 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:42.279027    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:42.280126 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:42.280099    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:44.086160 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.086125    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"]
Jul 27 16:27:44.096088 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.096060    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"]
Jul 27 16:27:44.096248 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.096174    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:27:44.098247 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.098218    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-f385e1-dockercfg-tksv4\""
Jul 27 16:27:44.098385 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.098264    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-f385e1\""
Jul 27 16:27:44.198402 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.198358    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdfwq\" (UniqueName: \"kubernetes.io/projected/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-kube-api-access-pdfwq\") pod \"payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8\" (UID: \"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:27:44.198617 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.198451    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8\" (UID: \"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:27:44.299218 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.299182    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdfwq\" (UniqueName: \"kubernetes.io/projected/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-kube-api-access-pdfwq\") pod \"payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8\" (UID: \"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:27:44.299415 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.299234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8\" (UID: \"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:27:44.299932 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.299912    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8\" (UID: \"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:27:44.307309 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.307281    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdfwq\" (UniqueName: \"kubernetes.io/projected/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-kube-api-access-pdfwq\") pod \"payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8\" (UID: \"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:27:44.407645 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.407561    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:27:44.590619 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:44.590595    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"]
Jul 27 16:27:44.592666 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:27:44.592638    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod688ec3c4_ecb8_4e95_bdcf_23ca24f18c9d.slice/crio-c12eab2208613d6b8138d64ebdc25585acd70d49763c4a7c3a5848e7fa42add0 WatchSource:0}: Error finding container c12eab2208613d6b8138d64ebdc25585acd70d49763c4a7c3a5848e7fa42add0: Status 404 returned error can't find the container with id c12eab2208613d6b8138d64ebdc25585acd70d49763c4a7c3a5848e7fa42add0
Jul 27 16:27:45.299607 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:45.299571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8" event={"ID":"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d","Type":"ContainerStarted","Data":"07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae"}
Jul 27 16:27:45.300015 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:45.299624    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8" event={"ID":"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d","Type":"ContainerStarted","Data":"c12eab2208613d6b8138d64ebdc25585acd70d49763c4a7c3a5848e7fa42add0"}
Jul 27 16:27:45.300015 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:45.299705    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:27:45.324448 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:45.324360    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8" podStartSLOduration=1.324338566 podStartE2EDuration="1.324338566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:27:45.323736184 +0000 UTC m=+2368.004800619" watchObservedRunningTime="2026-07-27 16:27:45.324338566 +0000 UTC m=+2368.005402997"
Jul 27 16:27:48.251246 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:48.251215    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:27:48.251757 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:48.251447    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:27:48.320084 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:48.319997    2579 generic.go:356] "Generic (PLEG): container finished" podID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerID="d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37" exitCode=0
Jul 27 16:27:48.320258 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:48.320074    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" event={"ID":"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa","Type":"ContainerDied","Data":"d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37"}
Jul 27 16:27:48.320564 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:48.320546    2579 scope.go:117] "RemoveContainer" containerID="d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37"
Jul 27 16:27:48.321731 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:48.321696    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:48.321818 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:48.321785    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:48.321860 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:48.321830    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:49.224392 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:49.224340    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:49.327830 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:49.327796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" event={"ID":"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa","Type":"ContainerStarted","Data":"5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a"}
Jul 27 16:27:50.031613 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:50.031582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:50.032897 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:50.032870    2579 patch_prober.go:28] interesting pod/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 16:27:50.033123 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:50.032925    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 16:27:51.031650 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:51.031608    2579 patch_prober.go:28] interesting pod/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 16:27:51.032107 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:51.031669    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 16:27:52.031733 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:52.031699    2579 patch_prober.go:28] interesting pod/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 16:27:52.032133 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:52.031757    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 16:27:53.031354 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:53.031318    2579 patch_prober.go:28] interesting pod/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 27 16:27:53.031561 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:53.031375    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 27 16:27:54.034830 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:54.034795    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:54.035259 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:54.035112    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:54.035908 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:54.035883    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:27:56.309163 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:56.309130    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:27:57.301407 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:57.300354    2579 patch_prober.go:28] interesting pod/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:42018->10.132.0.69:15021: read: connection reset by peer" start-of-body=
Jul 27 16:27:57.301407 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:57.300439    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:42018->10.132.0.69:15021: read: connection reset by peer"
Jul 27 16:27:57.379409 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:57.379378    2579 generic.go:356] "Generic (PLEG): container finished" podID="23dfea6f-170d-46e8-8545-dac5a678deed" containerID="5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6" exitCode=0
Jul 27 16:27:57.379814 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:57.379450    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" event={"ID":"23dfea6f-170d-46e8-8545-dac5a678deed","Type":"ContainerDied","Data":"5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6"}
Jul 27 16:27:57.379909 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:57.379895    2579 scope.go:117] "RemoveContainer" containerID="5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6"
Jul 27 16:27:57.380959 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:57.380936    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:57.381048 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:57.381006    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:57.381048 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:57.381038    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:27:58.387062 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:58.387006    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" event={"ID":"23dfea6f-170d-46e8-8545-dac5a678deed","Type":"ContainerStarted","Data":"60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd"}
Jul 27 16:27:58.695617 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:58.695519    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:27:58.695784 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:58.695751    2579 patch_prober.go:28] interesting pod/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 16:27:58.695829 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:58.695797    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 16:27:59.695844 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:59.695810    2579 patch_prober.go:28] interesting pod/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 16:27:59.696489 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:27:59.696410    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 16:28:00.696049 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:28:00.696015    2579 patch_prober.go:28] interesting pod/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 16:28:00.696462 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:28:00.696081    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 16:28:01.695784 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:28:01.695743    2579 patch_prober.go:28] interesting pod/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Jul 27 16:28:01.695974 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:28:01.695806    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Jul 27 16:28:02.699140 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:28:02.699108    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:28:02.699659 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:28:02.699486    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:28:02.700254 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:28:02.700232    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:28:19.018386 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:28:19.018352    2579 scope.go:117] "RemoveContainer" containerID="92a6a5fcd0d4e695c010f260cca8643942b375b5aa3433a1fcaa2574be05eacf"
Jul 27 16:29:39.664071 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.664034    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"]
Jul 27 16:29:39.664771 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.664264    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg" podUID="967a5362-7248-4473-baf0-e844e55855b5" containerName="payload-processing" containerID="cri-o://b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a" gracePeriod=30
Jul 27 16:29:39.674626 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.674578    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"]
Jul 27 16:29:39.674967 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.674910    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg" podUID="ff1a1105-e142-47be-8a29-01ef89de2c9f" containerName="payload-pre-processing" containerID="cri-o://45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a" gracePeriod=30
Jul 27 16:29:39.947473 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.947441    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:29:39.978663 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.978630    2579 generic.go:356] "Generic (PLEG): container finished" podID="967a5362-7248-4473-baf0-e844e55855b5" containerID="b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a" exitCode=0
Jul 27 16:29:39.978838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.978673    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"
Jul 27 16:29:39.978838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.978691    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg" event={"ID":"967a5362-7248-4473-baf0-e844e55855b5","Type":"ContainerDied","Data":"b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a"}
Jul 27 16:29:39.978838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.978746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg" event={"ID":"967a5362-7248-4473-baf0-e844e55855b5","Type":"ContainerDied","Data":"dcc39cbcfb0e5192e65b247d8407a6e5f7da552f3cf94802ee2200630b4a6222"}
Jul 27 16:29:39.978838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.978773    2579 scope.go:117] "RemoveContainer" containerID="b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a"
Jul 27 16:29:39.980176 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.980158    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:29:39.980268 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.980224    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff1a1105-e142-47be-8a29-01ef89de2c9f" containerID="45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a" exitCode=0
Jul 27 16:29:39.980332 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.980273    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg" event={"ID":"ff1a1105-e142-47be-8a29-01ef89de2c9f","Type":"ContainerDied","Data":"45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a"}
Jul 27 16:29:39.980332 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.980319    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg" event={"ID":"ff1a1105-e142-47be-8a29-01ef89de2c9f","Type":"ContainerDied","Data":"889f0eae65401130194017e62005fa15a4c65d546ce07a40cfb455c0043450b7"}
Jul 27 16:29:39.988292 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.988273    2579 scope.go:117] "RemoveContainer" containerID="b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a"
Jul 27 16:29:39.988687 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:29:39.988661    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a\": container with ID starting with b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a not found: ID does not exist" containerID="b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a"
Jul 27 16:29:39.988762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.988704    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a"} err="failed to get container status \"b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a\": rpc error: code = NotFound desc = could not find container \"b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a\": container with ID starting with b391c87cb5308f6eb67b45ef1db72daa22c9060169804e3089587d3dbed66d8a not found: ID does not exist"
Jul 27 16:29:39.988762 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.988728    2579 scope.go:117] "RemoveContainer" containerID="45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a"
Jul 27 16:29:39.999627 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:39.999593    2579 scope.go:117] "RemoveContainer" containerID="45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a"
Jul 27 16:29:40.000040 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:29:40.000013    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a\": container with ID starting with 45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a not found: ID does not exist" containerID="45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a"
Jul 27 16:29:40.000140 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.000053    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a"} err="failed to get container status \"45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a\": rpc error: code = NotFound desc = could not find container \"45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a\": container with ID starting with 45bc3a1278c45011928398376170cb2a43de1a7ed5e96c29b7b60fc30128577a not found: ID does not exist"
Jul 27 16:29:40.066029 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.065988    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrnmn\" (UniqueName: \"kubernetes.io/projected/ff1a1105-e142-47be-8a29-01ef89de2c9f-kube-api-access-hrnmn\") pod \"ff1a1105-e142-47be-8a29-01ef89de2c9f\" (UID: \"ff1a1105-e142-47be-8a29-01ef89de2c9f\") "
Jul 27 16:29:40.066236 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.066056    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg5x9\" (UniqueName: \"kubernetes.io/projected/967a5362-7248-4473-baf0-e844e55855b5-kube-api-access-bg5x9\") pod \"967a5362-7248-4473-baf0-e844e55855b5\" (UID: \"967a5362-7248-4473-baf0-e844e55855b5\") "
Jul 27 16:29:40.066236 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.066092    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/967a5362-7248-4473-baf0-e844e55855b5-plugins-config-volume\") pod \"967a5362-7248-4473-baf0-e844e55855b5\" (UID: \"967a5362-7248-4473-baf0-e844e55855b5\") "
Jul 27 16:29:40.066236 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.066110    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff1a1105-e142-47be-8a29-01ef89de2c9f-plugins-config-volume\") pod \"ff1a1105-e142-47be-8a29-01ef89de2c9f\" (UID: \"ff1a1105-e142-47be-8a29-01ef89de2c9f\") "
Jul 27 16:29:40.066579 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.066534    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/967a5362-7248-4473-baf0-e844e55855b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "967a5362-7248-4473-baf0-e844e55855b5" (UID: "967a5362-7248-4473-baf0-e844e55855b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:29:40.066661 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.066583    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff1a1105-e142-47be-8a29-01ef89de2c9f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ff1a1105-e142-47be-8a29-01ef89de2c9f" (UID: "ff1a1105-e142-47be-8a29-01ef89de2c9f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:29:40.068259 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.068239    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/967a5362-7248-4473-baf0-e844e55855b5-kube-api-access-bg5x9" (OuterVolumeSpecName: "kube-api-access-bg5x9") pod "967a5362-7248-4473-baf0-e844e55855b5" (UID: "967a5362-7248-4473-baf0-e844e55855b5"). InnerVolumeSpecName "kube-api-access-bg5x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:29:40.068318 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.068267    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff1a1105-e142-47be-8a29-01ef89de2c9f-kube-api-access-hrnmn" (OuterVolumeSpecName: "kube-api-access-hrnmn") pod "ff1a1105-e142-47be-8a29-01ef89de2c9f" (UID: "ff1a1105-e142-47be-8a29-01ef89de2c9f"). InnerVolumeSpecName "kube-api-access-hrnmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:29:40.167690 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.167651    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg5x9\" (UniqueName: \"kubernetes.io/projected/967a5362-7248-4473-baf0-e844e55855b5-kube-api-access-bg5x9\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:40.167690 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.167682    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/967a5362-7248-4473-baf0-e844e55855b5-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:40.167690 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.167691    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff1a1105-e142-47be-8a29-01ef89de2c9f-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:40.167690 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.167703    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrnmn\" (UniqueName: \"kubernetes.io/projected/ff1a1105-e142-47be-8a29-01ef89de2c9f-kube-api-access-hrnmn\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:40.300792 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.300750    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"]
Jul 27 16:29:40.305370 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.305336    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cec93-7c8d9df48d-vrsgg"]
Jul 27 16:29:40.987434 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:40.987337    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"
Jul 27 16:29:41.010433 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:41.010393    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"]
Jul 27 16:29:41.015611 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:41.015575    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cec93-7b8b7996cb-4cxbg"]
Jul 27 16:29:41.931056 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:41.931019    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="967a5362-7248-4473-baf0-e844e55855b5" path="/var/lib/kubelet/pods/967a5362-7248-4473-baf0-e844e55855b5/volumes"
Jul 27 16:29:41.931411 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:41.931397    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff1a1105-e142-47be-8a29-01ef89de2c9f" path="/var/lib/kubelet/pods/ff1a1105-e142-47be-8a29-01ef89de2c9f/volumes"
Jul 27 16:29:51.300838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:51.300804    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"]
Jul 27 16:29:51.301244 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:51.301021    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy" containerID="cri-o://5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a" gracePeriod=30
Jul 27 16:29:54.037725 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:54.037682    2579 patch_prober.go:28] interesting pod/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 16:29:54.038115 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:54.037752    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 16:29:56.556845 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.556816    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:29:56.728104 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728011    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnh92\" (UniqueName: \"kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-kube-api-access-lnh92\") pod \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") "
Jul 27 16:29:56.728104 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728056    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-credential-socket\") pod \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") "
Jul 27 16:29:56.728104 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728096    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-podinfo\") pod \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") "
Jul 27 16:29:56.728374 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728128    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-data\") pod \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") "
Jul 27 16:29:56.728374 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728191    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-token\") pod \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") "
Jul 27 16:29:56.728374 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728234    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istiod-ca-cert\") pod \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") "
Jul 27 16:29:56.728374 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728268    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-socket\") pod \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") "
Jul 27 16:29:56.728374 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728316    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-envoy\") pod \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") "
Jul 27 16:29:56.728374 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728366    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-certs\") pod \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\" (UID: \"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa\") "
Jul 27 16:29:56.728699 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728434    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" (UID: "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:29:56.728758 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728696    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" (UID: "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:29:56.728758 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728702    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" (UID: "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:29:56.728758 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728735    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:56.729011 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.728984    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" (UID: "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:29:56.729204 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.729179    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-data" (OuterVolumeSpecName: "istio-data") pod "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" (UID: "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:29:56.730404 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.730364    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-kube-api-access-lnh92" (OuterVolumeSpecName: "kube-api-access-lnh92") pod "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" (UID: "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa"). InnerVolumeSpecName "kube-api-access-lnh92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:29:56.730404 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.730391    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" (UID: "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:29:56.730541 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.730397    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" (UID: "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:29:56.730541 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.730530    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-token" (OuterVolumeSpecName: "istio-token") pod "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" (UID: "32fcdc5f-5609-49cf-855c-96a7d5c0ebaa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:29:56.829676 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.829642    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:56.829676 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.829670    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:56.829676 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.829679    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:56.829913 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.829688    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnh92\" (UniqueName: \"kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-kube-api-access-lnh92\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:56.829913 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.829698    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:56.829913 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.829706    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:56.829913 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.829714    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:56.829913 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:56.829722    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:29:57.074725 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.074684    2579 generic.go:356] "Generic (PLEG): container finished" podID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerID="5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a" exitCode=0
Jul 27 16:29:57.074917 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.074736    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"
Jul 27 16:29:57.074917 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.074774    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" event={"ID":"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa","Type":"ContainerDied","Data":"5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a"}
Jul 27 16:29:57.074917 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.074832    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv" event={"ID":"32fcdc5f-5609-49cf-855c-96a7d5c0ebaa","Type":"ContainerDied","Data":"5b47f8da850e390599a3d5cfc0afbf8055dfe9e3c4674694032631e1955002cd"}
Jul 27 16:29:57.074917 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.074864    2579 scope.go:117] "RemoveContainer" containerID="5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a"
Jul 27 16:29:57.084381 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.084364    2579 scope.go:117] "RemoveContainer" containerID="d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37"
Jul 27 16:29:57.093350 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.093331    2579 scope.go:117] "RemoveContainer" containerID="5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a"
Jul 27 16:29:57.093637 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:29:57.093617    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a\": container with ID starting with 5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a not found: ID does not exist" containerID="5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a"
Jul 27 16:29:57.093692 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.093647    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a"} err="failed to get container status \"5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a\": rpc error: code = NotFound desc = could not find container \"5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a\": container with ID starting with 5daaea326487364a2dcf1375496e5a605af42f215c17a8629b167d430a6f582a not found: ID does not exist"
Jul 27 16:29:57.093692 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.093668    2579 scope.go:117] "RemoveContainer" containerID="d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37"
Jul 27 16:29:57.093951 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:29:57.093931    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37\": container with ID starting with d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37 not found: ID does not exist" containerID="d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37"
Jul 27 16:29:57.093996 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.093959    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37"} err="failed to get container status \"d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37\": rpc error: code = NotFound desc = could not find container \"d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37\": container with ID starting with d4ec47660e4d925dfce39caeeaa226c09c45a15ddae4f62d692baf91f36e7b37 not found: ID does not exist"
Jul 27 16:29:57.099933 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.099907    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"]
Jul 27 16:29:57.107213 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.107187    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-8cec93-openshift-default-644d7665b8-cstmv"]
Jul 27 16:29:57.931208 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:29:57.931173    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" path="/var/lib/kubelet/pods/32fcdc5f-5609-49cf-855c-96a7d5c0ebaa/volumes"
Jul 27 16:30:00.145992 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.145952    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss"]
Jul 27 16:30:00.146368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146310    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy"
Jul 27 16:30:00.146368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146322    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy"
Jul 27 16:30:00.146368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146335    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy"
Jul 27 16:30:00.146368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146340    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy"
Jul 27 16:30:00.146368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146350    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="967a5362-7248-4473-baf0-e844e55855b5" containerName="payload-processing"
Jul 27 16:30:00.146368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146356    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="967a5362-7248-4473-baf0-e844e55855b5" containerName="payload-processing"
Jul 27 16:30:00.146368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146367    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff1a1105-e142-47be-8a29-01ef89de2c9f" containerName="payload-pre-processing"
Jul 27 16:30:00.146368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146373    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff1a1105-e142-47be-8a29-01ef89de2c9f" containerName="payload-pre-processing"
Jul 27 16:30:00.146649 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146431    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="967a5362-7248-4473-baf0-e844e55855b5" containerName="payload-processing"
Jul 27 16:30:00.146649 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146438    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy"
Jul 27 16:30:00.146649 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146445    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff1a1105-e142-47be-8a29-01ef89de2c9f" containerName="payload-pre-processing"
Jul 27 16:30:00.146649 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.146451    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="32fcdc5f-5609-49cf-855c-96a7d5c0ebaa" containerName="istio-proxy"
Jul 27 16:30:00.151094 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.151073    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss"
Jul 27 16:30:00.153304 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.153278    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-wqs6d\""
Jul 27 16:30:00.159233 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.159203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss"]
Jul 27 16:30:00.163954 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.163925    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss"
Jul 27 16:30:00.308318 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:00.308291    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss"]
Jul 27 16:30:00.310521 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:30:00.310477    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f79fa57_a399_4bc9_837c_15ce7ffbf36d.slice/crio-b5ce6a62dd227af06b1b8e9167f0f290d8686fb384ad3fe2b3c940c641a8e505 WatchSource:0}: Error finding container b5ce6a62dd227af06b1b8e9167f0f290d8686fb384ad3fe2b3c940c641a8e505: Status 404 returned error can't find the container with id b5ce6a62dd227af06b1b8e9167f0f290d8686fb384ad3fe2b3c940c641a8e505
Jul 27 16:30:01.099730 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:01.099693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss" event={"ID":"9f79fa57-a399-4bc9-837c-15ce7ffbf36d","Type":"ContainerStarted","Data":"2fb3de580c0eb04a8e343ab141ebd05402f0954dfea562f54b3c6f4bdf4fd21a"}
Jul 27 16:30:01.099946 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:01.099748    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss" event={"ID":"9f79fa57-a399-4bc9-837c-15ce7ffbf36d","Type":"ContainerStarted","Data":"b5ce6a62dd227af06b1b8e9167f0f290d8686fb384ad3fe2b3c940c641a8e505"}
Jul 27 16:30:01.119120 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:01.119054    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss" podStartSLOduration=1.119034212 podStartE2EDuration="1.119034212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:30:01.116847495 +0000 UTC m=+2503.797911925" watchObservedRunningTime="2026-07-27 16:30:01.119034212 +0000 UTC m=+2503.800098643"
Jul 27 16:30:02.107954 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.107922    2579 generic.go:356] "Generic (PLEG): container finished" podID="9f79fa57-a399-4bc9-837c-15ce7ffbf36d" containerID="2fb3de580c0eb04a8e343ab141ebd05402f0954dfea562f54b3c6f4bdf4fd21a" exitCode=0
Jul 27 16:30:02.108340 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.108004    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss" event={"ID":"9f79fa57-a399-4bc9-837c-15ce7ffbf36d","Type":"ContainerDied","Data":"2fb3de580c0eb04a8e343ab141ebd05402f0954dfea562f54b3c6f4bdf4fd21a"}
Jul 27 16:30:02.141822 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.141788    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss"]
Jul 27 16:30:02.184100 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.184066    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"]
Jul 27 16:30:02.184419 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.184364    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8" podUID="688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d" containerName="payload-pre-processing" containerID="cri-o://07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae" gracePeriod=30
Jul 27 16:30:02.460168 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.460141    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:30:02.478624 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.478595    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-plugins-config-volume\") pod \"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d\" (UID: \"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d\") "
Jul 27 16:30:02.478624 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.478632    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdfwq\" (UniqueName: \"kubernetes.io/projected/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-kube-api-access-pdfwq\") pod \"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d\" (UID: \"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d\") "
Jul 27 16:30:02.478960 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.478933    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d" (UID: "688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:30:02.481330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.481301    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-kube-api-access-pdfwq" (OuterVolumeSpecName: "kube-api-access-pdfwq") pod "688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d" (UID: "688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d"). InnerVolumeSpecName "kube-api-access-pdfwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:30:02.579307 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.579272    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:02.579307 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:02.579301    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdfwq\" (UniqueName: \"kubernetes.io/projected/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d-kube-api-access-pdfwq\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:03.115690 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:03.115654    2579 generic.go:356] "Generic (PLEG): container finished" podID="688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d" containerID="07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae" exitCode=0
Jul 27 16:30:03.116169 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:03.115698    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"
Jul 27 16:30:03.116169 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:03.115738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8" event={"ID":"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d","Type":"ContainerDied","Data":"07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae"}
Jul 27 16:30:03.116169 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:03.115797    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8" event={"ID":"688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d","Type":"ContainerDied","Data":"c12eab2208613d6b8138d64ebdc25585acd70d49763c4a7c3a5848e7fa42add0"}
Jul 27 16:30:03.116169 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:03.115821    2579 scope.go:117] "RemoveContainer" containerID="07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae"
Jul 27 16:30:03.125406 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:03.125381    2579 scope.go:117] "RemoveContainer" containerID="07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae"
Jul 27 16:30:03.125720 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:30:03.125701    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae\": container with ID starting with 07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae not found: ID does not exist" containerID="07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae"
Jul 27 16:30:03.125787 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:03.125729    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae"} err="failed to get container status \"07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae\": rpc error: code = NotFound desc = could not find container \"07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae\": container with ID starting with 07399988843ff9a791f6a3ab7004351086c03036c559950b399d68fa133116ae not found: ID does not exist"
Jul 27 16:30:03.137937 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:03.137905    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"]
Jul 27 16:30:03.142687 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:03.142661    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-f385e1-7dbb68bdbd-wxng8"]
Jul 27 16:30:03.255488 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:03.255461    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss"
Jul 27 16:30:03.937074 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:03.937039    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d" path="/var/lib/kubelet/pods/688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d/volumes"
Jul 27 16:30:04.122004 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:04.121974    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss"
Jul 27 16:30:04.122488 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:04.122024    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss" event={"ID":"9f79fa57-a399-4bc9-837c-15ce7ffbf36d","Type":"ContainerDied","Data":"b5ce6a62dd227af06b1b8e9167f0f290d8686fb384ad3fe2b3c940c641a8e505"}
Jul 27 16:30:04.122488 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:04.122078    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5ce6a62dd227af06b1b8e9167f0f290d8686fb384ad3fe2b3c940c641a8e505"
Jul 27 16:30:04.150556 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:04.150520    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss"]
Jul 27 16:30:04.154341 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:04.154312    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-f385e1-29752830-prhss"]
Jul 27 16:30:05.930691 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:05.930651    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f79fa57-a399-4bc9-837c-15ce7ffbf36d" path="/var/lib/kubelet/pods/9f79fa57-a399-4bc9-837c-15ce7ffbf36d/volumes"
Jul 27 16:30:14.139959 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:14.139869    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"]
Jul 27 16:30:14.140578 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:14.140064    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy" containerID="cri-o://60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd" gracePeriod=30
Jul 27 16:30:15.133382 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.133345    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"]
Jul 27 16:30:15.133750 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.133737    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d" containerName="payload-pre-processing"
Jul 27 16:30:15.133805 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.133751    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d" containerName="payload-pre-processing"
Jul 27 16:30:15.133805 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.133760    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f79fa57-a399-4bc9-837c-15ce7ffbf36d" containerName="cleanup"
Jul 27 16:30:15.133805 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.133765    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f79fa57-a399-4bc9-837c-15ce7ffbf36d" containerName="cleanup"
Jul 27 16:30:15.133899 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.133823    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="688ec3c4-ecb8-4e95-bdcf-23ca24f18c9d" containerName="payload-pre-processing"
Jul 27 16:30:15.133899 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.133832    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f79fa57-a399-4bc9-837c-15ce7ffbf36d" containerName="cleanup"
Jul 27 16:30:15.136749 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.136730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.138952 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.138929    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-d2ac7b-openshift-default-dockercfg-6p6nc\""
Jul 27 16:30:15.150874 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.150844    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"]
Jul 27 16:30:15.171375 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.171341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-certs\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.171555 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.171391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-token\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.171555 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.171444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-credential-socket\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.171555 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.171460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-data\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.171555 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.171483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whhl5\" (UniqueName: \"kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-kube-api-access-whhl5\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.171704 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.171579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-envoy\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.171704 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.171631    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-podinfo\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.171704 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.171685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istiod-ca-cert\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.171802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.171731    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-socket\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.272241 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.272198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-envoy\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.272241 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.272245    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-podinfo\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.272529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.272372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istiod-ca-cert\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.272529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.272464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-socket\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.272655 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.272553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-certs\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.272655 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.272632    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-token\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.272813 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.272795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-credential-socket\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.272917 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.272892    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-certs\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.272993 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.272815    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-socket\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.273055 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.272907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-data\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.273117 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.273076    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-credential-socket\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.273117 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.273097    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whhl5\" (UniqueName: \"kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-kube-api-access-whhl5\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.273216 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.273149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istiod-ca-cert\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.273274 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.273239    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-data\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.274710 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.274689    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-envoy\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.274933 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.274911    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-podinfo\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.281138 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.281112    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-token\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.281270 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.281246    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whhl5\" (UniqueName: \"kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-kube-api-access-whhl5\") pod \"e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") " pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.446883 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.446792    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:15.589213 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.589185    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"]
Jul 27 16:30:15.591800 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:30:15.591771    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc92ed2_bb0f_4f0c_b568_ed8bd66b9ebc.slice/crio-4c2b6244509481816533b573b0b8ec84a778e2c9675cda79f7b8c9492539eba4 WatchSource:0}: Error finding container 4c2b6244509481816533b573b0b8ec84a778e2c9675cda79f7b8c9492539eba4: Status 404 returned error can't find the container with id 4c2b6244509481816533b573b0b8ec84a778e2c9675cda79f7b8c9492539eba4
Jul 27 16:30:15.594086 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.594052    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:15.594172 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.594139    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:15.594217 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:15.594179    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:16.191911 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:16.191876    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" event={"ID":"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc","Type":"ContainerStarted","Data":"668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780"}
Jul 27 16:30:16.192399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:16.191928    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" event={"ID":"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc","Type":"ContainerStarted","Data":"4c2b6244509481816533b573b0b8ec84a778e2c9675cda79f7b8c9492539eba4"}
Jul 27 16:30:16.216436 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:16.216381    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" podStartSLOduration=1.216361632 podStartE2EDuration="1.216361632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:30:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:30:16.214009959 +0000 UTC m=+2518.895074427" watchObservedRunningTime="2026-07-27 16:30:16.216361632 +0000 UTC m=+2518.897426063"
Jul 27 16:30:16.447560 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:16.447437    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:16.452476 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:16.452448    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:17.197514 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:17.197476    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:17.198373 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:17.198355    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:17.701703 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:17.701659    2579 patch_prober.go:28] interesting pod/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 16:30:17.701876 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:17.701722    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 16:30:18.967699 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:18.967629    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"]
Jul 27 16:30:18.971396 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:18.971376    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:18.973759 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:18.973735    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-d2ac7b-dockercfg-rgqk2\""
Jul 27 16:30:18.973759 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:18.973738    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-d2ac7b\""
Jul 27 16:30:18.981663 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:18.981630    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"]
Jul 27 16:30:18.993737 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:18.993705    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"]
Jul 27 16:30:18.997340 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:18.997316    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:19.006423 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.006393    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp\" (UID: \"4ec2dc65-ad34-4bf9-b4cb-53550c579a92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:19.006641 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.006465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mncf\" (UniqueName: \"kubernetes.io/projected/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-kube-api-access-6mncf\") pod \"payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp\" (UID: \"4ec2dc65-ad34-4bf9-b4cb-53550c579a92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:19.008471 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.008441    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"]
Jul 27 16:30:19.107788 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.107752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp\" (UID: \"4ec2dc65-ad34-4bf9-b4cb-53550c579a92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:19.107788 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.107795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mncf\" (UniqueName: \"kubernetes.io/projected/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-kube-api-access-6mncf\") pod \"payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp\" (UID: \"4ec2dc65-ad34-4bf9-b4cb-53550c579a92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:19.108017 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.107831    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1b8030d-4cc4-4790-9d4f-470fe645bc48-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv\" (UID: \"a1b8030d-4cc4-4790-9d4f-470fe645bc48\") " pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:19.108017 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.107874    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8snbf\" (UniqueName: \"kubernetes.io/projected/a1b8030d-4cc4-4790-9d4f-470fe645bc48-kube-api-access-8snbf\") pod \"payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv\" (UID: \"a1b8030d-4cc4-4790-9d4f-470fe645bc48\") " pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:19.108555 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.108536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp\" (UID: \"4ec2dc65-ad34-4bf9-b4cb-53550c579a92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:19.116894 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.116865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mncf\" (UniqueName: \"kubernetes.io/projected/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-kube-api-access-6mncf\") pod \"payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp\" (UID: \"4ec2dc65-ad34-4bf9-b4cb-53550c579a92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:19.209141 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.209106    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1b8030d-4cc4-4790-9d4f-470fe645bc48-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv\" (UID: \"a1b8030d-4cc4-4790-9d4f-470fe645bc48\") " pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:19.209141 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.209149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8snbf\" (UniqueName: \"kubernetes.io/projected/a1b8030d-4cc4-4790-9d4f-470fe645bc48-kube-api-access-8snbf\") pod \"payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv\" (UID: \"a1b8030d-4cc4-4790-9d4f-470fe645bc48\") " pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:19.210058 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.210034    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1b8030d-4cc4-4790-9d4f-470fe645bc48-plugins-config-volume\") pod \"payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv\" (UID: \"a1b8030d-4cc4-4790-9d4f-470fe645bc48\") " pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:19.217308 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.217278    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8snbf\" (UniqueName: \"kubernetes.io/projected/a1b8030d-4cc4-4790-9d4f-470fe645bc48-kube-api-access-8snbf\") pod \"payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv\" (UID: \"a1b8030d-4cc4-4790-9d4f-470fe645bc48\") " pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:19.283671 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.283632    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:19.309042 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.309013    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:19.406721 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.406693    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:30:19.461031 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.460997    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"]
Jul 27 16:30:19.461476 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:30:19.461446    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec2dc65_ad34_4bf9_b4cb_53550c579a92.slice/crio-5bfba739a9b3a22468ded6ea0c32830c1d0cf101cc79b9db389c8d0930aa7f00 WatchSource:0}: Error finding container 5bfba739a9b3a22468ded6ea0c32830c1d0cf101cc79b9db389c8d0930aa7f00: Status 404 returned error can't find the container with id 5bfba739a9b3a22468ded6ea0c32830c1d0cf101cc79b9db389c8d0930aa7f00
Jul 27 16:30:19.480277 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.480251    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"]
Jul 27 16:30:19.481778 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:30:19.481745    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b8030d_4cc4_4790_9d4f_470fe645bc48.slice/crio-c720d13e2b5acc282d5784759a75e6b004754a49f71534a9118333bdfba99185 WatchSource:0}: Error finding container c720d13e2b5acc282d5784759a75e6b004754a49f71534a9118333bdfba99185: Status 404 returned error can't find the container with id c720d13e2b5acc282d5784759a75e6b004754a49f71534a9118333bdfba99185
Jul 27 16:30:19.511773 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.511749    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-data\") pod \"23dfea6f-170d-46e8-8545-dac5a678deed\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") "
Jul 27 16:30:19.511895 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.511803    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-istio-token\") pod \"23dfea6f-170d-46e8-8545-dac5a678deed\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") "
Jul 27 16:30:19.511895 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.511831    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-certs\") pod \"23dfea6f-170d-46e8-8545-dac5a678deed\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") "
Jul 27 16:30:19.511895 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.511888    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-credential-socket\") pod \"23dfea6f-170d-46e8-8545-dac5a678deed\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") "
Jul 27 16:30:19.512063 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.511918    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-envoy\") pod \"23dfea6f-170d-46e8-8545-dac5a678deed\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") "
Jul 27 16:30:19.512063 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.511953    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23dfea6f-170d-46e8-8545-dac5a678deed-istiod-ca-cert\") pod \"23dfea6f-170d-46e8-8545-dac5a678deed\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") "
Jul 27 16:30:19.512063 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.512041    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23dfea6f-170d-46e8-8545-dac5a678deed-istio-podinfo\") pod \"23dfea6f-170d-46e8-8545-dac5a678deed\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") "
Jul 27 16:30:19.512217 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.512069    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r297\" (UniqueName: \"kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-kube-api-access-8r297\") pod \"23dfea6f-170d-46e8-8545-dac5a678deed\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") "
Jul 27 16:30:19.512217 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.512111    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-socket\") pod \"23dfea6f-170d-46e8-8545-dac5a678deed\" (UID: \"23dfea6f-170d-46e8-8545-dac5a678deed\") "
Jul 27 16:30:19.512317 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.512208    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "23dfea6f-170d-46e8-8545-dac5a678deed" (UID: "23dfea6f-170d-46e8-8545-dac5a678deed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:30:19.512462 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.512441    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:19.512545 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.512520    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "23dfea6f-170d-46e8-8545-dac5a678deed" (UID: "23dfea6f-170d-46e8-8545-dac5a678deed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:30:19.512701 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.512678    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-data" (OuterVolumeSpecName: "istio-data") pod "23dfea6f-170d-46e8-8545-dac5a678deed" (UID: "23dfea6f-170d-46e8-8545-dac5a678deed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:30:19.512909 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.512885    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "23dfea6f-170d-46e8-8545-dac5a678deed" (UID: "23dfea6f-170d-46e8-8545-dac5a678deed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:30:19.513000 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.512955    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23dfea6f-170d-46e8-8545-dac5a678deed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "23dfea6f-170d-46e8-8545-dac5a678deed" (UID: "23dfea6f-170d-46e8-8545-dac5a678deed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:30:19.514775 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.514753    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-kube-api-access-8r297" (OuterVolumeSpecName: "kube-api-access-8r297") pod "23dfea6f-170d-46e8-8545-dac5a678deed" (UID: "23dfea6f-170d-46e8-8545-dac5a678deed"). InnerVolumeSpecName "kube-api-access-8r297". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:30:19.515555 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.515534    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "23dfea6f-170d-46e8-8545-dac5a678deed" (UID: "23dfea6f-170d-46e8-8545-dac5a678deed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:30:19.515644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.515615    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23dfea6f-170d-46e8-8545-dac5a678deed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "23dfea6f-170d-46e8-8545-dac5a678deed" (UID: "23dfea6f-170d-46e8-8545-dac5a678deed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:30:19.515981 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.515950    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-istio-token" (OuterVolumeSpecName: "istio-token") pod "23dfea6f-170d-46e8-8545-dac5a678deed" (UID: "23dfea6f-170d-46e8-8545-dac5a678deed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:30:19.613135 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.613098    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:19.613135 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.613127    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23dfea6f-170d-46e8-8545-dac5a678deed-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:19.613135 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.613137    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23dfea6f-170d-46e8-8545-dac5a678deed-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:19.613135 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.613147    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r297\" (UniqueName: \"kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-kube-api-access-8r297\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:19.613409 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.613156    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:19.613409 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.613167    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:19.613409 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.613175    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23dfea6f-170d-46e8-8545-dac5a678deed-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:19.613409 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:19.613185    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23dfea6f-170d-46e8-8545-dac5a678deed-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:20.217716 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.217618    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv" event={"ID":"a1b8030d-4cc4-4790-9d4f-470fe645bc48","Type":"ContainerStarted","Data":"11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440"}
Jul 27 16:30:20.218144 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.217758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:20.218144 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.217782    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv" event={"ID":"a1b8030d-4cc4-4790-9d4f-470fe645bc48","Type":"ContainerStarted","Data":"c720d13e2b5acc282d5784759a75e6b004754a49f71534a9118333bdfba99185"}
Jul 27 16:30:20.219282 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.219255    2579 generic.go:356] "Generic (PLEG): container finished" podID="23dfea6f-170d-46e8-8545-dac5a678deed" containerID="60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd" exitCode=0
Jul 27 16:30:20.219412 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.219290    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"
Jul 27 16:30:20.219412 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.219331    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" event={"ID":"23dfea6f-170d-46e8-8545-dac5a678deed","Type":"ContainerDied","Data":"60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd"}
Jul 27 16:30:20.219412 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.219376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4" event={"ID":"23dfea6f-170d-46e8-8545-dac5a678deed","Type":"ContainerDied","Data":"e1da9df7071a4b1cc7299cbf7018dade571dc5760a22c0968688631f009c16df"}
Jul 27 16:30:20.219412 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.219397    2579 scope.go:117] "RemoveContainer" containerID="60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd"
Jul 27 16:30:20.221035 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.221008    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp" event={"ID":"4ec2dc65-ad34-4bf9-b4cb-53550c579a92","Type":"ContainerStarted","Data":"8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2"}
Jul 27 16:30:20.221139 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.221051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp" event={"ID":"4ec2dc65-ad34-4bf9-b4cb-53550c579a92","Type":"ContainerStarted","Data":"5bfba739a9b3a22468ded6ea0c32830c1d0cf101cc79b9db389c8d0930aa7f00"}
Jul 27 16:30:20.221221 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.221139    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:20.230131 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.230107    2579 scope.go:117] "RemoveContainer" containerID="5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6"
Jul 27 16:30:20.237678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.237624    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv" podStartSLOduration=2.237606471 podStartE2EDuration="2.237606471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:30:20.23611331 +0000 UTC m=+2522.917177741" watchObservedRunningTime="2026-07-27 16:30:20.237606471 +0000 UTC m=+2522.918670901"
Jul 27 16:30:20.239517 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.239473    2579 scope.go:117] "RemoveContainer" containerID="60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd"
Jul 27 16:30:20.239829 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:30:20.239802    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd\": container with ID starting with 60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd not found: ID does not exist" containerID="60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd"
Jul 27 16:30:20.239904 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.239838    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd"} err="failed to get container status \"60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd\": rpc error: code = NotFound desc = could not find container \"60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd\": container with ID starting with 60028af5661e897fb8ca74643513ff6c872a3460ac5bac8d9f0ba8e8a93f57cd not found: ID does not exist"
Jul 27 16:30:20.239904 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.239855    2579 scope.go:117] "RemoveContainer" containerID="5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6"
Jul 27 16:30:20.240088 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:30:20.240071    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6\": container with ID starting with 5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6 not found: ID does not exist" containerID="5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6"
Jul 27 16:30:20.240132 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.240093    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6"} err="failed to get container status \"5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6\": rpc error: code = NotFound desc = could not find container \"5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6\": container with ID starting with 5f86c93b930c584f10c522206aa3e505b25a2045e7352e2ad05f814ec977d8d6 not found: ID does not exist"
Jul 27 16:30:20.255185 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.255116    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp" podStartSLOduration=2.255094933 podStartE2EDuration="2.255094933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:30:20.252199495 +0000 UTC m=+2522.933263928" watchObservedRunningTime="2026-07-27 16:30:20.255094933 +0000 UTC m=+2522.936159362"
Jul 27 16:30:20.267749 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.267714    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"]
Jul 27 16:30:20.274801 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:20.274771    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f385e1-openshift-default-66c96f6544-nljz4"]
Jul 27 16:30:21.931197 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:21.931165    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" path="/var/lib/kubelet/pods/23dfea6f-170d-46e8-8545-dac5a678deed/volumes"
Jul 27 16:30:23.467995 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.467955    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"]
Jul 27 16:30:23.469143 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.469112    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy"
Jul 27 16:30:23.469302 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.469290    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy"
Jul 27 16:30:23.469482 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.469470    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy"
Jul 27 16:30:23.469604 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.469592    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy"
Jul 27 16:30:23.476782 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.476753    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.478962 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.478938    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"]
Jul 27 16:30:23.479882 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.479861    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-478f20-openshift-default-dockercfg-wrrfz\""
Jul 27 16:30:23.555012 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.554966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-credential-socket\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.555311 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.555285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-socket\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.555447 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.555432    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-istio-token\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.555592 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.555576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c50b167-128e-4c79-b101-b29f56755b33-istiod-ca-cert\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.555698 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.555682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c50b167-128e-4c79-b101-b29f56755b33-istio-podinfo\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.555823 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.555810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-certs\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.555946 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.555932    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-envoy\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.556053 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.556037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcdqs\" (UniqueName: \"kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-kube-api-access-bcdqs\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.556161 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.556147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-data\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.657547 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.657486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-certs\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.657885 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.657858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-envoy\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.658040 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.658025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcdqs\" (UniqueName: \"kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-kube-api-access-bcdqs\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.658175 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.658162    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-data\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.658465 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.658442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-credential-socket\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.659016 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.658913    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-credential-socket\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.659148 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.659120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-data\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.659272 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.659255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-socket\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.659398 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.659385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-istio-token\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.659551 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.659533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c50b167-128e-4c79-b101-b29f56755b33-istiod-ca-cert\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.660394 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.660367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c50b167-128e-4c79-b101-b29f56755b33-istio-podinfo\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.660630 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.659848    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-socket\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.660753 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.660294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c50b167-128e-4c79-b101-b29f56755b33-istiod-ca-cert\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.660855 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.659433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-certs\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.663591 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.663538    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-envoy\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.668375 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.668033    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c50b167-128e-4c79-b101-b29f56755b33-istio-podinfo\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.671179 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.670730    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcdqs\" (UniqueName: \"kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-kube-api-access-bcdqs\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.671179 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.671142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-istio-token\") pod \"e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") " pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.792015 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.791975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:23.971089 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.968955    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"]
Jul 27 16:30:23.972650 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:30:23.972614    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c50b167_128e_4c79_b101_b29f56755b33.slice/crio-b7488117ae539b74e510ef1828134ea406cfca005140ea1c006d8b929bad0028 WatchSource:0}: Error finding container b7488117ae539b74e510ef1828134ea406cfca005140ea1c006d8b929bad0028: Status 404 returned error can't find the container with id b7488117ae539b74e510ef1828134ea406cfca005140ea1c006d8b929bad0028
Jul 27 16:30:23.974852 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.974823    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:23.974920 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.974888    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:23.974920 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:23.974915    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:24.249334 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:24.249232    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" event={"ID":"4c50b167-128e-4c79-b101-b29f56755b33","Type":"ContainerStarted","Data":"f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab"}
Jul 27 16:30:24.249753 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:24.249731    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" event={"ID":"4c50b167-128e-4c79-b101-b29f56755b33","Type":"ContainerStarted","Data":"b7488117ae539b74e510ef1828134ea406cfca005140ea1c006d8b929bad0028"}
Jul 27 16:30:24.280819 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:24.280762    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" podStartSLOduration=1.2807436669999999 podStartE2EDuration="1.280743667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:30:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:30:24.278437877 +0000 UTC m=+2526.959502312" watchObservedRunningTime="2026-07-27 16:30:24.280743667 +0000 UTC m=+2526.961808108"
Jul 27 16:30:24.792805 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:24.792752    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:25.797988 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:25.797950    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:26.262635 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:26.262543    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:26.263815 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:26.263790    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:27.251016 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.250974    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"]
Jul 27 16:30:27.251536 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.251398    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy"
Jul 27 16:30:27.251536 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.251413    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="23dfea6f-170d-46e8-8545-dac5a678deed" containerName="istio-proxy"
Jul 27 16:30:27.254702 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.254678    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:30:27.256932 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.256907    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-478f20-dockercfg-k96z7\""
Jul 27 16:30:27.257066 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.256910    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-478f20\""
Jul 27 16:30:27.268976 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.268938    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"]
Jul 27 16:30:27.311520 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.311448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljr9c\" (UniqueName: \"kubernetes.io/projected/085b79a8-6a52-48cd-ba2b-8063884bf5da-kube-api-access-ljr9c\") pod \"payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv\" (UID: \"085b79a8-6a52-48cd-ba2b-8063884bf5da\") " pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:30:27.311695 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.311577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/085b79a8-6a52-48cd-ba2b-8063884bf5da-plugins-config-volume\") pod \"payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv\" (UID: \"085b79a8-6a52-48cd-ba2b-8063884bf5da\") " pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:30:27.412864 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.412814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljr9c\" (UniqueName: \"kubernetes.io/projected/085b79a8-6a52-48cd-ba2b-8063884bf5da-kube-api-access-ljr9c\") pod \"payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv\" (UID: \"085b79a8-6a52-48cd-ba2b-8063884bf5da\") " pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:30:27.413087 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.412954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/085b79a8-6a52-48cd-ba2b-8063884bf5da-plugins-config-volume\") pod \"payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv\" (UID: \"085b79a8-6a52-48cd-ba2b-8063884bf5da\") " pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:30:27.413877 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.413851    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/085b79a8-6a52-48cd-ba2b-8063884bf5da-plugins-config-volume\") pod \"payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv\" (UID: \"085b79a8-6a52-48cd-ba2b-8063884bf5da\") " pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:30:27.422188 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.422155    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljr9c\" (UniqueName: \"kubernetes.io/projected/085b79a8-6a52-48cd-ba2b-8063884bf5da-kube-api-access-ljr9c\") pod \"payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv\" (UID: \"085b79a8-6a52-48cd-ba2b-8063884bf5da\") " pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:30:27.566358 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.566315    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:30:27.734272 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:27.734242    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"]
Jul 27 16:30:27.736013 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:30:27.735985    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod085b79a8_6a52_48cd_ba2b_8063884bf5da.slice/crio-eb05ce01797389f0d76be9b04193157d36ea8e3162ef5e3f27ba871cb31a456e WatchSource:0}: Error finding container eb05ce01797389f0d76be9b04193157d36ea8e3162ef5e3f27ba871cb31a456e: Status 404 returned error can't find the container with id eb05ce01797389f0d76be9b04193157d36ea8e3162ef5e3f27ba871cb31a456e
Jul 27 16:30:28.278988 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:28.278942    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv" event={"ID":"085b79a8-6a52-48cd-ba2b-8063884bf5da","Type":"ContainerStarted","Data":"7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de"}
Jul 27 16:30:28.279456 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:28.279010    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv" event={"ID":"085b79a8-6a52-48cd-ba2b-8063884bf5da","Type":"ContainerStarted","Data":"eb05ce01797389f0d76be9b04193157d36ea8e3162ef5e3f27ba871cb31a456e"}
Jul 27 16:30:28.279456 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:28.279264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:30:28.298627 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:28.298564    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv" podStartSLOduration=1.2985491599999999 podStartE2EDuration="1.29854916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:30:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:30:28.29669726 +0000 UTC m=+2530.977761693" watchObservedRunningTime="2026-07-27 16:30:28.29854916 +0000 UTC m=+2530.979613589"
Jul 27 16:30:29.286128 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:29.286097    2579 generic.go:356] "Generic (PLEG): container finished" podID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerID="668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780" exitCode=0
Jul 27 16:30:29.286647 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:29.286171    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" event={"ID":"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc","Type":"ContainerDied","Data":"668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780"}
Jul 27 16:30:29.286724 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:29.286655    2579 scope.go:117] "RemoveContainer" containerID="668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780"
Jul 27 16:30:29.287705 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:29.287677    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:29.287809 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:29.287741    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:29.287809 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:29.287772    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:30.293175 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:30.293144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" event={"ID":"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc","Type":"ContainerStarted","Data":"8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58"}
Jul 27 16:30:30.448211 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:30.448172    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:30.449449 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:30.449410    2579 patch_prober.go:28] interesting pod/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 27 16:30:30.449637 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:30.449483    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 27 16:30:31.230424 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:31.230371    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp" podUID="4ec2dc65-ad34-4bf9-b4cb-53550c579a92" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.132.0.73:9004: connect: connection refused"
Jul 27 16:30:31.230871 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:31.230850    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:31.448269 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:31.448228    2579 patch_prober.go:28] interesting pod/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 27 16:30:31.448828 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:31.448309    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 27 16:30:32.197898 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:32.197846    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:32.448330 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:32.448226    2579 patch_prober.go:28] interesting pod/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 27 16:30:32.448938 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:32.448906    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 27 16:30:33.447551 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:33.447486    2579 patch_prober.go:28] interesting pod/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 27 16:30:33.447815 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:33.447785    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 27 16:30:34.451587 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:34.451553    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:34.452756 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:34.452728    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:30:39.287936 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:39.287903    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:30:41.229316 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:41.229283    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:42.047360 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:42.047093    2579 patch_prober.go:28] interesting pod/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": read tcp 10.132.0.2:53474->10.132.0.75:15021: read: connection reset by peer" start-of-body=
Jul 27 16:30:42.047360 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:42.047159    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": read tcp 10.132.0.2:53474->10.132.0.75:15021: read: connection reset by peer"
Jul 27 16:30:42.366611 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:42.366518    2579 generic.go:356] "Generic (PLEG): container finished" podID="4c50b167-128e-4c79-b101-b29f56755b33" containerID="f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab" exitCode=0
Jul 27 16:30:42.366611 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:42.366598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" event={"ID":"4c50b167-128e-4c79-b101-b29f56755b33","Type":"ContainerDied","Data":"f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab"}
Jul 27 16:30:42.367098 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:42.366987    2579 scope.go:117] "RemoveContainer" containerID="f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab"
Jul 27 16:30:42.367963 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:42.367938    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:42.368016 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:42.368003    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:42.368054 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:42.368035    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:30:43.375281 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:43.375250    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" event={"ID":"4c50b167-128e-4c79-b101-b29f56755b33","Type":"ContainerStarted","Data":"6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d"}
Jul 27 16:30:43.793250 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:43.793208    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:43.793480 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:43.793456    2579 patch_prober.go:28] interesting pod/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 27 16:30:43.793564 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:43.793543    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 27 16:30:44.793306 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:44.793269    2579 patch_prober.go:28] interesting pod/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 27 16:30:44.793769 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:44.793336    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 27 16:30:45.792838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:45.792795    2579 patch_prober.go:28] interesting pod/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 27 16:30:45.793162 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:45.792864    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 27 16:30:46.792545 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:46.792470    2579 patch_prober.go:28] interesting pod/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Jul 27 16:30:46.792984 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:46.792564    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Jul 27 16:30:47.795551 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:47.795491    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:47.796019 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:47.796000    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:47.796795 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:47.796776    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:30:54.570443 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.570407    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"]
Jul 27 16:30:54.570948 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.570642    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv" podUID="a1b8030d-4cc4-4790-9d4f-470fe645bc48" containerName="payload-processing" containerID="cri-o://11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440" gracePeriod=30
Jul 27 16:30:54.576541 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.576510    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"]
Jul 27 16:30:54.576794 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.576744    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp" podUID="4ec2dc65-ad34-4bf9-b4cb-53550c579a92" containerName="payload-pre-processing" containerID="cri-o://8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2" gracePeriod=30
Jul 27 16:30:54.833097 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.833036    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:54.870841 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.870813    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:54.887391 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.887352    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1b8030d-4cc4-4790-9d4f-470fe645bc48-plugins-config-volume\") pod \"a1b8030d-4cc4-4790-9d4f-470fe645bc48\" (UID: \"a1b8030d-4cc4-4790-9d4f-470fe645bc48\") "
Jul 27 16:30:54.887572 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.887434    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-plugins-config-volume\") pod \"4ec2dc65-ad34-4bf9-b4cb-53550c579a92\" (UID: \"4ec2dc65-ad34-4bf9-b4cb-53550c579a92\") "
Jul 27 16:30:54.887572 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.887468    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mncf\" (UniqueName: \"kubernetes.io/projected/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-kube-api-access-6mncf\") pod \"4ec2dc65-ad34-4bf9-b4cb-53550c579a92\" (UID: \"4ec2dc65-ad34-4bf9-b4cb-53550c579a92\") "
Jul 27 16:30:54.887572 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.887512    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8snbf\" (UniqueName: \"kubernetes.io/projected/a1b8030d-4cc4-4790-9d4f-470fe645bc48-kube-api-access-8snbf\") pod \"a1b8030d-4cc4-4790-9d4f-470fe645bc48\" (UID: \"a1b8030d-4cc4-4790-9d4f-470fe645bc48\") "
Jul 27 16:30:54.887809 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.887784    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1b8030d-4cc4-4790-9d4f-470fe645bc48-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a1b8030d-4cc4-4790-9d4f-470fe645bc48" (UID: "a1b8030d-4cc4-4790-9d4f-470fe645bc48"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:30:54.887904 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.887882    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ec2dc65-ad34-4bf9-b4cb-53550c579a92" (UID: "4ec2dc65-ad34-4bf9-b4cb-53550c579a92"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:30:54.889703 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.889669    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-kube-api-access-6mncf" (OuterVolumeSpecName: "kube-api-access-6mncf") pod "4ec2dc65-ad34-4bf9-b4cb-53550c579a92" (UID: "4ec2dc65-ad34-4bf9-b4cb-53550c579a92"). InnerVolumeSpecName "kube-api-access-6mncf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:30:54.889813 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.889715    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1b8030d-4cc4-4790-9d4f-470fe645bc48-kube-api-access-8snbf" (OuterVolumeSpecName: "kube-api-access-8snbf") pod "a1b8030d-4cc4-4790-9d4f-470fe645bc48" (UID: "a1b8030d-4cc4-4790-9d4f-470fe645bc48"). InnerVolumeSpecName "kube-api-access-8snbf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:30:54.988636 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.988600    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1b8030d-4cc4-4790-9d4f-470fe645bc48-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:54.988636 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.988630    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:54.988636 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.988639    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mncf\" (UniqueName: \"kubernetes.io/projected/4ec2dc65-ad34-4bf9-b4cb-53550c579a92-kube-api-access-6mncf\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:54.988636 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:54.988648    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8snbf\" (UniqueName: \"kubernetes.io/projected/a1b8030d-4cc4-4790-9d4f-470fe645bc48-kube-api-access-8snbf\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:30:55.447573 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.447533    2579 generic.go:356] "Generic (PLEG): container finished" podID="a1b8030d-4cc4-4790-9d4f-470fe645bc48" containerID="11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440" exitCode=0
Jul 27 16:30:55.447573 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.447567    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"
Jul 27 16:30:55.447816 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.447598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv" event={"ID":"a1b8030d-4cc4-4790-9d4f-470fe645bc48","Type":"ContainerDied","Data":"11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440"}
Jul 27 16:30:55.447816 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.447652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv" event={"ID":"a1b8030d-4cc4-4790-9d4f-470fe645bc48","Type":"ContainerDied","Data":"c720d13e2b5acc282d5784759a75e6b004754a49f71534a9118333bdfba99185"}
Jul 27 16:30:55.447816 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.447675    2579 scope.go:117] "RemoveContainer" containerID="11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440"
Jul 27 16:30:55.449180 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.449152    2579 generic.go:356] "Generic (PLEG): container finished" podID="4ec2dc65-ad34-4bf9-b4cb-53550c579a92" containerID="8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2" exitCode=0
Jul 27 16:30:55.449294 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.449194    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"
Jul 27 16:30:55.449294 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.449208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp" event={"ID":"4ec2dc65-ad34-4bf9-b4cb-53550c579a92","Type":"ContainerDied","Data":"8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2"}
Jul 27 16:30:55.449294 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.449248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp" event={"ID":"4ec2dc65-ad34-4bf9-b4cb-53550c579a92","Type":"ContainerDied","Data":"5bfba739a9b3a22468ded6ea0c32830c1d0cf101cc79b9db389c8d0930aa7f00"}
Jul 27 16:30:55.464075 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.464053    2579 scope.go:117] "RemoveContainer" containerID="11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440"
Jul 27 16:30:55.464366 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:30:55.464348    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440\": container with ID starting with 11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440 not found: ID does not exist" containerID="11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440"
Jul 27 16:30:55.464415 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.464373    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440"} err="failed to get container status \"11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440\": rpc error: code = NotFound desc = could not find container \"11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440\": container with ID starting with 11dd84fe95132f8d53127d1a5e4afb09fc5776eef5f660cf7f307ec726d79440 not found: ID does not exist"
Jul 27 16:30:55.464415 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.464390    2579 scope.go:117] "RemoveContainer" containerID="8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2"
Jul 27 16:30:55.472801 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.472780    2579 scope.go:117] "RemoveContainer" containerID="8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2"
Jul 27 16:30:55.473114 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:30:55.473094    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2\": container with ID starting with 8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2 not found: ID does not exist" containerID="8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2"
Jul 27 16:30:55.473170 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.473122    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2"} err="failed to get container status \"8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2\": rpc error: code = NotFound desc = could not find container \"8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2\": container with ID starting with 8f99bc46fc10766261e49ec50b6eefef00dea32b25204f95279c77b73f4145a2 not found: ID does not exist"
Jul 27 16:30:55.477589 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.477570    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"]
Jul 27 16:30:55.481247 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.481225    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-d2ac7b-ff7d58f6b-xf9xv"]
Jul 27 16:30:55.490973 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.490949    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"]
Jul 27 16:30:55.495109 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.495087    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-d2ac7b-6cb6699cb-2gptp"]
Jul 27 16:30:55.931456 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.931424    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ec2dc65-ad34-4bf9-b4cb-53550c579a92" path="/var/lib/kubelet/pods/4ec2dc65-ad34-4bf9-b4cb-53550c579a92/volumes"
Jul 27 16:30:55.931894 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:30:55.931864    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b8030d-4cc4-4790-9d4f-470fe645bc48" path="/var/lib/kubelet/pods/a1b8030d-4cc4-4790-9d4f-470fe645bc48/volumes"
Jul 27 16:31:05.754231 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:05.754196    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"]
Jul 27 16:31:05.754748 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:05.754427    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerName="istio-proxy" containerID="cri-o://8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58" gracePeriod=30
Jul 27 16:31:11.013976 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.013949    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:31:11.141467 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.141435    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-data\") pod \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") "
Jul 27 16:31:11.141678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.141486    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whhl5\" (UniqueName: \"kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-kube-api-access-whhl5\") pod \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") "
Jul 27 16:31:11.141678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.141522    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istiod-ca-cert\") pod \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") "
Jul 27 16:31:11.141678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.141545    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-token\") pod \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") "
Jul 27 16:31:11.141678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.141562    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-envoy\") pod \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") "
Jul 27 16:31:11.141678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.141592    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-podinfo\") pod \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") "
Jul 27 16:31:11.141678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.141626    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-certs\") pod \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") "
Jul 27 16:31:11.141678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.141659    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-socket\") pod \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") "
Jul 27 16:31:11.142056 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.141709    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-credential-socket\") pod \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\" (UID: \"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc\") "
Jul 27 16:31:11.142056 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.141925    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" (UID: "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:31:11.142056 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.142044    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:11.142242 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.142078    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" (UID: "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:31:11.142242 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.142118    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" (UID: "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:31:11.142242 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.142163    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" (UID: "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:31:11.142398 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.142309    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-data" (OuterVolumeSpecName: "istio-data") pod "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" (UID: "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:31:11.143920 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.143888    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-token" (OuterVolumeSpecName: "istio-token") pod "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" (UID: "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:31:11.144049 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.143947    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-kube-api-access-whhl5" (OuterVolumeSpecName: "kube-api-access-whhl5") pod "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" (UID: "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc"). InnerVolumeSpecName "kube-api-access-whhl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:31:11.144049 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.143973    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" (UID: "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:31:11.144049 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.144021    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" (UID: "7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:31:11.242947 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.242906    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:11.242947 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.242943    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:11.242947 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.242956    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whhl5\" (UniqueName: \"kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-kube-api-access-whhl5\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:11.243199 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.242969    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:11.243199 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.242980    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:11.243199 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.242991    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:11.243199 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.243001    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:11.243199 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.243012    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:11.538562 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.538530    2579 generic.go:356] "Generic (PLEG): container finished" podID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerID="8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58" exitCode=0
Jul 27 16:31:11.538780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.538578    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"
Jul 27 16:31:11.538780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.538622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" event={"ID":"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc","Type":"ContainerDied","Data":"8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58"}
Jul 27 16:31:11.538780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.538683    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw" event={"ID":"7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc","Type":"ContainerDied","Data":"4c2b6244509481816533b573b0b8ec84a778e2c9675cda79f7b8c9492539eba4"}
Jul 27 16:31:11.538780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.538714    2579 scope.go:117] "RemoveContainer" containerID="8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58"
Jul 27 16:31:11.550981 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.550957    2579 scope.go:117] "RemoveContainer" containerID="668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780"
Jul 27 16:31:11.561478 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.561416    2579 scope.go:117] "RemoveContainer" containerID="8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58"
Jul 27 16:31:11.561902 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:31:11.561867    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58\": container with ID starting with 8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58 not found: ID does not exist" containerID="8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58"
Jul 27 16:31:11.561996 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.561913    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58"} err="failed to get container status \"8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58\": rpc error: code = NotFound desc = could not find container \"8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58\": container with ID starting with 8d69db0dbe88d0556545570a711d63a3a6851002f18e97f99c1c67b4f01c1c58 not found: ID does not exist"
Jul 27 16:31:11.561996 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.561940    2579 scope.go:117] "RemoveContainer" containerID="668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780"
Jul 27 16:31:11.562299 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:31:11.562278    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780\": container with ID starting with 668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780 not found: ID does not exist" containerID="668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780"
Jul 27 16:31:11.562343 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.562306    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780"} err="failed to get container status \"668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780\": rpc error: code = NotFound desc = could not find container \"668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780\": container with ID starting with 668748465a31cc1f1e44bb765364bd6e1cf4343833eb96c9b98df77cfc002780 not found: ID does not exist"
Jul 27 16:31:11.564613 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.564587    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"]
Jul 27 16:31:11.566796 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.566777    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-d2ac7b-openshift-default-9d7757c58-5v4zw"]
Jul 27 16:31:11.931002 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:11.930921    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" path="/var/lib/kubelet/pods/7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc/volumes"
Jul 27 16:31:21.795149 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:21.795116    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"]
Jul 27 16:31:21.795819 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:21.795327    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv" podUID="085b79a8-6a52-48cd-ba2b-8063884bf5da" containerName="payload-processing" containerID="cri-o://7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de" gracePeriod=30
Jul 27 16:31:22.051263 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.051195    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:31:22.148265 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.148230    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljr9c\" (UniqueName: \"kubernetes.io/projected/085b79a8-6a52-48cd-ba2b-8063884bf5da-kube-api-access-ljr9c\") pod \"085b79a8-6a52-48cd-ba2b-8063884bf5da\" (UID: \"085b79a8-6a52-48cd-ba2b-8063884bf5da\") "
Jul 27 16:31:22.148471 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.148341    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/085b79a8-6a52-48cd-ba2b-8063884bf5da-plugins-config-volume\") pod \"085b79a8-6a52-48cd-ba2b-8063884bf5da\" (UID: \"085b79a8-6a52-48cd-ba2b-8063884bf5da\") "
Jul 27 16:31:22.148777 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.148754    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/085b79a8-6a52-48cd-ba2b-8063884bf5da-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "085b79a8-6a52-48cd-ba2b-8063884bf5da" (UID: "085b79a8-6a52-48cd-ba2b-8063884bf5da"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:31:22.150332 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.150312    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085b79a8-6a52-48cd-ba2b-8063884bf5da-kube-api-access-ljr9c" (OuterVolumeSpecName: "kube-api-access-ljr9c") pod "085b79a8-6a52-48cd-ba2b-8063884bf5da" (UID: "085b79a8-6a52-48cd-ba2b-8063884bf5da"). InnerVolumeSpecName "kube-api-access-ljr9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:31:22.249120 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.249085    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/085b79a8-6a52-48cd-ba2b-8063884bf5da-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:22.249120 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.249117    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljr9c\" (UniqueName: \"kubernetes.io/projected/085b79a8-6a52-48cd-ba2b-8063884bf5da-kube-api-access-ljr9c\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:22.601123 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.601087    2579 generic.go:356] "Generic (PLEG): container finished" podID="085b79a8-6a52-48cd-ba2b-8063884bf5da" containerID="7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de" exitCode=0
Jul 27 16:31:22.601315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.601137    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"
Jul 27 16:31:22.601315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.601179    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv" event={"ID":"085b79a8-6a52-48cd-ba2b-8063884bf5da","Type":"ContainerDied","Data":"7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de"}
Jul 27 16:31:22.601315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.601235    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv" event={"ID":"085b79a8-6a52-48cd-ba2b-8063884bf5da","Type":"ContainerDied","Data":"eb05ce01797389f0d76be9b04193157d36ea8e3162ef5e3f27ba871cb31a456e"}
Jul 27 16:31:22.601315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.601260    2579 scope.go:117] "RemoveContainer" containerID="7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de"
Jul 27 16:31:22.610731 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.610711    2579 scope.go:117] "RemoveContainer" containerID="7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de"
Jul 27 16:31:22.611013 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:31:22.610991    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de\": container with ID starting with 7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de not found: ID does not exist" containerID="7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de"
Jul 27 16:31:22.611079 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.611027    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de"} err="failed to get container status \"7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de\": rpc error: code = NotFound desc = could not find container \"7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de\": container with ID starting with 7946ef2e0dc0551cb5d15882526c7c159e9bf26f52c61c2fb8cf20d9a0ab57de not found: ID does not exist"
Jul 27 16:31:22.623684 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.623655    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"]
Jul 27 16:31:22.629276 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:22.629244    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-478f20-ff68b7884-w2tpv"]
Jul 27 16:31:23.930034 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:23.929997    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="085b79a8-6a52-48cd-ba2b-8063884bf5da" path="/var/lib/kubelet/pods/085b79a8-6a52-48cd-ba2b-8063884bf5da/volumes"
Jul 27 16:31:33.284323 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:33.284286    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"]
Jul 27 16:31:33.284806 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:33.284565    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy" containerID="cri-o://6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d" gracePeriod=30
Jul 27 16:31:34.177112 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177082    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"]
Jul 27 16:31:34.177424 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177412    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerName="istio-proxy"
Jul 27 16:31:34.177471 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177426    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerName="istio-proxy"
Jul 27 16:31:34.177471 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177438    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ec2dc65-ad34-4bf9-b4cb-53550c579a92" containerName="payload-pre-processing"
Jul 27 16:31:34.177471 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177444    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ec2dc65-ad34-4bf9-b4cb-53550c579a92" containerName="payload-pre-processing"
Jul 27 16:31:34.177471 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177451    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b8030d-4cc4-4790-9d4f-470fe645bc48" containerName="payload-processing"
Jul 27 16:31:34.177471 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177457    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b8030d-4cc4-4790-9d4f-470fe645bc48" containerName="payload-processing"
Jul 27 16:31:34.177471 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177470    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085b79a8-6a52-48cd-ba2b-8063884bf5da" containerName="payload-processing"
Jul 27 16:31:34.177678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177476    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="085b79a8-6a52-48cd-ba2b-8063884bf5da" containerName="payload-processing"
Jul 27 16:31:34.177678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177485    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerName="istio-proxy"
Jul 27 16:31:34.177678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177490    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerName="istio-proxy"
Jul 27 16:31:34.177678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177576    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ec2dc65-ad34-4bf9-b4cb-53550c579a92" containerName="payload-pre-processing"
Jul 27 16:31:34.177678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177583    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b8030d-4cc4-4790-9d4f-470fe645bc48" containerName="payload-processing"
Jul 27 16:31:34.177678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177590    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerName="istio-proxy"
Jul 27 16:31:34.177678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177596    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="085b79a8-6a52-48cd-ba2b-8063884bf5da" containerName="payload-processing"
Jul 27 16:31:34.177678 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.177602    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cc92ed2-bb0f-4f0c-b568-ed8bd66b9ebc" containerName="istio-proxy"
Jul 27 16:31:34.179971 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.179950    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.182047 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.182021    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-932843-openshift-default-dockercfg-cpb2t\""
Jul 27 16:31:34.194255 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.194227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"]
Jul 27 16:31:34.357148 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.357106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-envoy\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.357643 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.357165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-socket\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.357643 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.357224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-podinfo\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.357643 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.357281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjqxh\" (UniqueName: \"kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-kube-api-access-rjqxh\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.357643 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.357309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-certs\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.357643 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.357406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cec0030-501f-46fa-bc8e-9e642e061a77-istiod-ca-cert\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.357643 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.357451    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-credential-socket\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.357643 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.357480    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-data\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.357643 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.357531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-token\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.458944 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.458851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-data\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.458944 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.458900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-token\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.458944 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.458932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-envoy\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.459232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.458967    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-socket\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.459232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.458995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-podinfo\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.459232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.459041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjqxh\" (UniqueName: \"kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-kube-api-access-rjqxh\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.459232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.459083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-certs\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.459232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.459131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cec0030-501f-46fa-bc8e-9e642e061a77-istiod-ca-cert\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.459232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.459191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-credential-socket\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.459524 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.459287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-data\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.459661 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.459613    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-socket\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.459801 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.459783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-certs\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.459870 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.459836    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-credential-socket\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.459914 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.459891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cec0030-501f-46fa-bc8e-9e642e061a77-istiod-ca-cert\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.461574 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.461551    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-envoy\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.461708 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.461689    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-podinfo\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.467195 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.467171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-token\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.467755 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.467736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjqxh\" (UniqueName: \"kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-kube-api-access-rjqxh\") pod \"e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") " pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.490399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.490368    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:34.640686 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.640660    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"]
Jul 27 16:31:34.642144 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:31:34.642108    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cec0030_501f_46fa_bc8e_9e642e061a77.slice/crio-eb60183334f4b86f63b447a59b417c43ead0df87f17067bcd5ce9c6fa34179f9 WatchSource:0}: Error finding container eb60183334f4b86f63b447a59b417c43ead0df87f17067bcd5ce9c6fa34179f9: Status 404 returned error can't find the container with id eb60183334f4b86f63b447a59b417c43ead0df87f17067bcd5ce9c6fa34179f9
Jul 27 16:31:34.644311 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.644280    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:31:34.644408 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.644343    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:31:34.644408 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.644370    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:31:34.672313 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:34.672286    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" event={"ID":"9cec0030-501f-46fa-bc8e-9e642e061a77","Type":"ContainerStarted","Data":"eb60183334f4b86f63b447a59b417c43ead0df87f17067bcd5ce9c6fa34179f9"}
Jul 27 16:31:35.685037 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:35.684987    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" event={"ID":"9cec0030-501f-46fa-bc8e-9e642e061a77","Type":"ContainerStarted","Data":"5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4"}
Jul 27 16:31:35.707669 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:35.707610    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" podStartSLOduration=1.70759201 podStartE2EDuration="1.70759201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:31:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:31:35.704683712 +0000 UTC m=+2598.385748143" watchObservedRunningTime="2026-07-27 16:31:35.70759201 +0000 UTC m=+2598.388656439"
Jul 27 16:31:36.491295 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:36.491261    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:36.496197 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:36.496169    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:36.690822 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:36.690788    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:36.691764 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:36.691744    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:38.354232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.354192    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"]
Jul 27 16:31:38.356679 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.356662    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:31:38.359673 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.359650    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-932843\""
Jul 27 16:31:38.359775 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.359690    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-932843-dockercfg-htnvp\""
Jul 27 16:31:38.370553 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.370527    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"]
Jul 27 16:31:38.388679 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.388647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl\" (UID: \"4121c4c3-bea8-4d47-8a42-611c8e17c5ec\") " pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:31:38.388854 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.388697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shhbk\" (UniqueName: \"kubernetes.io/projected/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-kube-api-access-shhbk\") pod \"payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl\" (UID: \"4121c4c3-bea8-4d47-8a42-611c8e17c5ec\") " pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:31:38.392980 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.392951    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"]
Jul 27 16:31:38.395579 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.395560    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:31:38.409736 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.409711    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"]
Jul 27 16:31:38.489464 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.489430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl\" (UID: \"4121c4c3-bea8-4d47-8a42-611c8e17c5ec\") " pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:31:38.489679 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.489482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shhbk\" (UniqueName: \"kubernetes.io/projected/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-kube-api-access-shhbk\") pod \"payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl\" (UID: \"4121c4c3-bea8-4d47-8a42-611c8e17c5ec\") " pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:31:38.489679 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.489570    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v\" (UID: \"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:31:38.489679 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.489635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgnhf\" (UniqueName: \"kubernetes.io/projected/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-kube-api-access-kgnhf\") pod \"payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v\" (UID: \"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:31:38.490215 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.490189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl\" (UID: \"4121c4c3-bea8-4d47-8a42-611c8e17c5ec\") " pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:31:38.497960 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.497935    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shhbk\" (UniqueName: \"kubernetes.io/projected/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-kube-api-access-shhbk\") pod \"payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl\" (UID: \"4121c4c3-bea8-4d47-8a42-611c8e17c5ec\") " pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:31:38.551235 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.551164    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:31:38.590124 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590093    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-envoy\") pod \"4c50b167-128e-4c79-b101-b29f56755b33\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") "
Jul 27 16:31:38.590124 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590128    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcdqs\" (UniqueName: \"kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-kube-api-access-bcdqs\") pod \"4c50b167-128e-4c79-b101-b29f56755b33\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") "
Jul 27 16:31:38.590391 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590150    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-certs\") pod \"4c50b167-128e-4c79-b101-b29f56755b33\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") "
Jul 27 16:31:38.590391 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590180    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-istio-token\") pod \"4c50b167-128e-4c79-b101-b29f56755b33\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") "
Jul 27 16:31:38.590391 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590195    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-data\") pod \"4c50b167-128e-4c79-b101-b29f56755b33\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") "
Jul 27 16:31:38.590391 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590265    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-socket\") pod \"4c50b167-128e-4c79-b101-b29f56755b33\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") "
Jul 27 16:31:38.590391 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590289    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c50b167-128e-4c79-b101-b29f56755b33-istiod-ca-cert\") pod \"4c50b167-128e-4c79-b101-b29f56755b33\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") "
Jul 27 16:31:38.590391 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590316    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-credential-socket\") pod \"4c50b167-128e-4c79-b101-b29f56755b33\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") "
Jul 27 16:31:38.590391 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590378    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c50b167-128e-4c79-b101-b29f56755b33-istio-podinfo\") pod \"4c50b167-128e-4c79-b101-b29f56755b33\" (UID: \"4c50b167-128e-4c79-b101-b29f56755b33\") "
Jul 27 16:31:38.590764 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590448    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c50b167-128e-4c79-b101-b29f56755b33" (UID: "4c50b167-128e-4c79-b101-b29f56755b33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:31:38.590764 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590580    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v\" (UID: \"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:31:38.590764 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgnhf\" (UniqueName: \"kubernetes.io/projected/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-kube-api-access-kgnhf\") pod \"payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v\" (UID: \"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:31:38.590894 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590760    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c50b167-128e-4c79-b101-b29f56755b33" (UID: "4c50b167-128e-4c79-b101-b29f56755b33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:31:38.590894 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590772    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c50b167-128e-4c79-b101-b29f56755b33-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c50b167-128e-4c79-b101-b29f56755b33" (UID: "4c50b167-128e-4c79-b101-b29f56755b33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:31:38.590894 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.590815    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:38.591195 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.591170    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c50b167-128e-4c79-b101-b29f56755b33" (UID: "4c50b167-128e-4c79-b101-b29f56755b33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:31:38.591828 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.591802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v\" (UID: \"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:31:38.592019 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.591994    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c50b167-128e-4c79-b101-b29f56755b33" (UID: "4c50b167-128e-4c79-b101-b29f56755b33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:31:38.592873 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.592833    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c50b167-128e-4c79-b101-b29f56755b33-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c50b167-128e-4c79-b101-b29f56755b33" (UID: "4c50b167-128e-4c79-b101-b29f56755b33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:31:38.592954 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.592909    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c50b167-128e-4c79-b101-b29f56755b33" (UID: "4c50b167-128e-4c79-b101-b29f56755b33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:31:38.592954 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.592927    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-kube-api-access-bcdqs" (OuterVolumeSpecName: "kube-api-access-bcdqs") pod "4c50b167-128e-4c79-b101-b29f56755b33" (UID: "4c50b167-128e-4c79-b101-b29f56755b33"). InnerVolumeSpecName "kube-api-access-bcdqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:31:38.593128 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.593105    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c50b167-128e-4c79-b101-b29f56755b33" (UID: "4c50b167-128e-4c79-b101-b29f56755b33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:31:38.598966 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.598936    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgnhf\" (UniqueName: \"kubernetes.io/projected/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-kube-api-access-kgnhf\") pod \"payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v\" (UID: \"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:31:38.666790 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.666749    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:31:38.691997 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.691970    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:38.692112 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.692000    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c50b167-128e-4c79-b101-b29f56755b33-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:38.692112 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.692018    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:38.692112 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.692032    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c50b167-128e-4c79-b101-b29f56755b33-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:38.692112 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.692044    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:38.692112 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.692058    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcdqs\" (UniqueName: \"kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-kube-api-access-bcdqs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:38.692112 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.692070    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c50b167-128e-4c79-b101-b29f56755b33-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:38.692112 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.692082    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c50b167-128e-4c79-b101-b29f56755b33-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:31:38.702544 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.702511    2579 generic.go:356] "Generic (PLEG): container finished" podID="4c50b167-128e-4c79-b101-b29f56755b33" containerID="6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d" exitCode=0
Jul 27 16:31:38.702677 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.702565    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"
Jul 27 16:31:38.702677 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.702601    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" event={"ID":"4c50b167-128e-4c79-b101-b29f56755b33","Type":"ContainerDied","Data":"6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d"}
Jul 27 16:31:38.702677 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.702658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp" event={"ID":"4c50b167-128e-4c79-b101-b29f56755b33","Type":"ContainerDied","Data":"b7488117ae539b74e510ef1828134ea406cfca005140ea1c006d8b929bad0028"}
Jul 27 16:31:38.702777 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.702681    2579 scope.go:117] "RemoveContainer" containerID="6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d"
Jul 27 16:31:38.705782 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.705755    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:31:38.712984 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.712966    2579 scope.go:117] "RemoveContainer" containerID="f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab"
Jul 27 16:31:38.729098 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.729050    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"]
Jul 27 16:31:38.732377 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.732342    2579 scope.go:117] "RemoveContainer" containerID="6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d"
Jul 27 16:31:38.732771 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:31:38.732729    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d\": container with ID starting with 6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d not found: ID does not exist" containerID="6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d"
Jul 27 16:31:38.732906 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.732768    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d"} err="failed to get container status \"6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d\": rpc error: code = NotFound desc = could not find container \"6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d\": container with ID starting with 6fb05a98f46b239bcccb8525c0f1716fe9cb53159336b59473e4cff144c2968d not found: ID does not exist"
Jul 27 16:31:38.732906 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.732797    2579 scope.go:117] "RemoveContainer" containerID="f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab"
Jul 27 16:31:38.733213 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:31:38.733186    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab\": container with ID starting with f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab not found: ID does not exist" containerID="f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab"
Jul 27 16:31:38.733329 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.733219    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab"} err="failed to get container status \"f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab\": rpc error: code = NotFound desc = could not find container \"f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab\": container with ID starting with f96fb9f866f21b23d9a7bb33329980a0759eb55fd2aa3b2c961b5aec7d43c7ab not found: ID does not exist"
Jul 27 16:31:38.734057 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.734030    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-478f20-openshift-default-77c87d8f76-spdtp"]
Jul 27 16:31:38.816429 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.816380    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"]
Jul 27 16:31:38.816961 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:31:38.816926    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4121c4c3_bea8_4d47_8a42_611c8e17c5ec.slice/crio-5023917ddac33b0ebcca576318872b3cdc9ef3ff7f3426ea19b38906a31d1923 WatchSource:0}: Error finding container 5023917ddac33b0ebcca576318872b3cdc9ef3ff7f3426ea19b38906a31d1923: Status 404 returned error can't find the container with id 5023917ddac33b0ebcca576318872b3cdc9ef3ff7f3426ea19b38906a31d1923
Jul 27 16:31:38.868610 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:38.868586    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"]
Jul 27 16:31:38.870115 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:31:38.870090    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65f1a72_ced7_40ac_aaa0_7ca59eb5d882.slice/crio-d8c22afdf1dc98b34e66b5b0e562c6b2713555fefdd59a99dcd7efff1770430f WatchSource:0}: Error finding container d8c22afdf1dc98b34e66b5b0e562c6b2713555fefdd59a99dcd7efff1770430f: Status 404 returned error can't find the container with id d8c22afdf1dc98b34e66b5b0e562c6b2713555fefdd59a99dcd7efff1770430f
Jul 27 16:31:39.711314 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:39.711226    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v" event={"ID":"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882","Type":"ContainerStarted","Data":"ac4e65654cd879b59a817d96b2ba96c6befdef701bea39f2665f8f8acf9515a8"}
Jul 27 16:31:39.711314 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:39.711278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v" event={"ID":"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882","Type":"ContainerStarted","Data":"d8c22afdf1dc98b34e66b5b0e562c6b2713555fefdd59a99dcd7efff1770430f"}
Jul 27 16:31:39.711805 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:39.711338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:31:39.712828 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:39.712803    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl" event={"ID":"4121c4c3-bea8-4d47-8a42-611c8e17c5ec","Type":"ContainerStarted","Data":"8dfd14d21eadb4a72ff4fc95500ef3b2596faf4b796b2377afac27ee83ccb3a0"}
Jul 27 16:31:39.712925 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:39.712845    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl" event={"ID":"4121c4c3-bea8-4d47-8a42-611c8e17c5ec","Type":"ContainerStarted","Data":"5023917ddac33b0ebcca576318872b3cdc9ef3ff7f3426ea19b38906a31d1923"}
Jul 27 16:31:39.712925 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:39.712888    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:31:39.728218 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:39.728170    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v" podStartSLOduration=1.728153687 podStartE2EDuration="1.728153687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:31:39.725993003 +0000 UTC m=+2602.407057433" watchObservedRunningTime="2026-07-27 16:31:39.728153687 +0000 UTC m=+2602.409218117"
Jul 27 16:31:39.740729 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:39.740680    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl" podStartSLOduration=1.740666761 podStartE2EDuration="1.740666761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:31:39.739266737 +0000 UTC m=+2602.420331166" watchObservedRunningTime="2026-07-27 16:31:39.740666761 +0000 UTC m=+2602.421731191"
Jul 27 16:31:39.930310 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:39.930273    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c50b167-128e-4c79-b101-b29f56755b33" path="/var/lib/kubelet/pods/4c50b167-128e-4c79-b101-b29f56755b33/volumes"
Jul 27 16:31:42.785179 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.785145    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"]
Jul 27 16:31:42.785663 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.785573    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy"
Jul 27 16:31:42.785663 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.785590    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy"
Jul 27 16:31:42.785663 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.785615    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy"
Jul 27 16:31:42.785663 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.785622    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy"
Jul 27 16:31:42.785944 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.785678    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy"
Jul 27 16:31:42.785944 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.785687    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c50b167-128e-4c79-b101-b29f56755b33" containerName="istio-proxy"
Jul 27 16:31:42.788324 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.788302    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.791489 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.791464    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-1f21d6-openshift-default-dockercfg-4zs76\""
Jul 27 16:31:42.802628 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.802602    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"]
Jul 27 16:31:42.828625 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.828592    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-envoy\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.828625 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.828638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-data\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.828885 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.828698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-socket\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.828885 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.828730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc385e67-553d-42a2-99b2-9fae9a728c21-istiod-ca-cert\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.828885 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.828756    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-credential-socket\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.828885 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.828784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-token\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.828885 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.828879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-podinfo\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.829174 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.828906    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmf9p\" (UniqueName: \"kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-kube-api-access-jmf9p\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.829174 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.828933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-certs\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.930270 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-certs\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.930270 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-envoy\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.930547 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-data\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.930547 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930339    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-socket\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.930547 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc385e67-553d-42a2-99b2-9fae9a728c21-istiod-ca-cert\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.930547 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-credential-socket\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.930547 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-token\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.930547 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-podinfo\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.930547 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmf9p\" (UniqueName: \"kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-kube-api-access-jmf9p\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.930931 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-certs\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.930931 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930782    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-data\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.931037 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.930966    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-credential-socket\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.931168 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.931145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-socket\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.931627 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.931601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc385e67-553d-42a2-99b2-9fae9a728c21-istiod-ca-cert\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.932943 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.932922    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-envoy\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.933536 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.933518    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-podinfo\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.944965 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.944940    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmf9p\" (UniqueName: \"kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-kube-api-access-jmf9p\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:42.945122 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:42.945101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-token\") pod \"e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") " pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:43.099792 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:43.099691    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:43.236380 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:43.236355    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"]
Jul 27 16:31:43.237762 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:31:43.237733    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc385e67_553d_42a2_99b2_9fae9a728c21.slice/crio-ad305b00b1e252ab5fdb69e186ab42cd46137179326b427bb959d152960a4158 WatchSource:0}: Error finding container ad305b00b1e252ab5fdb69e186ab42cd46137179326b427bb959d152960a4158: Status 404 returned error can't find the container with id ad305b00b1e252ab5fdb69e186ab42cd46137179326b427bb959d152960a4158
Jul 27 16:31:43.240001 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:43.239971    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:31:43.240090 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:43.240035    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:31:43.240090 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:43.240069    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:31:43.736059 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:43.736027    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" event={"ID":"dc385e67-553d-42a2-99b2-9fae9a728c21","Type":"ContainerStarted","Data":"49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000"}
Jul 27 16:31:43.736257 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:43.736078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" event={"ID":"dc385e67-553d-42a2-99b2-9fae9a728c21","Type":"ContainerStarted","Data":"ad305b00b1e252ab5fdb69e186ab42cd46137179326b427bb959d152960a4158"}
Jul 27 16:31:43.755969 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:43.755903    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" podStartSLOduration=1.755882443 podStartE2EDuration="1.755882443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:31:43.755230901 +0000 UTC m=+2606.436295356" watchObservedRunningTime="2026-07-27 16:31:43.755882443 +0000 UTC m=+2606.436946873"
Jul 27 16:31:44.099906 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:44.099867    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:44.105193 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:44.105159    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:44.742289 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:44.742247    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:44.743208 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:44.743181    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:31:46.378318 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.378282    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"]
Jul 27 16:31:46.380962 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.380946    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:31:46.383141 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.383116    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-1f21d6\""
Jul 27 16:31:46.383273 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.383213    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-1f21d6-dockercfg-mqmsv\""
Jul 27 16:31:46.390831 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.390805    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"]
Jul 27 16:31:46.464520 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.464215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rsrr\" (UniqueName: \"kubernetes.io/projected/76a7a7d2-5acd-4cde-8457-cc808469c3ae-kube-api-access-8rsrr\") pod \"payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck\" (UID: \"76a7a7d2-5acd-4cde-8457-cc808469c3ae\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:31:46.464520 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.464304    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76a7a7d2-5acd-4cde-8457-cc808469c3ae-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck\" (UID: \"76a7a7d2-5acd-4cde-8457-cc808469c3ae\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:31:46.565798 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.565744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rsrr\" (UniqueName: \"kubernetes.io/projected/76a7a7d2-5acd-4cde-8457-cc808469c3ae-kube-api-access-8rsrr\") pod \"payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck\" (UID: \"76a7a7d2-5acd-4cde-8457-cc808469c3ae\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:31:46.566046 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.565847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76a7a7d2-5acd-4cde-8457-cc808469c3ae-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck\" (UID: \"76a7a7d2-5acd-4cde-8457-cc808469c3ae\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:31:46.566890 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.566858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76a7a7d2-5acd-4cde-8457-cc808469c3ae-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck\" (UID: \"76a7a7d2-5acd-4cde-8457-cc808469c3ae\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:31:46.576512 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.576453    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rsrr\" (UniqueName: \"kubernetes.io/projected/76a7a7d2-5acd-4cde-8457-cc808469c3ae-kube-api-access-8rsrr\") pod \"payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck\" (UID: \"76a7a7d2-5acd-4cde-8457-cc808469c3ae\") " pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:31:46.692131 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.692038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:31:46.873206 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:46.873074    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"]
Jul 27 16:31:46.876175 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:31:46.876145    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a7a7d2_5acd_4cde_8457_cc808469c3ae.slice/crio-7582266ca0cff6c9ae5c24cd67b0ceb5231b093dcd758ef759c17cfc55d8e29b WatchSource:0}: Error finding container 7582266ca0cff6c9ae5c24cd67b0ceb5231b093dcd758ef759c17cfc55d8e29b: Status 404 returned error can't find the container with id 7582266ca0cff6c9ae5c24cd67b0ceb5231b093dcd758ef759c17cfc55d8e29b
Jul 27 16:31:47.770350 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:47.770300    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck" event={"ID":"76a7a7d2-5acd-4cde-8457-cc808469c3ae","Type":"ContainerStarted","Data":"162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969"}
Jul 27 16:31:47.770886 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:47.770369    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck" event={"ID":"76a7a7d2-5acd-4cde-8457-cc808469c3ae","Type":"ContainerStarted","Data":"7582266ca0cff6c9ae5c24cd67b0ceb5231b093dcd758ef759c17cfc55d8e29b"}
Jul 27 16:31:47.770886 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:47.770413    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:31:47.786276 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:47.786206    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck" podStartSLOduration=1.786186837 podStartE2EDuration="1.786186837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:31:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:31:47.78584218 +0000 UTC m=+2610.466906612" watchObservedRunningTime="2026-07-27 16:31:47.786186837 +0000 UTC m=+2610.467251270"
Jul 27 16:31:50.720253 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:50.720226    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:31:50.720693 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:50.720300    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:31:52.732685 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:52.732642    2579 patch_prober.go:28] interesting pod/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 27 16:31:52.733170 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:52.732712    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 27 16:31:53.806669 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:53.806636    2579 generic.go:356] "Generic (PLEG): container finished" podID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerID="5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4" exitCode=0
Jul 27 16:31:53.807118 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:53.806703    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" event={"ID":"9cec0030-501f-46fa-bc8e-9e642e061a77","Type":"ContainerDied","Data":"5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4"}
Jul 27 16:31:53.807118 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:53.807116    2579 scope.go:117] "RemoveContainer" containerID="5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4"
Jul 27 16:31:53.808176 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:53.808152    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:31:53.808251 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:53.808238    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:31:53.808292 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:53.808271    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:31:54.814133 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:54.814096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" event={"ID":"9cec0030-501f-46fa-bc8e-9e642e061a77","Type":"ContainerStarted","Data":"4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c"}
Jul 27 16:31:55.491348 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:55.491312    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:55.491727 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:55.491703    2579 patch_prober.go:28] interesting pod/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 16:31:55.491907 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:55.491879    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 16:31:56.491677 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:56.491639    2579 patch_prober.go:28] interesting pod/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 16:31:56.492287 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:56.492252    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 16:31:57.490987 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:57.490951    2579 patch_prober.go:28] interesting pod/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 16:31:57.491165 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:57.491012    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 16:31:58.491850 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:58.491807    2579 patch_prober.go:28] interesting pod/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Jul 27 16:31:58.492232 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:58.491880    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Jul 27 16:31:58.778541 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:58.778478    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:31:59.494761 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:59.494733    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:59.495226 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:59.495114    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:31:59.495924 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:31:59.495903    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:32:00.497890 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:00.496852    2579 patch_prober.go:28] interesting pod/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": read tcp 10.132.0.2:58796->10.132.0.80:15021: read: connection reset by peer" start-of-body=
Jul 27 16:32:00.497890 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:00.496941    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": read tcp 10.132.0.2:58796->10.132.0.80:15021: read: connection reset by peer"
Jul 27 16:32:00.847730 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:00.847694    2579 generic.go:356] "Generic (PLEG): container finished" podID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerID="49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000" exitCode=0
Jul 27 16:32:00.847952 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:00.847762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" event={"ID":"dc385e67-553d-42a2-99b2-9fae9a728c21","Type":"ContainerDied","Data":"49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000"}
Jul 27 16:32:00.848279 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:00.848260    2579 scope.go:117] "RemoveContainer" containerID="49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000"
Jul 27 16:32:00.849246 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:00.849225    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:32:00.849304 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:00.849283    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:32:00.849339 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:00.849312    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:32:01.859637 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:01.859597    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" event={"ID":"dc385e67-553d-42a2-99b2-9fae9a728c21","Type":"ContainerStarted","Data":"3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e"}
Jul 27 16:32:02.099940 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:02.099900    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:32:02.100129 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:02.100112    2579 patch_prober.go:28] interesting pod/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 16:32:02.100172 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:02.100156    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 16:32:03.100351 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:03.100313    2579 patch_prober.go:28] interesting pod/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 16:32:03.100848 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:03.100390    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 16:32:04.101007 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:04.100975    2579 patch_prober.go:28] interesting pod/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 16:32:04.101399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:04.101034    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 16:32:05.100147 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:05.100108    2579 patch_prober.go:28] interesting pod/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Jul 27 16:32:05.100363 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:05.100174    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Jul 27 16:32:06.103982 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:06.103952    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:32:06.104361 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:06.104272    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:32:06.104867 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:32:06.104850    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:36:19.161485 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:36:19.161401    2579 scope.go:117] "RemoveContainer" containerID="2fb3de580c0eb04a8e343ab141ebd05402f0954dfea562f54b3c6f4bdf4fd21a"
Jul 27 16:40:56.761427 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.761392    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"]
Jul 27 16:40:56.764845 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.764821    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:56.766954 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.766931    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-ffa17b-openshift-default-dockercfg-fk5fr\""
Jul 27 16:40:56.777327 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.777304    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"]
Jul 27 16:40:56.937809 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.937769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-istio-token\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:56.937991 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.937815    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-socket\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:56.937991 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.937842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-certs\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:56.937991 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.937899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-envoy\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:56.938099 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.938018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-credential-socket\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:56.938099 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.938055    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-data\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:56.938099 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.938075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc33561-7517-4073-929e-1c64c774559b-istio-podinfo\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:56.938099 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.938093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc33561-7517-4073-929e-1c64c774559b-istiod-ca-cert\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:56.938229 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:56.938123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vqvk\" (UniqueName: \"kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-kube-api-access-5vqvk\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039276 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-istio-token\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039276 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-socket\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039575 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-certs\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039575 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-envoy\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039575 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039351    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-credential-socket\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039575 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-data\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039575 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc33561-7517-4073-929e-1c64c774559b-istio-podinfo\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039575 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039409    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc33561-7517-4073-929e-1c64c774559b-istiod-ca-cert\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039575 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vqvk\" (UniqueName: \"kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-kube-api-access-5vqvk\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039710    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-socket\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039783    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-credential-socket\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.039916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-certs\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.040023 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.039933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-data\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.040288 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.040266    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc33561-7517-4073-929e-1c64c774559b-istiod-ca-cert\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.041823 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.041806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-envoy\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.041908 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.041891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc33561-7517-4073-929e-1c64c774559b-istio-podinfo\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.049851 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.049831    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-istio-token\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.050119 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.050098    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vqvk\" (UniqueName: \"kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-kube-api-access-5vqvk\") pod \"e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") " pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.076890 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.076858    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:57.226300 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.226275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"]
Jul 27 16:40:57.228267 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:40:57.228243    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cc33561_7517_4073_929e_1c64c774559b.slice/crio-079ea6e2e610e8069219b020748c5be1a2e1a20383e7c4ed79101e5bb319df03 WatchSource:0}: Error finding container 079ea6e2e610e8069219b020748c5be1a2e1a20383e7c4ed79101e5bb319df03: Status 404 returned error can't find the container with id 079ea6e2e610e8069219b020748c5be1a2e1a20383e7c4ed79101e5bb319df03
Jul 27 16:40:57.230999 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.230967    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:40:57.231085 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.231032    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:40:57.231085 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.231061    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:40:57.776844 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.776807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" event={"ID":"1cc33561-7517-4073-929e-1c64c774559b","Type":"ContainerStarted","Data":"b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed"}
Jul 27 16:40:57.777355 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.776866    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" event={"ID":"1cc33561-7517-4073-929e-1c64c774559b","Type":"ContainerStarted","Data":"079ea6e2e610e8069219b020748c5be1a2e1a20383e7c4ed79101e5bb319df03"}
Jul 27 16:40:57.798663 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:57.798602    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" podStartSLOduration=1.798586535 podStartE2EDuration="1.798586535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:40:57.796973863 +0000 UTC m=+3160.478038290" watchObservedRunningTime="2026-07-27 16:40:57.798586535 +0000 UTC m=+3160.479651021"
Jul 27 16:40:58.077602 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:58.077474    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:58.082616 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:58.082588    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:58.782564 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:58.782531    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:40:58.783654 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:40:58.783634    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:41:16.895271 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:16.895184    2579 generic.go:356] "Generic (PLEG): container finished" podID="1cc33561-7517-4073-929e-1c64c774559b" containerID="b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed" exitCode=0
Jul 27 16:41:16.895271 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:16.895258    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" event={"ID":"1cc33561-7517-4073-929e-1c64c774559b","Type":"ContainerDied","Data":"b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed"}
Jul 27 16:41:16.895733 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:16.895693    2579 scope.go:117] "RemoveContainer" containerID="b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed"
Jul 27 16:41:16.896820 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:16.896787    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:41:16.896906 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:16.896864    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:41:16.896906 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:16.896896    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:41:17.902764 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:17.902733    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" event={"ID":"1cc33561-7517-4073-929e-1c64c774559b","Type":"ContainerStarted","Data":"1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676"}
Jul 27 16:41:18.077219 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:18.077184    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:41:18.077409 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:18.077392    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 16:41:18.077456 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:18.077437    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" podUID="1cc33561-7517-4073-929e-1c64c774559b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 16:41:19.078156 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:19.078123    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 16:41:19.078601 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:19.078175    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" podUID="1cc33561-7517-4073-929e-1c64c774559b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 16:41:20.077679 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:20.077638    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 16:41:20.077864 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:20.077700    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" podUID="1cc33561-7517-4073-929e-1c64c774559b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 16:41:21.078325 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:21.078280    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 27 16:41:21.078832 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:21.078344    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" podUID="1cc33561-7517-4073-929e-1c64c774559b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 27 16:41:22.081545 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:22.081509    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:41:22.081992 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:22.081806    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:41:22.082402 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:22.082384    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:41:25.345308 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.345273    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"]
Jul 27 16:41:25.347959 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.347942    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:41:25.350154 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.350131    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-d32cda-dockercfg-jgb9k\""
Jul 27 16:41:25.350305 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.350278    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-d32cda\""
Jul 27 16:41:25.359544 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.359519    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"]
Jul 27 16:41:25.434527 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.434109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4719abcd-8b55-4a11-b87e-3879974937cb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85\" (UID: \"4719abcd-8b55-4a11-b87e-3879974937cb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:41:25.434527 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.434174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smhkd\" (UniqueName: \"kubernetes.io/projected/4719abcd-8b55-4a11-b87e-3879974937cb-kube-api-access-smhkd\") pod \"payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85\" (UID: \"4719abcd-8b55-4a11-b87e-3879974937cb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:41:25.535080 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.535047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4719abcd-8b55-4a11-b87e-3879974937cb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85\" (UID: \"4719abcd-8b55-4a11-b87e-3879974937cb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:41:25.535265 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.535091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smhkd\" (UniqueName: \"kubernetes.io/projected/4719abcd-8b55-4a11-b87e-3879974937cb-kube-api-access-smhkd\") pod \"payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85\" (UID: \"4719abcd-8b55-4a11-b87e-3879974937cb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:41:25.535827 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.535805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4719abcd-8b55-4a11-b87e-3879974937cb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85\" (UID: \"4719abcd-8b55-4a11-b87e-3879974937cb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:41:25.546358 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.546331    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smhkd\" (UniqueName: \"kubernetes.io/projected/4719abcd-8b55-4a11-b87e-3879974937cb-kube-api-access-smhkd\") pod \"payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85\" (UID: \"4719abcd-8b55-4a11-b87e-3879974937cb\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:41:25.659457 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.659363    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:41:25.807797 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.807770    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"]
Jul 27 16:41:25.809326 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:41:25.809297    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4719abcd_8b55_4a11_b87e_3879974937cb.slice/crio-61b32fe443a406a86506f38dff5a34a2a3bb03564a08d0c70b2d6c17aaf184c0 WatchSource:0}: Error finding container 61b32fe443a406a86506f38dff5a34a2a3bb03564a08d0c70b2d6c17aaf184c0: Status 404 returned error can't find the container with id 61b32fe443a406a86506f38dff5a34a2a3bb03564a08d0c70b2d6c17aaf184c0
Jul 27 16:41:25.946972 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.946885    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85" event={"ID":"4719abcd-8b55-4a11-b87e-3879974937cb","Type":"ContainerStarted","Data":"ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db"}
Jul 27 16:41:25.946972 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.946946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85" event={"ID":"4719abcd-8b55-4a11-b87e-3879974937cb","Type":"ContainerStarted","Data":"61b32fe443a406a86506f38dff5a34a2a3bb03564a08d0c70b2d6c17aaf184c0"}
Jul 27 16:41:25.947149 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.947070    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:41:25.965619 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:25.965565    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85" podStartSLOduration=0.965549016 podStartE2EDuration="965.549016ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:41:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:41:25.962766946 +0000 UTC m=+3188.643831377" watchObservedRunningTime="2026-07-27 16:41:25.965549016 +0000 UTC m=+3188.646613446"
Jul 27 16:41:36.955109 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:36.955072    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:41:46.427365 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:46.427333    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-vbq5q_00315488-f29e-4a44-b58b-c9a8bd46a3fd/payload-processing/0.log"
Jul 27 16:41:46.548617 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:41:46.548588    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85_4719abcd-8b55-4a11-b87e-3879974937cb/payload-processing/0.log"
Jul 27 16:42:36.688816 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:36.688782    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-vbq5q_00315488-f29e-4a44-b58b-c9a8bd46a3fd/payload-processing/0.log"
Jul 27 16:42:36.818955 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:36.818920    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85_4719abcd-8b55-4a11-b87e-3879974937cb/payload-processing/0.log"
Jul 27 16:42:37.482088 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.482052    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"]
Jul 27 16:42:37.485546 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.485521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.487710 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.487687    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-145981-openshift-default-dockercfg-5dzjg\""
Jul 27 16:42:37.496949 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.496925    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"]
Jul 27 16:42:37.607701 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.607655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vkb9\" (UniqueName: \"kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-kube-api-access-4vkb9\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.607916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.607720    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-podinfo\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.607916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.607752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5e53042-d9b0-417d-8e0c-5b5521eec259-istiod-ca-cert\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.607916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.607786    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-envoy\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.607916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.607823    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-socket\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.607916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.607866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-credential-socket\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.607916 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.607908    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-certs\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.608268 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.607933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-data\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.608268 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.607978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-token\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.709315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.709280    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vkb9\" (UniqueName: \"kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-kube-api-access-4vkb9\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.709315 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.709318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-podinfo\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.709914 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.709339    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5e53042-d9b0-417d-8e0c-5b5521eec259-istiod-ca-cert\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.709914 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.709357    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-envoy\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.709914 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.709480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-socket\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.709914 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.709566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-credential-socket\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.709914 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.709615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-certs\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.709914 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.709641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-data\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.709914 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.709765    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-token\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.710293 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.709917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-socket\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.710293 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.709933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-credential-socket\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.710293 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.710059    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-data\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.710293 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.710170    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-certs\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.710293 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.710211    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5e53042-d9b0-417d-8e0c-5b5521eec259-istiod-ca-cert\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.711689 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.711661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-envoy\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.711906 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.711890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-podinfo\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.717195 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.717170    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vkb9\" (UniqueName: \"kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-kube-api-access-4vkb9\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.717543 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.717526    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-token\") pod \"e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") " pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.797833 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.797803    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:37.942151 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.942125    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"]
Jul 27 16:42:37.943847 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:42:37.943817    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e53042_d9b0_417d_8e0c_5b5521eec259.slice/crio-1287e5800cc801ffcd1c2333f3d9d635ee769f60c4c448a752c4ac6f235d741d WatchSource:0}: Error finding container 1287e5800cc801ffcd1c2333f3d9d635ee769f60c4c448a752c4ac6f235d741d: Status 404 returned error can't find the container with id 1287e5800cc801ffcd1c2333f3d9d635ee769f60c4c448a752c4ac6f235d741d
Jul 27 16:42:37.946074 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.946044    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:42:37.946170 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.946106    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:42:37.946170 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:37.946133    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:42:38.365351 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:38.365316    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" event={"ID":"b5e53042-d9b0-417d-8e0c-5b5521eec259","Type":"ContainerStarted","Data":"f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7"}
Jul 27 16:42:38.365556 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:38.365370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" event={"ID":"b5e53042-d9b0-417d-8e0c-5b5521eec259","Type":"ContainerStarted","Data":"1287e5800cc801ffcd1c2333f3d9d635ee769f60c4c448a752c4ac6f235d741d"}
Jul 27 16:42:38.387750 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:38.387696    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" podStartSLOduration=1.387678417 podStartE2EDuration="1.387678417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 16:42:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:42:38.386898924 +0000 UTC m=+3261.067963354" watchObservedRunningTime="2026-07-27 16:42:38.387678417 +0000 UTC m=+3261.068742847"
Jul 27 16:42:38.798207 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:38.798171    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:39.803354 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:39.803320    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:40.376391 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:40.376361    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:40.377426 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:40.377398    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:54.458227 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:54.458190    2579 generic.go:356] "Generic (PLEG): container finished" podID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerID="f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7" exitCode=0
Jul 27 16:42:54.458688 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:54.458262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" event={"ID":"b5e53042-d9b0-417d-8e0c-5b5521eec259","Type":"ContainerDied","Data":"f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7"}
Jul 27 16:42:54.458743 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:54.458688    2579 scope.go:117] "RemoveContainer" containerID="f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7"
Jul 27 16:42:54.459863 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:54.459836    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:42:54.459934 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:54.459903    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:42:54.459973 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:54.459935    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 27 16:42:55.376474 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:55.376430    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:55.471335 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:55.471297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" event={"ID":"b5e53042-d9b0-417d-8e0c-5b5521eec259","Type":"ContainerStarted","Data":"4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529"}
Jul 27 16:42:55.798799 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:55.798770    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:55.799781 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:55.799746    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 27 16:42:55.799920 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:55.799813    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 27 16:42:56.799156 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:56.799121    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 27 16:42:56.799595 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:56.799200    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 27 16:42:57.798635 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:57.798597    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 27 16:42:57.798822 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:57.798656    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 27 16:42:58.798545 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:58.798476    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 27 16:42:58.798962 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:58.798570    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 27 16:42:59.802006 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:59.801969    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:59.802410 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:59.802242    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:42:59.802840 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:42:59.802820    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:43:17.595312 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:17.595273    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"]
Jul 27 16:43:17.595853 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:17.595548    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerName="istio-proxy" containerID="cri-o://4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529" gracePeriod=30
Jul 27 16:43:22.852521 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.852471    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:43:22.957479 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.957385    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vkb9\" (UniqueName: \"kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-kube-api-access-4vkb9\") pod \"b5e53042-d9b0-417d-8e0c-5b5521eec259\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") "
Jul 27 16:43:22.957479 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.957426    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-data\") pod \"b5e53042-d9b0-417d-8e0c-5b5521eec259\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") "
Jul 27 16:43:22.957479 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.957460    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5e53042-d9b0-417d-8e0c-5b5521eec259-istiod-ca-cert\") pod \"b5e53042-d9b0-417d-8e0c-5b5521eec259\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") "
Jul 27 16:43:22.957479 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.957477    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-envoy\") pod \"b5e53042-d9b0-417d-8e0c-5b5521eec259\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") "
Jul 27 16:43:22.957855 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.957548    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-credential-socket\") pod \"b5e53042-d9b0-417d-8e0c-5b5521eec259\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") "
Jul 27 16:43:22.957855 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.957576    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-podinfo\") pod \"b5e53042-d9b0-417d-8e0c-5b5521eec259\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") "
Jul 27 16:43:22.957855 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.957623    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-socket\") pod \"b5e53042-d9b0-417d-8e0c-5b5521eec259\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") "
Jul 27 16:43:22.957855 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.957682    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-token\") pod \"b5e53042-d9b0-417d-8e0c-5b5521eec259\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") "
Jul 27 16:43:22.957855 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.957735    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-certs\") pod \"b5e53042-d9b0-417d-8e0c-5b5521eec259\" (UID: \"b5e53042-d9b0-417d-8e0c-5b5521eec259\") "
Jul 27 16:43:22.958108 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.957894    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5e53042-d9b0-417d-8e0c-5b5521eec259" (UID: "b5e53042-d9b0-417d-8e0c-5b5521eec259"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:43:22.958108 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.957920    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5e53042-d9b0-417d-8e0c-5b5521eec259-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5e53042-d9b0-417d-8e0c-5b5521eec259" (UID: "b5e53042-d9b0-417d-8e0c-5b5521eec259"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:43:22.958108 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.958029    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5e53042-d9b0-417d-8e0c-5b5521eec259" (UID: "b5e53042-d9b0-417d-8e0c-5b5521eec259"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:43:22.958287 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.958121    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5e53042-d9b0-417d-8e0c-5b5521eec259" (UID: "b5e53042-d9b0-417d-8e0c-5b5521eec259"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:43:22.958287 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.958187    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:43:22.958287 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.958209    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:43:22.958287 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.958224    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5e53042-d9b0-417d-8e0c-5b5521eec259-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:43:22.958959 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.958933    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5e53042-d9b0-417d-8e0c-5b5521eec259" (UID: "b5e53042-d9b0-417d-8e0c-5b5521eec259"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:43:22.959786 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.959766    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5e53042-d9b0-417d-8e0c-5b5521eec259" (UID: "b5e53042-d9b0-417d-8e0c-5b5521eec259"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:43:22.959886 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.959871    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-kube-api-access-4vkb9" (OuterVolumeSpecName: "kube-api-access-4vkb9") pod "b5e53042-d9b0-417d-8e0c-5b5521eec259" (UID: "b5e53042-d9b0-417d-8e0c-5b5521eec259"). InnerVolumeSpecName "kube-api-access-4vkb9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:43:22.959931 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.959914    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5e53042-d9b0-417d-8e0c-5b5521eec259" (UID: "b5e53042-d9b0-417d-8e0c-5b5521eec259"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:43:22.959968 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:22.959946    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5e53042-d9b0-417d-8e0c-5b5521eec259" (UID: "b5e53042-d9b0-417d-8e0c-5b5521eec259"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:43:23.058799 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.058761    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vkb9\" (UniqueName: \"kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-kube-api-access-4vkb9\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:43:23.058799 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.058796    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:43:23.058799 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.058805    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:43:23.059038 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.058812    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:43:23.059038 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.058821    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5e53042-d9b0-417d-8e0c-5b5521eec259-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:43:23.059038 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.058829    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5e53042-d9b0-417d-8e0c-5b5521eec259-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:43:23.633950 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.633919    2579 generic.go:356] "Generic (PLEG): container finished" podID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerID="4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529" exitCode=0
Jul 27 16:43:23.634125 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.633972    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"
Jul 27 16:43:23.634125 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.633982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" event={"ID":"b5e53042-d9b0-417d-8e0c-5b5521eec259","Type":"ContainerDied","Data":"4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529"}
Jul 27 16:43:23.634125 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.634025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79" event={"ID":"b5e53042-d9b0-417d-8e0c-5b5521eec259","Type":"ContainerDied","Data":"1287e5800cc801ffcd1c2333f3d9d635ee769f60c4c448a752c4ac6f235d741d"}
Jul 27 16:43:23.634125 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.634047    2579 scope.go:117] "RemoveContainer" containerID="4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529"
Jul 27 16:43:23.643838 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.643820    2579 scope.go:117] "RemoveContainer" containerID="f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7"
Jul 27 16:43:23.652096 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.652077    2579 scope.go:117] "RemoveContainer" containerID="4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529"
Jul 27 16:43:23.652340 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:43:23.652321    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529\": container with ID starting with 4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529 not found: ID does not exist" containerID="4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529"
Jul 27 16:43:23.652379 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.652349    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529"} err="failed to get container status \"4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529\": rpc error: code = NotFound desc = could not find container \"4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529\": container with ID starting with 4ee837546d63d247c61f83fe45136393a988b8d4fac757aba5c8125ce0a53529 not found: ID does not exist"
Jul 27 16:43:23.652379 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.652367    2579 scope.go:117] "RemoveContainer" containerID="f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7"
Jul 27 16:43:23.652602 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:43:23.652585    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7\": container with ID starting with f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7 not found: ID does not exist" containerID="f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7"
Jul 27 16:43:23.652644 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.652608    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7"} err="failed to get container status \"f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7\": rpc error: code = NotFound desc = could not find container \"f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7\": container with ID starting with f5a8e5a66ef1a4072cd5d932824d84195bde8433ede73d64a4604a959a8bc7f7 not found: ID does not exist"
Jul 27 16:43:23.657886 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.657861    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"]
Jul 27 16:43:23.661588 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.661567    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-145981-openshift-default-5df4db5db8-m4k79"]
Jul 27 16:43:23.931130 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:43:23.931050    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" path="/var/lib/kubelet/pods/b5e53042-d9b0-417d-8e0c-5b5521eec259/volumes"
Jul 27 16:44:31.060418 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:31.060382    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"]
Jul 27 16:44:31.060961 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:31.060668    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" podUID="1cc33561-7517-4073-929e-1c64c774559b" containerName="istio-proxy" containerID="cri-o://1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676" gracePeriod=30
Jul 27 16:44:36.319629 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.319603    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:44:36.361548 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.361450    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vqvk\" (UniqueName: \"kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-kube-api-access-5vqvk\") pod \"1cc33561-7517-4073-929e-1c64c774559b\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") "
Jul 27 16:44:36.361548 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.361509    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc33561-7517-4073-929e-1c64c774559b-istiod-ca-cert\") pod \"1cc33561-7517-4073-929e-1c64c774559b\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") "
Jul 27 16:44:36.361548 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.361530    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-credential-socket\") pod \"1cc33561-7517-4073-929e-1c64c774559b\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") "
Jul 27 16:44:36.361835 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.361560    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-certs\") pod \"1cc33561-7517-4073-929e-1c64c774559b\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") "
Jul 27 16:44:36.361835 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.361587    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-socket\") pod \"1cc33561-7517-4073-929e-1c64c774559b\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") "
Jul 27 16:44:36.361835 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.361635    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-envoy\") pod \"1cc33561-7517-4073-929e-1c64c774559b\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") "
Jul 27 16:44:36.361835 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.361670    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-istio-token\") pod \"1cc33561-7517-4073-929e-1c64c774559b\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") "
Jul 27 16:44:36.361835 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.361705    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-data\") pod \"1cc33561-7517-4073-929e-1c64c774559b\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") "
Jul 27 16:44:36.361835 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.361777    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc33561-7517-4073-929e-1c64c774559b-istio-podinfo\") pod \"1cc33561-7517-4073-929e-1c64c774559b\" (UID: \"1cc33561-7517-4073-929e-1c64c774559b\") "
Jul 27 16:44:36.362194 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.361844    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1cc33561-7517-4073-929e-1c64c774559b" (UID: "1cc33561-7517-4073-929e-1c64c774559b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:44:36.362194 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.361939    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cc33561-7517-4073-929e-1c64c774559b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1cc33561-7517-4073-929e-1c64c774559b" (UID: "1cc33561-7517-4073-929e-1c64c774559b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:44:36.362194 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.362115    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1cc33561-7517-4073-929e-1c64c774559b" (UID: "1cc33561-7517-4073-929e-1c64c774559b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:44:36.362194 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.362094    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1cc33561-7517-4073-929e-1c64c774559b" (UID: "1cc33561-7517-4073-929e-1c64c774559b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:44:36.362523 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.362485    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cc33561-7517-4073-929e-1c64c774559b-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:44:36.362596 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.362528    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:44:36.362596 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.362542    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:44:36.362596 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.362556    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:44:36.362923 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.362892    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-data" (OuterVolumeSpecName: "istio-data") pod "1cc33561-7517-4073-929e-1c64c774559b" (UID: "1cc33561-7517-4073-929e-1c64c774559b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:44:36.364136 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.364103    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-istio-token" (OuterVolumeSpecName: "istio-token") pod "1cc33561-7517-4073-929e-1c64c774559b" (UID: "1cc33561-7517-4073-929e-1c64c774559b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:44:36.364246 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.364153    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-kube-api-access-5vqvk" (OuterVolumeSpecName: "kube-api-access-5vqvk") pod "1cc33561-7517-4073-929e-1c64c774559b" (UID: "1cc33561-7517-4073-929e-1c64c774559b"). InnerVolumeSpecName "kube-api-access-5vqvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:44:36.364399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.364375    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1cc33561-7517-4073-929e-1c64c774559b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1cc33561-7517-4073-929e-1c64c774559b" (UID: "1cc33561-7517-4073-929e-1c64c774559b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:44:36.364399 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.364381    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1cc33561-7517-4073-929e-1c64c774559b" (UID: "1cc33561-7517-4073-929e-1c64c774559b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:44:36.463216 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.463181    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cc33561-7517-4073-929e-1c64c774559b-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:44:36.463216 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.463209    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vqvk\" (UniqueName: \"kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-kube-api-access-5vqvk\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:44:36.463216 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.463219    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:44:36.463216 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.463227    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cc33561-7517-4073-929e-1c64c774559b-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:44:36.463490 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:36.463235    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cc33561-7517-4073-929e-1c64c774559b-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:44:37.049616 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.049577    2579 generic.go:356] "Generic (PLEG): container finished" podID="1cc33561-7517-4073-929e-1c64c774559b" containerID="1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676" exitCode=0
Jul 27 16:44:37.049789 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.049647    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"
Jul 27 16:44:37.049789 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.049659    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" event={"ID":"1cc33561-7517-4073-929e-1c64c774559b","Type":"ContainerDied","Data":"1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676"}
Jul 27 16:44:37.049789 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.049713    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8" event={"ID":"1cc33561-7517-4073-929e-1c64c774559b","Type":"ContainerDied","Data":"079ea6e2e610e8069219b020748c5be1a2e1a20383e7c4ed79101e5bb319df03"}
Jul 27 16:44:37.049789 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.049736    2579 scope.go:117] "RemoveContainer" containerID="1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676"
Jul 27 16:44:37.061409 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.061389    2579 scope.go:117] "RemoveContainer" containerID="b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed"
Jul 27 16:44:37.069966 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.069946    2579 scope.go:117] "RemoveContainer" containerID="1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676"
Jul 27 16:44:37.070229 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:44:37.070208    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676\": container with ID starting with 1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676 not found: ID does not exist" containerID="1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676"
Jul 27 16:44:37.070304 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.070238    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676"} err="failed to get container status \"1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676\": rpc error: code = NotFound desc = could not find container \"1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676\": container with ID starting with 1d81be6a797368ffa20c889571dafe78717e01a66fd0d7d203fd003847dac676 not found: ID does not exist"
Jul 27 16:44:37.070304 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.070256    2579 scope.go:117] "RemoveContainer" containerID="b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed"
Jul 27 16:44:37.070508 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:44:37.070474    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed\": container with ID starting with b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed not found: ID does not exist" containerID="b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed"
Jul 27 16:44:37.070573 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.070524    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed"} err="failed to get container status \"b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed\": rpc error: code = NotFound desc = could not find container \"b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed\": container with ID starting with b011acaf095f49a75ce0027000172f6096a41134e264636fc065bf3977dfe0ed not found: ID does not exist"
Jul 27 16:44:37.075936 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.075897    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"]
Jul 27 16:44:37.079748 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.079728    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-ffa17b-openshift-default-7d4f48d6cb-vgdq8"]
Jul 27 16:44:37.931201 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:37.931167    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cc33561-7517-4073-929e-1c64c774559b" path="/var/lib/kubelet/pods/1cc33561-7517-4073-929e-1c64c774559b/volumes"
Jul 27 16:44:42.145265 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:42.145226    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"]
Jul 27 16:44:42.145810 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:42.145460    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85" podUID="4719abcd-8b55-4a11-b87e-3879974937cb" containerName="payload-processing" containerID="cri-o://ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db" gracePeriod=30
Jul 27 16:44:42.409304 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:42.409240    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:44:42.527320 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:42.527285    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smhkd\" (UniqueName: \"kubernetes.io/projected/4719abcd-8b55-4a11-b87e-3879974937cb-kube-api-access-smhkd\") pod \"4719abcd-8b55-4a11-b87e-3879974937cb\" (UID: \"4719abcd-8b55-4a11-b87e-3879974937cb\") "
Jul 27 16:44:42.527506 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:42.527383    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4719abcd-8b55-4a11-b87e-3879974937cb-plugins-config-volume\") pod \"4719abcd-8b55-4a11-b87e-3879974937cb\" (UID: \"4719abcd-8b55-4a11-b87e-3879974937cb\") "
Jul 27 16:44:42.527813 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:42.527788    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4719abcd-8b55-4a11-b87e-3879974937cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4719abcd-8b55-4a11-b87e-3879974937cb" (UID: "4719abcd-8b55-4a11-b87e-3879974937cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:44:42.529425 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:42.529400    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4719abcd-8b55-4a11-b87e-3879974937cb-kube-api-access-smhkd" (OuterVolumeSpecName: "kube-api-access-smhkd") pod "4719abcd-8b55-4a11-b87e-3879974937cb" (UID: "4719abcd-8b55-4a11-b87e-3879974937cb"). InnerVolumeSpecName "kube-api-access-smhkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:44:42.628855 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:42.628820    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4719abcd-8b55-4a11-b87e-3879974937cb-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:44:42.628855 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:42.628849    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smhkd\" (UniqueName: \"kubernetes.io/projected/4719abcd-8b55-4a11-b87e-3879974937cb-kube-api-access-smhkd\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:44:43.087981 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:43.087945    2579 generic.go:356] "Generic (PLEG): container finished" podID="4719abcd-8b55-4a11-b87e-3879974937cb" containerID="ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db" exitCode=0
Jul 27 16:44:43.088168 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:43.088009    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"
Jul 27 16:44:43.088168 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:43.088032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85" event={"ID":"4719abcd-8b55-4a11-b87e-3879974937cb","Type":"ContainerDied","Data":"ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db"}
Jul 27 16:44:43.088168 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:43.088085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85" event={"ID":"4719abcd-8b55-4a11-b87e-3879974937cb","Type":"ContainerDied","Data":"61b32fe443a406a86506f38dff5a34a2a3bb03564a08d0c70b2d6c17aaf184c0"}
Jul 27 16:44:43.088168 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:43.088107    2579 scope.go:117] "RemoveContainer" containerID="ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db"
Jul 27 16:44:43.097447 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:43.097430    2579 scope.go:117] "RemoveContainer" containerID="ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db"
Jul 27 16:44:43.097791 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:44:43.097773    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db\": container with ID starting with ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db not found: ID does not exist" containerID="ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db"
Jul 27 16:44:43.097857 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:43.097801    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db"} err="failed to get container status \"ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db\": rpc error: code = NotFound desc = could not find container \"ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db\": container with ID starting with ed4e7378078ade9760c8609b3804f29763ee206bc31d4a38b4509ebc2dbca6db not found: ID does not exist"
Jul 27 16:44:43.114795 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:43.114767    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"]
Jul 27 16:44:43.124996 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:43.124974    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d32cda-bc598ff54-bgt85"]
Jul 27 16:44:43.930598 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:44:43.930564    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4719abcd-8b55-4a11-b87e-3879974937cb" path="/var/lib/kubelet/pods/4719abcd-8b55-4a11-b87e-3879974937cb/volumes"
Jul 27 16:45:04.032524 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.032459    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"]
Jul 27 16:45:04.033077 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.032837    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl" podUID="4121c4c3-bea8-4d47-8a42-611c8e17c5ec" containerName="payload-processing" containerID="cri-o://8dfd14d21eadb4a72ff4fc95500ef3b2596faf4b796b2377afac27ee83ccb3a0" gracePeriod=30
Jul 27 16:45:04.039661 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.039634    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"]
Jul 27 16:45:04.039923 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.039880    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v" podUID="d65f1a72-ced7-40ac-aaa0-7ca59eb5d882" containerName="payload-pre-processing" containerID="cri-o://ac4e65654cd879b59a817d96b2ba96c6befdef701bea39f2665f8f8acf9515a8" gracePeriod=30
Jul 27 16:45:04.212997 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.212878    2579 generic.go:356] "Generic (PLEG): container finished" podID="d65f1a72-ced7-40ac-aaa0-7ca59eb5d882" containerID="ac4e65654cd879b59a817d96b2ba96c6befdef701bea39f2665f8f8acf9515a8" exitCode=0
Jul 27 16:45:04.212997 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.212922    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v" event={"ID":"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882","Type":"ContainerDied","Data":"ac4e65654cd879b59a817d96b2ba96c6befdef701bea39f2665f8f8acf9515a8"}
Jul 27 16:45:04.216735 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.216245    2579 generic.go:356] "Generic (PLEG): container finished" podID="4121c4c3-bea8-4d47-8a42-611c8e17c5ec" containerID="8dfd14d21eadb4a72ff4fc95500ef3b2596faf4b796b2377afac27ee83ccb3a0" exitCode=0
Jul 27 16:45:04.216735 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.216411    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl" event={"ID":"4121c4c3-bea8-4d47-8a42-611c8e17c5ec","Type":"ContainerDied","Data":"8dfd14d21eadb4a72ff4fc95500ef3b2596faf4b796b2377afac27ee83ccb3a0"}
Jul 27 16:45:04.315664 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.315639    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:45:04.349240 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.349215    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:45:04.439792 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.439760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shhbk\" (UniqueName: \"kubernetes.io/projected/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-kube-api-access-shhbk\") pod \"4121c4c3-bea8-4d47-8a42-611c8e17c5ec\" (UID: \"4121c4c3-bea8-4d47-8a42-611c8e17c5ec\") "
Jul 27 16:45:04.439952 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.439860    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-plugins-config-volume\") pod \"4121c4c3-bea8-4d47-8a42-611c8e17c5ec\" (UID: \"4121c4c3-bea8-4d47-8a42-611c8e17c5ec\") "
Jul 27 16:45:04.440270 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.440250    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4121c4c3-bea8-4d47-8a42-611c8e17c5ec" (UID: "4121c4c3-bea8-4d47-8a42-611c8e17c5ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:45:04.441874 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.441854    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-kube-api-access-shhbk" (OuterVolumeSpecName: "kube-api-access-shhbk") pod "4121c4c3-bea8-4d47-8a42-611c8e17c5ec" (UID: "4121c4c3-bea8-4d47-8a42-611c8e17c5ec"). InnerVolumeSpecName "kube-api-access-shhbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:45:04.541066 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.541009    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgnhf\" (UniqueName: \"kubernetes.io/projected/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-kube-api-access-kgnhf\") pod \"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882\" (UID: \"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882\") "
Jul 27 16:45:04.541066 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.541074    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-plugins-config-volume\") pod \"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882\" (UID: \"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882\") "
Jul 27 16:45:04.541294 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.541277    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shhbk\" (UniqueName: \"kubernetes.io/projected/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-kube-api-access-shhbk\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:04.541294 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.541289    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4121c4c3-bea8-4d47-8a42-611c8e17c5ec-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:04.541512 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.541464    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d65f1a72-ced7-40ac-aaa0-7ca59eb5d882" (UID: "d65f1a72-ced7-40ac-aaa0-7ca59eb5d882"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:45:04.543188 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.543164    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-kube-api-access-kgnhf" (OuterVolumeSpecName: "kube-api-access-kgnhf") pod "d65f1a72-ced7-40ac-aaa0-7ca59eb5d882" (UID: "d65f1a72-ced7-40ac-aaa0-7ca59eb5d882"). InnerVolumeSpecName "kube-api-access-kgnhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:45:04.642529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.642416    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgnhf\" (UniqueName: \"kubernetes.io/projected/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-kube-api-access-kgnhf\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:04.642529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:04.642447    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:05.226152 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.226109    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v" event={"ID":"d65f1a72-ced7-40ac-aaa0-7ca59eb5d882","Type":"ContainerDied","Data":"d8c22afdf1dc98b34e66b5b0e562c6b2713555fefdd59a99dcd7efff1770430f"}
Jul 27 16:45:05.226152 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.226142    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"
Jul 27 16:45:05.226692 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.226188    2579 scope.go:117] "RemoveContainer" containerID="ac4e65654cd879b59a817d96b2ba96c6befdef701bea39f2665f8f8acf9515a8"
Jul 27 16:45:05.227652 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.227529    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"
Jul 27 16:45:05.227652 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.227538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl" event={"ID":"4121c4c3-bea8-4d47-8a42-611c8e17c5ec","Type":"ContainerDied","Data":"5023917ddac33b0ebcca576318872b3cdc9ef3ff7f3426ea19b38906a31d1923"}
Jul 27 16:45:05.235730 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.235713    2579 scope.go:117] "RemoveContainer" containerID="8dfd14d21eadb4a72ff4fc95500ef3b2596faf4b796b2377afac27ee83ccb3a0"
Jul 27 16:45:05.252238 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.252212    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"]
Jul 27 16:45:05.255730 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.255707    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-932843-544d749c7d-rx4sl"]
Jul 27 16:45:05.268093 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.268066    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"]
Jul 27 16:45:05.272254 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.272233    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-932843-b58968f96-fzm6v"]
Jul 27 16:45:05.930804 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.930771    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4121c4c3-bea8-4d47-8a42-611c8e17c5ec" path="/var/lib/kubelet/pods/4121c4c3-bea8-4d47-8a42-611c8e17c5ec/volumes"
Jul 27 16:45:05.931142 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:05.931129    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d65f1a72-ced7-40ac-aaa0-7ca59eb5d882" path="/var/lib/kubelet/pods/d65f1a72-ced7-40ac-aaa0-7ca59eb5d882/volumes"
Jul 27 16:45:15.422676 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:15.422600    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"]
Jul 27 16:45:15.423050 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:15.422865    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerName="istio-proxy" containerID="cri-o://4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c" gracePeriod=30
Jul 27 16:45:20.685686 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.685621    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:45:20.788362 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788322    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjqxh\" (UniqueName: \"kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-kube-api-access-rjqxh\") pod \"9cec0030-501f-46fa-bc8e-9e642e061a77\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") "
Jul 27 16:45:20.788616 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788368    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-podinfo\") pod \"9cec0030-501f-46fa-bc8e-9e642e061a77\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") "
Jul 27 16:45:20.788616 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788408    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-envoy\") pod \"9cec0030-501f-46fa-bc8e-9e642e061a77\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") "
Jul 27 16:45:20.788616 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788430    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cec0030-501f-46fa-bc8e-9e642e061a77-istiod-ca-cert\") pod \"9cec0030-501f-46fa-bc8e-9e642e061a77\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") "
Jul 27 16:45:20.788616 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788461    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-socket\") pod \"9cec0030-501f-46fa-bc8e-9e642e061a77\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") "
Jul 27 16:45:20.788616 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788482    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-certs\") pod \"9cec0030-501f-46fa-bc8e-9e642e061a77\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") "
Jul 27 16:45:20.788616 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788556    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-credential-socket\") pod \"9cec0030-501f-46fa-bc8e-9e642e061a77\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") "
Jul 27 16:45:20.788616 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788601    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-token\") pod \"9cec0030-501f-46fa-bc8e-9e642e061a77\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") "
Jul 27 16:45:20.789061 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788698    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-data\") pod \"9cec0030-501f-46fa-bc8e-9e642e061a77\" (UID: \"9cec0030-501f-46fa-bc8e-9e642e061a77\") "
Jul 27 16:45:20.789061 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788834    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9cec0030-501f-46fa-bc8e-9e642e061a77" (UID: "9cec0030-501f-46fa-bc8e-9e642e061a77"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:45:20.789061 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788829    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9cec0030-501f-46fa-bc8e-9e642e061a77" (UID: "9cec0030-501f-46fa-bc8e-9e642e061a77"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:45:20.789061 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.788956    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9cec0030-501f-46fa-bc8e-9e642e061a77" (UID: "9cec0030-501f-46fa-bc8e-9e642e061a77"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:45:20.789277 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.789159    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:20.789277 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.789191    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:20.789277 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.789207    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:20.789428 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.789366    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cec0030-501f-46fa-bc8e-9e642e061a77-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9cec0030-501f-46fa-bc8e-9e642e061a77" (UID: "9cec0030-501f-46fa-bc8e-9e642e061a77"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:45:20.789643 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.789622    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-data" (OuterVolumeSpecName: "istio-data") pod "9cec0030-501f-46fa-bc8e-9e642e061a77" (UID: "9cec0030-501f-46fa-bc8e-9e642e061a77"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:45:20.790702 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.790678    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-kube-api-access-rjqxh" (OuterVolumeSpecName: "kube-api-access-rjqxh") pod "9cec0030-501f-46fa-bc8e-9e642e061a77" (UID: "9cec0030-501f-46fa-bc8e-9e642e061a77"). InnerVolumeSpecName "kube-api-access-rjqxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:45:20.790829 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.790812    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-token" (OuterVolumeSpecName: "istio-token") pod "9cec0030-501f-46fa-bc8e-9e642e061a77" (UID: "9cec0030-501f-46fa-bc8e-9e642e061a77"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:45:20.791069 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.791042    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9cec0030-501f-46fa-bc8e-9e642e061a77" (UID: "9cec0030-501f-46fa-bc8e-9e642e061a77"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:45:20.791137 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.791047    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9cec0030-501f-46fa-bc8e-9e642e061a77" (UID: "9cec0030-501f-46fa-bc8e-9e642e061a77"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:45:20.890552 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.890488    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:20.890552 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.890546    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:20.890552 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.890555    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjqxh\" (UniqueName: \"kubernetes.io/projected/9cec0030-501f-46fa-bc8e-9e642e061a77-kube-api-access-rjqxh\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:20.890802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.890564    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:20.890802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.890572    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cec0030-501f-46fa-bc8e-9e642e061a77-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:20.890802 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:20.890581    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cec0030-501f-46fa-bc8e-9e642e061a77-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:21.320309 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.320274    2579 generic.go:356] "Generic (PLEG): container finished" podID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerID="4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c" exitCode=0
Jul 27 16:45:21.320525 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.320318    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"
Jul 27 16:45:21.320525 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.320330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" event={"ID":"9cec0030-501f-46fa-bc8e-9e642e061a77","Type":"ContainerDied","Data":"4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c"}
Jul 27 16:45:21.320525 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.320382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6" event={"ID":"9cec0030-501f-46fa-bc8e-9e642e061a77","Type":"ContainerDied","Data":"eb60183334f4b86f63b447a59b417c43ead0df87f17067bcd5ce9c6fa34179f9"}
Jul 27 16:45:21.320525 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.320414    2579 scope.go:117] "RemoveContainer" containerID="4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c"
Jul 27 16:45:21.329998 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.329977    2579 scope.go:117] "RemoveContainer" containerID="5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4"
Jul 27 16:45:21.338294 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.338276    2579 scope.go:117] "RemoveContainer" containerID="4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c"
Jul 27 16:45:21.338570 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:45:21.338550    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c\": container with ID starting with 4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c not found: ID does not exist" containerID="4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c"
Jul 27 16:45:21.338657 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.338584    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c"} err="failed to get container status \"4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c\": rpc error: code = NotFound desc = could not find container \"4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c\": container with ID starting with 4bd399c637193aad176327080e1eb43e00da91584970f3af1989dc8e7de53d1c not found: ID does not exist"
Jul 27 16:45:21.338657 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.338609    2579 scope.go:117] "RemoveContainer" containerID="5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4"
Jul 27 16:45:21.338843 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:45:21.338828    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4\": container with ID starting with 5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4 not found: ID does not exist" containerID="5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4"
Jul 27 16:45:21.338897 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.338854    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4"} err="failed to get container status \"5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4\": rpc error: code = NotFound desc = could not find container \"5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4\": container with ID starting with 5c21bd8dd50d18e0d718abaf39719686b43bb26fd24b99854df3fad63b5887f4 not found: ID does not exist"
Jul 27 16:45:21.350949 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.350922    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"]
Jul 27 16:45:21.355640 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.355620    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-932843-openshift-default-696d4d95c6-shcs6"]
Jul 27 16:45:21.930187 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:21.930155    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" path="/var/lib/kubelet/pods/9cec0030-501f-46fa-bc8e-9e642e061a77/volumes"
Jul 27 16:45:26.405657 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:26.405618    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"]
Jul 27 16:45:26.406149 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:26.405817    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck" podUID="76a7a7d2-5acd-4cde-8457-cc808469c3ae" containerName="payload-processing" containerID="cri-o://162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969" gracePeriod=30
Jul 27 16:45:26.673674 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:26.673643    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:45:26.746565 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:26.746528    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76a7a7d2-5acd-4cde-8457-cc808469c3ae-plugins-config-volume\") pod \"76a7a7d2-5acd-4cde-8457-cc808469c3ae\" (UID: \"76a7a7d2-5acd-4cde-8457-cc808469c3ae\") "
Jul 27 16:45:26.746723 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:26.746609    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rsrr\" (UniqueName: \"kubernetes.io/projected/76a7a7d2-5acd-4cde-8457-cc808469c3ae-kube-api-access-8rsrr\") pod \"76a7a7d2-5acd-4cde-8457-cc808469c3ae\" (UID: \"76a7a7d2-5acd-4cde-8457-cc808469c3ae\") "
Jul 27 16:45:26.746909 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:26.746883    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76a7a7d2-5acd-4cde-8457-cc808469c3ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "76a7a7d2-5acd-4cde-8457-cc808469c3ae" (UID: "76a7a7d2-5acd-4cde-8457-cc808469c3ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:45:26.748817 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:26.748790    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a7a7d2-5acd-4cde-8457-cc808469c3ae-kube-api-access-8rsrr" (OuterVolumeSpecName: "kube-api-access-8rsrr") pod "76a7a7d2-5acd-4cde-8457-cc808469c3ae" (UID: "76a7a7d2-5acd-4cde-8457-cc808469c3ae"). InnerVolumeSpecName "kube-api-access-8rsrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:45:26.847727 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:26.847685    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rsrr\" (UniqueName: \"kubernetes.io/projected/76a7a7d2-5acd-4cde-8457-cc808469c3ae-kube-api-access-8rsrr\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:26.847727 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:26.847720    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76a7a7d2-5acd-4cde-8457-cc808469c3ae-plugins-config-volume\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:27.354638 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:27.354599    2579 generic.go:356] "Generic (PLEG): container finished" podID="76a7a7d2-5acd-4cde-8457-cc808469c3ae" containerID="162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969" exitCode=0
Jul 27 16:45:27.354638 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:27.354641    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"
Jul 27 16:45:27.354910 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:27.354645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck" event={"ID":"76a7a7d2-5acd-4cde-8457-cc808469c3ae","Type":"ContainerDied","Data":"162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969"}
Jul 27 16:45:27.354910 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:27.354768    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck" event={"ID":"76a7a7d2-5acd-4cde-8457-cc808469c3ae","Type":"ContainerDied","Data":"7582266ca0cff6c9ae5c24cd67b0ceb5231b093dcd758ef759c17cfc55d8e29b"}
Jul 27 16:45:27.354910 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:27.354797    2579 scope.go:117] "RemoveContainer" containerID="162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969"
Jul 27 16:45:27.364072 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:27.364049    2579 scope.go:117] "RemoveContainer" containerID="162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969"
Jul 27 16:45:27.364330 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:45:27.364313    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969\": container with ID starting with 162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969 not found: ID does not exist" containerID="162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969"
Jul 27 16:45:27.364368 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:27.364340    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969"} err="failed to get container status \"162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969\": rpc error: code = NotFound desc = could not find container \"162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969\": container with ID starting with 162683a780f1adcbba86cfd168ecb215aab1141a40f2f42a688252bec1589969 not found: ID does not exist"
Jul 27 16:45:27.377288 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:27.377262    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"]
Jul 27 16:45:27.382182 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:27.382159    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-1f21d6-c98f95974-vtpck"]
Jul 27 16:45:27.931009 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:27.930975    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76a7a7d2-5acd-4cde-8457-cc808469c3ae" path="/var/lib/kubelet/pods/76a7a7d2-5acd-4cde-8457-cc808469c3ae/volumes"
Jul 27 16:45:37.559101 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:37.559064    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"]
Jul 27 16:45:37.559660 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:37.559318    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerName="istio-proxy" containerID="cri-o://3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e" gracePeriod=30
Jul 27 16:45:42.817408 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.817378    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:45:42.894126 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894029    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-data\") pod \"dc385e67-553d-42a2-99b2-9fae9a728c21\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") "
Jul 27 16:45:42.894126 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894089    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-envoy\") pod \"dc385e67-553d-42a2-99b2-9fae9a728c21\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") "
Jul 27 16:45:42.894126 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894115    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-socket\") pod \"dc385e67-553d-42a2-99b2-9fae9a728c21\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") "
Jul 27 16:45:42.894384 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894158    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmf9p\" (UniqueName: \"kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-kube-api-access-jmf9p\") pod \"dc385e67-553d-42a2-99b2-9fae9a728c21\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") "
Jul 27 16:45:42.894384 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-certs\") pod \"dc385e67-553d-42a2-99b2-9fae9a728c21\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") "
Jul 27 16:45:42.894384 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894215    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-token\") pod \"dc385e67-553d-42a2-99b2-9fae9a728c21\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") "
Jul 27 16:45:42.894384 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894330    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc385e67-553d-42a2-99b2-9fae9a728c21-istiod-ca-cert\") pod \"dc385e67-553d-42a2-99b2-9fae9a728c21\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") "
Jul 27 16:45:42.894384 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894369    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-credential-socket\") pod \"dc385e67-553d-42a2-99b2-9fae9a728c21\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") "
Jul 27 16:45:42.894685 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894415    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-podinfo\") pod \"dc385e67-553d-42a2-99b2-9fae9a728c21\" (UID: \"dc385e67-553d-42a2-99b2-9fae9a728c21\") "
Jul 27 16:45:42.894685 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894465    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc385e67-553d-42a2-99b2-9fae9a728c21" (UID: "dc385e67-553d-42a2-99b2-9fae9a728c21"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:45:42.894791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894731    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc385e67-553d-42a2-99b2-9fae9a728c21-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc385e67-553d-42a2-99b2-9fae9a728c21" (UID: "dc385e67-553d-42a2-99b2-9fae9a728c21"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 16:45:42.894791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894761    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:42.894903 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894811    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc385e67-553d-42a2-99b2-9fae9a728c21" (UID: "dc385e67-553d-42a2-99b2-9fae9a728c21"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:45:42.894950 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.894922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc385e67-553d-42a2-99b2-9fae9a728c21" (UID: "dc385e67-553d-42a2-99b2-9fae9a728c21"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:45:42.895077 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.895050    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc385e67-553d-42a2-99b2-9fae9a728c21" (UID: "dc385e67-553d-42a2-99b2-9fae9a728c21"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:45:42.896484 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.896459    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc385e67-553d-42a2-99b2-9fae9a728c21" (UID: "dc385e67-553d-42a2-99b2-9fae9a728c21"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 16:45:42.896672 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.896509    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-kube-api-access-jmf9p" (OuterVolumeSpecName: "kube-api-access-jmf9p") pod "dc385e67-553d-42a2-99b2-9fae9a728c21" (UID: "dc385e67-553d-42a2-99b2-9fae9a728c21"). InnerVolumeSpecName "kube-api-access-jmf9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:45:42.896672 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.896536    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc385e67-553d-42a2-99b2-9fae9a728c21" (UID: "dc385e67-553d-42a2-99b2-9fae9a728c21"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 16:45:42.896672 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.896638    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc385e67-553d-42a2-99b2-9fae9a728c21" (UID: "dc385e67-553d-42a2-99b2-9fae9a728c21"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 27 16:45:42.995741 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.995698    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-token\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:42.995741 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.995732    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc385e67-553d-42a2-99b2-9fae9a728c21-istiod-ca-cert\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:42.995741 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.995741    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-credential-socket\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:42.995741 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.995751    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-podinfo\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:42.996029 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.995760    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-data\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:42.996029 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.995768    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-istio-envoy\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:42.996029 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.995778    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmf9p\" (UniqueName: \"kubernetes.io/projected/dc385e67-553d-42a2-99b2-9fae9a728c21-kube-api-access-jmf9p\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:42.996029 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:42.995786    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc385e67-553d-42a2-99b2-9fae9a728c21-workload-certs\") on node \"ip-10-0-141-146.ec2.internal\" DevicePath \"\""
Jul 27 16:45:43.440388 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.440350    2579 generic.go:356] "Generic (PLEG): container finished" podID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerID="3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e" exitCode=0
Jul 27 16:45:43.440586 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.440407    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"
Jul 27 16:45:43.440586 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.440434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" event={"ID":"dc385e67-553d-42a2-99b2-9fae9a728c21","Type":"ContainerDied","Data":"3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e"}
Jul 27 16:45:43.440586 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.440491    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf" event={"ID":"dc385e67-553d-42a2-99b2-9fae9a728c21","Type":"ContainerDied","Data":"ad305b00b1e252ab5fdb69e186ab42cd46137179326b427bb959d152960a4158"}
Jul 27 16:45:43.440586 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.440529    2579 scope.go:117] "RemoveContainer" containerID="3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e"
Jul 27 16:45:43.451485 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.451385    2579 scope.go:117] "RemoveContainer" containerID="49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000"
Jul 27 16:45:43.460581 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.460546    2579 scope.go:117] "RemoveContainer" containerID="3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e"
Jul 27 16:45:43.460978 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:45:43.460944    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e\": container with ID starting with 3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e not found: ID does not exist" containerID="3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e"
Jul 27 16:45:43.461148 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.460990    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e"} err="failed to get container status \"3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e\": rpc error: code = NotFound desc = could not find container \"3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e\": container with ID starting with 3fcfafebe2d8d1dba7e7f280a81fc5b5c2d0af6ced25430c9ba24cd4eae1f57e not found: ID does not exist"
Jul 27 16:45:43.461148 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.461042    2579 scope.go:117] "RemoveContainer" containerID="49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000"
Jul 27 16:45:43.461435 ip-10-0-141-146 kubenswrapper[2579]: E0727 16:45:43.461405    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000\": container with ID starting with 49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000 not found: ID does not exist" containerID="49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000"
Jul 27 16:45:43.461486 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.461448    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000"} err="failed to get container status \"49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000\": rpc error: code = NotFound desc = could not find container \"49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000\": container with ID starting with 49a741701c9996f906b5b6a8ffb5d82b758dc29db86b4071c51d98df55c99000 not found: ID does not exist"
Jul 27 16:45:43.463663 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.463640    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"]
Jul 27 16:45:43.467878 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.467852    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-1f21d6-openshift-default-7dc587679b-mxkjf"]
Jul 27 16:45:43.889691 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.889659    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7z7tx_71495e28-54bb-4239-bd98-eb79f515dd5b/manager/0.log"
Jul 27 16:45:43.930653 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:43.930620    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" path="/var/lib/kubelet/pods/dc385e67-553d-42a2-99b2-9fae9a728c21/volumes"
Jul 27 16:45:44.270756 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:44.270672    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8bfcd_a3671a02-bda6-4192-96f5-5ef9ea3fbeb4/server/0.log"
Jul 27 16:45:44.386389 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:44.386354    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lnv82_1bd2c52a-2595-43c2-b5f6-7c36c1c3446f/manager/0.log"
Jul 27 16:45:44.501272 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:44.501240    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc7975cbd-4lj7x_a43f8fe7-87fe-4358-a2b3-1963f4f1348e/copy-manifests/0.log"
Jul 27 16:45:44.509624 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:44.509598    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc7975cbd-4lj7x_a43f8fe7-87fe-4358-a2b3-1963f4f1348e/manager/0.log"
Jul 27 16:45:45.267220 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:45.267185    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29752815-krd9j_586856e2-5cf4-4f76-8469-cc03eb47c02f/cleanup/0.log"
Jul 27 16:45:45.618593 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:45.618565    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-97vh6_91c5857c-5673-49f1-bdc2-fae31072c7b7/postgres/0.log"
Jul 27 16:45:46.432701 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.432667    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n_102a0a81-0316-43f0-b5b5-f02088f1ad4f/util/0.log"
Jul 27 16:45:46.441714 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.441690    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n_102a0a81-0316-43f0-b5b5-f02088f1ad4f/pull/0.log"
Jul 27 16:45:46.449791 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.449771    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n_102a0a81-0316-43f0-b5b5-f02088f1ad4f/extract/0.log"
Jul 27 16:45:46.569402 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.569375    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw_e647bd06-92f3-4153-911e-0e0cb8d31a91/util/0.log"
Jul 27 16:45:46.577834 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.577807    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw_e647bd06-92f3-4153-911e-0e0cb8d31a91/pull/0.log"
Jul 27 16:45:46.586123 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.586103    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw_e647bd06-92f3-4153-911e-0e0cb8d31a91/extract/0.log"
Jul 27 16:45:46.709363 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.709275    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm_077de615-73a1-4d1f-be41-0d9f8f07e52d/util/0.log"
Jul 27 16:45:46.716924 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.716905    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm_077de615-73a1-4d1f-be41-0d9f8f07e52d/pull/0.log"
Jul 27 16:45:46.724450 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.724429    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm_077de615-73a1-4d1f-be41-0d9f8f07e52d/extract/0.log"
Jul 27 16:45:46.850857 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.850829    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4_dd027e94-0738-4a30-a481-478dd0774e93/util/0.log"
Jul 27 16:45:46.859970 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.859944    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4_dd027e94-0738-4a30-a481-478dd0774e93/pull/0.log"
Jul 27 16:45:46.867847 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:46.867821    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4_dd027e94-0738-4a30-a481-478dd0774e93/extract/0.log"
Jul 27 16:45:47.245512 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:47.245477    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9mlp8_7f9ef2c1-2fc2-472c-b49c-99606c2b8da6/manager/0.log"
Jul 27 16:45:47.882637 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:47.882603    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-sv8tg_1e7f1162-d953-4366-a568-6dea3f5f4649/manager/0.log"
Jul 27 16:45:48.255896 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:48.255813    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr_6f0453ab-cd93-4a12-845e-ebed7524993d/istio-proxy/0.log"
Jul 27 16:45:48.403719 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:48.403686    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8ssgg_45e993b7-d3b2-4a5a-92e3-d200962425ab/discovery/0.log"
Jul 27 16:45:48.631566 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:48.631535    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7696b457-r8smj_2d8badc6-554c-4e66-8908-8d1c446ef225/kube-auth-proxy/0.log"
Jul 27 16:45:48.760451 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:48.760422    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xm9bx_dca93d49-78b3-4aca-975f-25bc6a68fbb8/istio-proxy/1.log"
Jul 27 16:45:49.012760 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:49.012678    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-vbq5q_00315488-f29e-4a44-b58b-c9a8bd46a3fd/payload-processing/0.log"
Jul 27 16:45:49.622739 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:49.622709    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-kn9fw_6617f656-b7e0-47f6-b1a1-ec741a265bf5/main/0.log"
Jul 27 16:45:50.009285 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:50.009205    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-zncpq_d6fdd852-1e8d-42ef-8e92-68bfb5035a66/main/0.log"
Jul 27 16:45:59.217662 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:59.217623    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-44z5d_d3b7a762-4b09-4df3-878f-304637a41ed9/global-pull-secret-syncer/0.log"
Jul 27 16:45:59.394573 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:59.394538    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5htdh_3fb0452e-1b06-406d-8a5b-3b07372c12ff/konnectivity-agent/0.log"
Jul 27 16:45:59.516362 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:45:59.516283    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-146.ec2.internal_4d95d964f6f5196d055ec9fd47d5b92d/haproxy/0.log"
Jul 27 16:46:03.838254 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:03.838214    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n_102a0a81-0316-43f0-b5b5-f02088f1ad4f/extract/0.log"
Jul 27 16:46:03.864106 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:03.864078    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n_102a0a81-0316-43f0-b5b5-f02088f1ad4f/util/0.log"
Jul 27 16:46:03.889335 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:03.889310    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759dx67n_102a0a81-0316-43f0-b5b5-f02088f1ad4f/pull/0.log"
Jul 27 16:46:03.920987 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:03.920960    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw_e647bd06-92f3-4153-911e-0e0cb8d31a91/extract/0.log"
Jul 27 16:46:03.945089 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:03.945061    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw_e647bd06-92f3-4153-911e-0e0cb8d31a91/util/0.log"
Jul 27 16:46:03.973594 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:03.973566    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0gnhqw_e647bd06-92f3-4153-911e-0e0cb8d31a91/pull/0.log"
Jul 27 16:46:04.003625 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:04.003596    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm_077de615-73a1-4d1f-be41-0d9f8f07e52d/extract/0.log"
Jul 27 16:46:04.038693 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:04.038662    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm_077de615-73a1-4d1f-be41-0d9f8f07e52d/util/0.log"
Jul 27 16:46:04.066813 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:04.066780    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mp6qm_077de615-73a1-4d1f-be41-0d9f8f07e52d/pull/0.log"
Jul 27 16:46:04.104792 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:04.104710    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4_dd027e94-0738-4a30-a481-478dd0774e93/extract/0.log"
Jul 27 16:46:04.127936 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:04.127908    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4_dd027e94-0738-4a30-a481-478dd0774e93/util/0.log"
Jul 27 16:46:04.153328 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:04.153296    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1w9fq4_dd027e94-0738-4a30-a481-478dd0774e93/pull/0.log"
Jul 27 16:46:04.549227 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:04.549201    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9mlp8_7f9ef2c1-2fc2-472c-b49c-99606c2b8da6/manager/0.log"
Jul 27 16:46:04.997844 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:04.997750    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-sv8tg_1e7f1162-d953-4366-a568-6dea3f5f4649/manager/0.log"
Jul 27 16:46:06.998553 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:06.998457    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w5l6w_2a5154fb-d47f-4313-9ab7-ba8a8d36e80a/node-exporter/0.log"
Jul 27 16:46:07.028834 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:07.028809    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w5l6w_2a5154fb-d47f-4313-9ab7-ba8a8d36e80a/kube-rbac-proxy/0.log"
Jul 27 16:46:07.058109 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:07.058082    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w5l6w_2a5154fb-d47f-4313-9ab7-ba8a8d36e80a/init-textfile/0.log"
Jul 27 16:46:09.916992 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.916953    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"]
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917333    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4121c4c3-bea8-4d47-8a42-611c8e17c5ec" containerName="payload-processing"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917346    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4121c4c3-bea8-4d47-8a42-611c8e17c5ec" containerName="payload-processing"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917355    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917360    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917368    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917374    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917380    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917386    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917391    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cc33561-7517-4073-929e-1c64c774559b" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917396    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cc33561-7517-4073-929e-1c64c774559b" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917406    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a7a7d2-5acd-4cde-8457-cc808469c3ae" containerName="payload-processing"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917410    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a7a7d2-5acd-4cde-8457-cc808469c3ae" containerName="payload-processing"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917420    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d65f1a72-ced7-40ac-aaa0-7ca59eb5d882" containerName="payload-pre-processing"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917425    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d65f1a72-ced7-40ac-aaa0-7ca59eb5d882" containerName="payload-pre-processing"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917432    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917437    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917444    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917449    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917457    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917462    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerName="istio-proxy"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917468    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4719abcd-8b55-4a11-b87e-3879974937cb" containerName="payload-processing"
Jul 27 16:46:09.917529 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917473    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4719abcd-8b55-4a11-b87e-3879974937cb" containerName="payload-processing"
Jul 27 16:46:09.918201 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917552    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc385e67-553d-42a2-99b2-9fae9a728c21" containerName="istio-proxy"
Jul 27 16:46:09.918201 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917561    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerName="istio-proxy"
Jul 27 16:46:09.918201 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917568    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d65f1a72-ced7-40ac-aaa0-7ca59eb5d882" containerName="payload-pre-processing"
Jul 27 16:46:09.918201 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917574    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc33561-7517-4073-929e-1c64c774559b" containerName="istio-proxy"
Jul 27 16:46:09.918201 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917580    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5e53042-d9b0-417d-8e0c-5b5521eec259" containerName="istio-proxy"
Jul 27 16:46:09.918201 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917586    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4121c4c3-bea8-4d47-8a42-611c8e17c5ec" containerName="payload-processing"
Jul 27 16:46:09.918201 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917590    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cec0030-501f-46fa-bc8e-9e642e061a77" containerName="istio-proxy"
Jul 27 16:46:09.918201 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917596    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="76a7a7d2-5acd-4cde-8457-cc808469c3ae" containerName="payload-processing"
Jul 27 16:46:09.918201 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917601    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cc33561-7517-4073-929e-1c64c774559b" containerName="istio-proxy"
Jul 27 16:46:09.918201 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.917607    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4719abcd-8b55-4a11-b87e-3879974937cb" containerName="payload-processing"
Jul 27 16:46:09.920426 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.920409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:09.922392 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.922374    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6nds\"/\"openshift-service-ca.crt\""
Jul 27 16:46:09.922526 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.922490    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t6nds\"/\"kube-root-ca.crt\""
Jul 27 16:46:09.922909 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.922891    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t6nds\"/\"default-dockercfg-zspp8\""
Jul 27 16:46:09.943620 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:09.943579    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"]
Jul 27 16:46:10.033280 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.033235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-proc\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.033458 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.033350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-sys\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.033458 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.033391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-lib-modules\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.033458 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.033414    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-podres\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.033458 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.033446    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glbw4\" (UniqueName: \"kubernetes.io/projected/cd479ae6-b9c0-486d-9d78-78c9c6484b07-kube-api-access-glbw4\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.083977 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.083942    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7ddc4c856f-2f9zg_f566621d-c040-4b88-9844-e89f311f2b55/console/0.log"
Jul 27 16:46:10.134274 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.134232    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-proc\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.134456 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.134312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-sys\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.134456 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.134341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-lib-modules\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.134456 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.134361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-podres\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.134456 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.134360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-proc\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.134456 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.134418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glbw4\" (UniqueName: \"kubernetes.io/projected/cd479ae6-b9c0-486d-9d78-78c9c6484b07-kube-api-access-glbw4\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.134456 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.134427    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-sys\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.134710 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.134468    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-podres\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.134710 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.134523    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cd479ae6-b9c0-486d-9d78-78c9c6484b07-lib-modules\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.142638 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.142613    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glbw4\" (UniqueName: \"kubernetes.io/projected/cd479ae6-b9c0-486d-9d78-78c9c6484b07-kube-api-access-glbw4\") pod \"perf-node-gather-daemonset-b6gfb\" (UID: \"cd479ae6-b9c0-486d-9d78-78c9c6484b07\") " pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.233319 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.233222    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.368488 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.368459    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"]
Jul 27 16:46:10.370602 ip-10-0-141-146 kubenswrapper[2579]: W0727 16:46:10.370569    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcd479ae6_b9c0_486d_9d78_78c9c6484b07.slice/crio-4bcb63ca2ef09b1babf9e3d796c1a3d41d2e77b6f245b732409ca50c324ee4c4 WatchSource:0}: Error finding container 4bcb63ca2ef09b1babf9e3d796c1a3d41d2e77b6f245b732409ca50c324ee4c4: Status 404 returned error can't find the container with id 4bcb63ca2ef09b1babf9e3d796c1a3d41d2e77b6f245b732409ca50c324ee4c4
Jul 27 16:46:10.592356 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.592312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb" event={"ID":"cd479ae6-b9c0-486d-9d78-78c9c6484b07","Type":"ContainerStarted","Data":"b643703843e27446ae2be19ea50fa2233f50f939a7ae919aeefd3650a726a48a"}
Jul 27 16:46:10.592593 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.592460    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:10.592593 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.592524    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb" event={"ID":"cd479ae6-b9c0-486d-9d78-78c9c6484b07","Type":"ContainerStarted","Data":"4bcb63ca2ef09b1babf9e3d796c1a3d41d2e77b6f245b732409ca50c324ee4c4"}
Jul 27 16:46:10.609711 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:10.609652    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb" podStartSLOduration=1.609633785 podStartE2EDuration="1.609633785s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 16:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 16:46:10.60696357 +0000 UTC m=+3473.288028001" watchObservedRunningTime="2026-07-27 16:46:10.609633785 +0000 UTC m=+3473.290698214"
Jul 27 16:46:11.814994 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:11.814966    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7cpkh_01000c87-df01-472f-bd6c-e64b199bcc35/dns/0.log"
Jul 27 16:46:11.842622 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:11.842597    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7cpkh_01000c87-df01-472f-bd6c-e64b199bcc35/kube-rbac-proxy/0.log"
Jul 27 16:46:12.069681 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:12.069588    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zls2z_fc65e853-284c-47b7-a0f6-022fa31d1a0d/dns-node-resolver/0.log"
Jul 27 16:46:12.648033 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:12.648002    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ksdlr_2ca7316b-79a1-488e-9f95-7afaf9e1e775/node-ca/0.log"
Jul 27 16:46:13.761897 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:13.761864    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr_6f0453ab-cd93-4a12-845e-ebed7524993d/istio-proxy/0.log"
Jul 27 16:46:13.913145 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:13.913109    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8ssgg_45e993b7-d3b2-4a5a-92e3-d200962425ab/discovery/0.log"
Jul 27 16:46:13.973336 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:13.973299    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7696b457-r8smj_2d8badc6-554c-4e66-8908-8d1c446ef225/kube-auth-proxy/0.log"
Jul 27 16:46:14.026689 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:14.026659    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xm9bx_dca93d49-78b3-4aca-975f-25bc6a68fbb8/istio-proxy/0.log"
Jul 27 16:46:14.052544 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:14.052514    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xm9bx_dca93d49-78b3-4aca-975f-25bc6a68fbb8/istio-proxy/1.log"
Jul 27 16:46:14.122682 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:14.122653    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-vbq5q_00315488-f29e-4a44-b58b-c9a8bd46a3fd/payload-processing/0.log"
Jul 27 16:46:15.094251 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:15.094211    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rm56l_931dac23-0e51-4f5c-958a-88d3da987537/serve-healthcheck-canary/0.log"
Jul 27 16:46:15.941293 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:15.941246    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skx27_ee1db810-9561-46f7-9521-5fe16c9c94bd/kube-rbac-proxy/0.log"
Jul 27 16:46:15.974582 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:15.974528    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skx27_ee1db810-9561-46f7-9521-5fe16c9c94bd/exporter/0.log"
Jul 27 16:46:16.004523 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:16.004471    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-skx27_ee1db810-9561-46f7-9521-5fe16c9c94bd/extractor/0.log"
Jul 27 16:46:16.607621 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:16.607586    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t6nds/perf-node-gather-daemonset-b6gfb"
Jul 27 16:46:18.122290 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:18.122247    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7z7tx_71495e28-54bb-4239-bd98-eb79f515dd5b/manager/0.log"
Jul 27 16:46:18.677351 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:18.677316    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8bfcd_a3671a02-bda6-4192-96f5-5ef9ea3fbeb4/server/0.log"
Jul 27 16:46:18.767543 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:18.767442    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lnv82_1bd2c52a-2595-43c2-b5f6-7c36c1c3446f/manager/0.log"
Jul 27 16:46:18.805033 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:18.804990    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc7975cbd-4lj7x_a43f8fe7-87fe-4358-a2b3-1963f4f1348e/manager/0.log"
Jul 27 16:46:18.831361 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:18.831334    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc7975cbd-4lj7x_a43f8fe7-87fe-4358-a2b3-1963f4f1348e/copy-manifests/0.log"
Jul 27 16:46:19.589302 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:19.589271    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr_6f0453ab-cd93-4a12-845e-ebed7524993d/istio-proxy/0.log"
Jul 27 16:46:19.739818 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:19.739787    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8ssgg_45e993b7-d3b2-4a5a-92e3-d200962425ab/discovery/0.log"
Jul 27 16:46:19.769514 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:19.769477    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7696b457-r8smj_2d8badc6-554c-4e66-8908-8d1c446ef225/kube-auth-proxy/0.log"
Jul 27 16:46:19.794265 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:19.794235    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xm9bx_dca93d49-78b3-4aca-975f-25bc6a68fbb8/istio-proxy/0.log"
Jul 27 16:46:19.821149 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:19.821115    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xm9bx_dca93d49-78b3-4aca-975f-25bc6a68fbb8/istio-proxy/1.log"
Jul 27 16:46:19.864742 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:19.864715    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-vbq5q_00315488-f29e-4a44-b58b-c9a8bd46a3fd/payload-processing/0.log"
Jul 27 16:46:21.250780 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:21.250749    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6cbcdcfcccl5nkr_6f0453ab-cd93-4a12-845e-ebed7524993d/istio-proxy/0.log"
Jul 27 16:46:21.406633 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:21.406540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-8ssgg_45e993b7-d3b2-4a5a-92e3-d200962425ab/discovery/0.log"
Jul 27 16:46:21.453409 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:21.453378    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f7696b457-r8smj_2d8badc6-554c-4e66-8908-8d1c446ef225/kube-auth-proxy/0.log"
Jul 27 16:46:21.487551 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:21.487517    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xm9bx_dca93d49-78b3-4aca-975f-25bc6a68fbb8/istio-proxy/0.log"
Jul 27 16:46:21.512392 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:21.512356    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-c747fcbf8-xm9bx_dca93d49-78b3-4aca-975f-25bc6a68fbb8/istio-proxy/1.log"
Jul 27 16:46:21.558951 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:21.558919    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-vbq5q_00315488-f29e-4a44-b58b-c9a8bd46a3fd/payload-processing/0.log"
Jul 27 16:46:25.868159 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:25.868114    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz_b534d69f-dc4a-42a3-a71d-9f0bd6499673/kube-storage-version-migrator-operator/1.log"
Jul 27 16:46:25.869150 ip-10-0-141-146 kubenswrapper[2579]: I0727 16:46:25.869129    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-b54qz_b534d69f-dc4a-42a3-a71d-9f0bd6499673/kube-storage-version-migrator-operator/0.log"