Sep 10 14:17:29.398913 ip-10-0-128-234 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 10 14:17:29.399083 ip-10-0-128-234 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 10 14:17:29.399178 ip-10-0-128-234 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 10 14:17:29.399619 ip-10-0-128-234 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 10 14:17:39.560946 ip-10-0-128-234 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 10 14:17:39.560964 ip-10-0-128-234 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e24366de34fc4c9ab697435f592203a2 --
Sep 10 14:19:13.279179 ip-10-0-128-234 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 14:19:13.730397 ip-10-0-128-234 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:19:13.730397 ip-10-0-128-234 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 14:19:13.730397 ip-10-0-128-234 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:19:13.730397 ip-10-0-128-234 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 14:19:13.730397 ip-10-0-128-234 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 14:19:13.731459 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.731368    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 14:19:13.736199 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736179    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:13.736199 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736198    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736202    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736206    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736209    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736212    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736216    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736219    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736226    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736228    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736231    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736234    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736236    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736239    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736241    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736244    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736246    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736249    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736251    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736254    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736256    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:13.736267 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736259    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736267    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736270    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736274    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736276    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736279    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736284    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736287    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736290    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736293    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736295    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736298    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736300    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736302    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736305    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736309    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736311    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736313    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736316    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:13.736734 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736319    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736322    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736324    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736327    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736329    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736331    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736334    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736336    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736338    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736341    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736343    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736346    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736348    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736351    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736355    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736358    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736360    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736365    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736368    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736371    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:13.737200 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736374    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736377    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736380    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736383    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736386    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736388    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736391    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736393    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736396    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736398    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736401    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736403    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736405    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736409    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736411    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736414    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736416    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736419    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736421    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736425    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:13.737721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736427    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736429    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736432    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736434    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736437    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736439    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736442    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736445    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736449    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736452    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736456    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736459    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736462    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736464    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736467    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736469    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736472    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736474    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.736477    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:13.738226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737233    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737239    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737243    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737246    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737249    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737251    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737254    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737257    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737261    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737265    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737268    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737271    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737273    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737276    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737280    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737284    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737287    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737290    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737293    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:13.738773 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737297    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737300    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737303    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737306    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737308    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737311    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737313    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737316    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737318    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737320    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737323    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737325    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737328    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737331    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737333    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737336    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737338    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737340    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737343    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:13.739274 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737346    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737348    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737351    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737354    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737356    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737359    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737361    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737364    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737366    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737368    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737371    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737373    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737375    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737378    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737382    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737384    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737387    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737389    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737392    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737394    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:13.739748 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737396    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737399    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737401    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737404    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737407    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737409    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737412    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737414    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737417    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737419    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737423    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737426    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737428    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737430    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737433    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737436    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737439    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737444    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737447    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737449    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:13.740268 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737451    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737454    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737456    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737459    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737461    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737463    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737466    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737471    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737474    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737477    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737480    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737482    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737485    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737488    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737490    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737493    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737496    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737498    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737500    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:13.740757 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737503    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737505    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737931    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737937    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737940    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737944    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737946    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737949    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737953    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737956    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737960    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737963    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737966    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737968    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737971    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737975    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737978    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737981    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737985    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:13.741243 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737988    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737991    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737994    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737996    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.737999    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738001    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738004    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738006    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738016    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738020    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738023    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738025    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738028    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738031    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738033    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738036    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738038    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738041    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738043    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738045    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:13.741696 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738048    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738050    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738054    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738058    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738061    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738063    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738065    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738069    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738071    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738074    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738076    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738080    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738082    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738085    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738088    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738091    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738093    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738096    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738098    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738100    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:13.742204 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738103    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738105    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738108    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738110    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738113    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738115    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738117    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738119    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738122    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738124    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738126    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738129    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738131    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738134    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738136    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738140    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738143    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738145    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738148    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738150    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:13.742731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738152    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738155    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738157    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738159    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738163    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738166    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738168    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738171    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738174    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738176    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738178    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738181    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738185    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738188    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738190    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738193    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738195    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738198    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738200    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:13.743226 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738204    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738207    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738210    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738287    2579 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738327    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738339    2579 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738347    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738352    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738356    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738362    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738366    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738369    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738372    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738376    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738379    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738382    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738385    2579 flags.go:64] FLAG: --cgroup-root=""
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738389    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738392    2579 flags.go:64] FLAG: --client-ca-file=""
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738395    2579 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738398    2579 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738401    2579 flags.go:64] FLAG: --cluster-domain=""
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738404    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 14:19:13.743693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738407    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738410    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738413    2579 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738417    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738420    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738423    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738426    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738429    2579 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738432    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738435    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738438    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738441    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738445    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738447    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738451    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738454    2579 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738457    2579 flags.go:64] FLAG: --enable-server="true"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738461    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738466    2579 flags.go:64] FLAG: --event-burst="100"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738469    2579 flags.go:64] FLAG: --event-qps="50"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738472    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738475    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738478    2579 flags.go:64] FLAG: --eviction-hard=""
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738482    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 14:19:13.744257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738485    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738488    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738492    2579 flags.go:64] FLAG: --eviction-soft=""
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738495    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738498    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738501    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738504    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738506    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738509    2579 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738512    2579 flags.go:64] FLAG: --feature-gates=""
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738516    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738519    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738522    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738525    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738528    2579 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738531    2579 flags.go:64] FLAG: --help="false"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738534    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-128-234.ec2.internal"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738537    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738540    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738542    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738546    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738549    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738552    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 14:19:13.744848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738555    2579 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738558    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738562    2579 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738565    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738568    2579 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738572    2579 flags.go:64] FLAG: --kube-reserved=""
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738575    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738578    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738581    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738584    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738587    2579 flags.go:64] FLAG: --lock-file=""
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738590    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738593    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738596    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738602    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738604    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738607    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738610    2579 flags.go:64] FLAG: --logging-format="text"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738613    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738616    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738619    2579 flags.go:64] FLAG: --manifest-url=""
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738621    2579 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738626    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738629    2579 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738633    2579 flags.go:64] FLAG: --max-pods="110"
Sep 10 14:19:13.745423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738637    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738640    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738642    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738645    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738648    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738667    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738671    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738682    2579 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738685    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738690    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738693    2579 flags.go:64] FLAG: --pod-cidr=""
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738696    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738702    2579 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738705    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738709    2579 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738712    2579 flags.go:64] FLAG: --port="10250"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738715    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738718    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b2ecb6795d265170"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738721    2579 flags.go:64] FLAG: --qos-reserved=""
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738725    2579 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738728    2579 flags.go:64] FLAG: --register-node="true"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738731    2579 flags.go:64] FLAG: --register-with-taints=""
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738735    2579 flags.go:64] FLAG: --registry-burst="10"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738738    2579 flags.go:64] FLAG: --registry-qps="5"
Sep 10 14:19:13.746117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738740    2579 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738743    2579 flags.go:64] FLAG: --reserved-memory=""
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738747    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738750    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738753    2579 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738755    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738758    2579 flags.go:64] FLAG: --runonce="false"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738761    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738764    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738767    2579 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738769    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738772    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738775    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738793    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738796    2579 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738798    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738801    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738805    2579 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738808    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738811    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738814    2579 flags.go:64] FLAG: --system-cgroups=""
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738816    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738823    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738825    2579 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738828    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 14:19:13.746710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738832    2579 flags.go:64] FLAG: --tls-min-version=""
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738835    2579 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738838    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738841    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738844    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738847    2579 flags.go:64] FLAG: --v="2"
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738851    2579 flags.go:64] FLAG: --version="false"
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738855    2579 flags.go:64] FLAG: --vmodule=""
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738859    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.738862    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738978    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738982    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738985    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738988    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738991    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738993    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738996    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.738998    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739001    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739003    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739005    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739008    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:13.747595 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739010    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739013    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739015    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739018    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739020    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739023    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739025    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739028    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739030    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739033    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739036    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739039    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739042    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739045    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739047    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739050    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739052    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739055    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739057    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739059    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:13.748334 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739062    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739064    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739067    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739070    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739072    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739075    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739077    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739080    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739082    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739085    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739087    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739089    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739092    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739094    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739096    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739099    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739102    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739104    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739106    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739109    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:13.748866 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739111    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739114    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739118    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739121    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739124    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739127    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739130    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739132    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739135    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739137    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739140    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739142    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739144    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739147    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739149    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739152    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739154    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739157    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739159    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739162    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:13.749368 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739164    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739166    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739169    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739171    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739173    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739176    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739178    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739182    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739185    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739188    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739190    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739194    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739197    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739200    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739203    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739206    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739209    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739212    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:13.749892 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739215    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739217    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739228    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739231    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739233    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739236    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739239    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739241    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.739244    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.740179    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.750147    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.750302    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.750324    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 14:19:13.750384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.750330    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750391    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750396    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750400    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750403    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750405    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750409    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750412    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750415    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750417    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750420    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750424    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750428    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750431    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750434    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750436    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750439    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750441    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750444    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:13.750710 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750446    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750449    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750451    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750454    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750457    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750459    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750462    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750464    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750466    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750470    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750472    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750475    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750477    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750480    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750482    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750486    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750489    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750491    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750494    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750497    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:13.751190 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750499    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750502    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750504    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750507    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750509    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750512    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750515    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750517    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750520    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750523    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750525    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750528    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750530    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750532    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750535    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750537    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750540    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750542    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750545    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750547    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:13.751677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750550    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750552    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750554    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750557    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750559    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750562    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750564    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750567    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750571    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750575    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750578    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750581    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750584    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750587    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750590    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750593    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750595    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750598    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750600    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:13.752183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750603    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750605    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750609    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750611    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750613    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750616    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750618    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750621    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750623    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750627    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750630    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750633    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750635    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750638    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750640    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750643    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750646    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750648    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750651    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:13.752648 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750653    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750656    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750659    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.750664    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750822    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750829    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750832    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750835    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750838    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750841    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750844    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750847    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750849    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750851    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 14:19:13.753115 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750854    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750858    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750863    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750866    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750868    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750870    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750873    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750876    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750878    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750882    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750885    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750888    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750891    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750894    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750896    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750899    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750901    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750904    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750906    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 14:19:13.753479 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750909    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750912    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750914    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750917    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750920    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750922    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750925    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750927    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750930    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750932    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750936    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750939    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750942    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750944    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750947    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750950    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750954    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750956    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750959    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750962    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 14:19:13.753956 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750964    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750967    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750969    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750972    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750975    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750977    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750980    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750982    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750985    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750987    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750990    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750992    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750995    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.750998    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751000    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751004    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751006    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751008    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751011    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751013    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 14:19:13.754452 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751016    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751019    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751021    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751024    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751026    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751029    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751031    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751033    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751036    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751039    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751042    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751044    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751047    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751049    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751052    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751054    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751059    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751062    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751064    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751067    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 14:19:13.754975 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751069    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751072    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751074    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751076    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751079    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751083    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751085    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751088    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751090    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:13.751093    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.751098    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.751230    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 14:19:13.755475 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.754534    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 14:19:13.755845 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.755544    2579 server.go:1019] "Starting client certificate rotation"
Sep 10 14:19:13.755845 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.755637    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 14:19:13.755845 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.755672    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 14:19:13.758588 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.758573    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 14:19:13.762425 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.762406    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 14:19:13.771664 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.771640    2579 log.go:25] "Validated CRI v1 runtime API"
Sep 10 14:19:13.774865 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.774846    2579 log.go:25] "Validated CRI v1 image API"
Sep 10 14:19:13.775881 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.775864    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 14:19:13.782725 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.782691    2579 fs.go:135] Filesystem UUIDs: map[164e7a05-ae14-44a8-8152-8d7614591639:/dev/nvme0n1p4 1c436935-419e-43ce-88a5-cbcabae6fdc9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 10 14:19:13.782844 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.782719    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 14:19:13.789743 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.789619    2579 manager.go:216] Machine: {Timestamp:2026-09-10 14:19:13.7872195 +0000 UTC m=+0.379424261 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099865 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24fad5b5e62f78708dd0eb962ebbcc SystemUUID:ec24fad5-b5e6-2f78-708d-d0eb962ebbcc BootID:e24366de-34fc-4c9a-b697-435f592203a2 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:f7:d2:df:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:f7:d2:df:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:9d:5b:48:e2:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 14:19:13.789743 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.789737    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 14:19:13.789902 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.789889    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 14:19:13.791015 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.790979    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 14:19:13.791159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.791020    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-234.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 14:19:13.791838 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.791828    2579 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 14:19:13.791879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.791840    2579 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 14:19:13.791879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.791849    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 14:19:13.792694 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.792683    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 14:19:13.794260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.794249    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 14:19:13.797448 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.797434    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 14:19:13.797756 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.797744    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 14:19:13.797804 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.797792    2579 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 14:19:13.797804 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.797804    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 14:19:13.797866 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.797818    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 14:19:13.797866 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.797827    2579 kubelet.go:398] "Adding apiserver pod source"
Sep 10 14:19:13.797866 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.797836    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 14:19:13.798197 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.798183    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 14:19:13.798261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.798209    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 14:19:13.798374 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.798352    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 14:19:13.800755 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.800737    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 14:19:13.803634 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.803618    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 14:19:13.803715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.803650    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 14:19:13.803832 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.803822    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 14:19:13.803875 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.803837    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 14:19:13.803875 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.803842    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 14:19:13.803875 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.803848    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 14:19:13.803875 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.803855    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 14:19:13.803875 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.803862    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 14:19:13.804481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.804473    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 14:19:13.804481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.804481    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 14:19:13.804540 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.804488    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 14:19:13.804540 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.804494    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 14:19:13.804540 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.804508    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 14:19:13.804540 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.804515    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 14:19:13.805649 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.805637    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 14:19:13.805649 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.805647    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 14:19:13.807361 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.807338    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-234.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 14:19:13.808133 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.808110    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 14:19:13.808185 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.808110    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 14:19:13.809845 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.809827    2579 server.go:1268] "Started kubelet"
Sep 10 14:19:13.809927 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.809905    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 14:19:13.809977 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.809909    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 14:19:13.809977 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.809975    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 14:19:13.810716 ip-10-0-128-234 systemd[1]: Started Kubernetes Kubelet.
Sep 10 14:19:13.811428 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.811371    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 14:19:13.812007 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.811991    2579 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 14:19:13.814430 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.814411    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 14:19:13.817790 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.817756    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 14:19:13.818378 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.818363    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 14:19:13.819375 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.819237    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 14:19:13.819497 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.819486    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 14:19:13.819654 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.819404    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 14:19:13.819715 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.819363    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Sep 10 14:19:13.819927 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.819915    2579 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 14:19:13.819927 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.819927    2579 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 14:19:13.820379 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.820333    2579 factory.go:55] Registering systemd factory
Sep 10 14:19:13.820379 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.820354    2579 factory.go:223] Registration of the systemd container factory successfully
Sep 10 14:19:13.820685 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.820670    2579 factory.go:153] Registering CRI-O factory
Sep 10 14:19:13.820745 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.820687    2579 factory.go:223] Registration of the crio container factory successfully
Sep 10 14:19:13.820745 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.820745    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 14:19:13.820868 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.820765    2579 factory.go:103] Registering Raw factory
Sep 10 14:19:13.820868 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.820823    2579 manager.go:1196] Started watching for new ooms in manager
Sep 10 14:19:13.821361 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.821249    2579 manager.go:349] Starting recovery of all containers
Sep 10 14:19:13.822077 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.820078    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18d3fb744642b6d5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-09-10 14:19:13.809774293 +0000 UTC m=+0.401979053,LastTimestamp:2026-09-10 14:19:13.809774293 +0000 UTC m=+0.401979053,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}"
Sep 10 14:19:13.830654 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.830627    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 14:19:13.830814 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.830769    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-234.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 14:19:13.832855 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.832839    2579 manager.go:354] Recovery completed
Sep 10 14:19:13.837253 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.837241    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:13.839203 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.839176    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:13.839270 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.839219    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:13.839270 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.839232    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:13.839913 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.839900    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 14:19:13.839913 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.839911    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 14:19:13.840003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.839915    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:13.840003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.839930    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 14:19:13.840585 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.840567    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:13.840658 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.840601    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:13.840658 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.840613    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:13.841101 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.841086    2579 policy_none.go:49] "None policy: Start"
Sep 10 14:19:13.841181 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.841104    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 14:19:13.841181 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.841119    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 14:19:13.841960 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.841950    2579 policy_none.go:47] "Start"
Sep 10 14:19:13.853466 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.853395    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18d3fb744803c417  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-234.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-09-10 14:19:13.839203351 +0000 UTC m=+0.431408110,LastTimestamp:2026-09-10 14:19:13.839203351 +0000 UTC m=+0.431408110,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}"
Sep 10 14:19:13.859111 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.859040    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18d3fb7448041eef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-234.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-09-10 14:19:13.839226607 +0000 UTC m=+0.431431371,LastTimestamp:2026-09-10 14:19:13.839226607 +0000 UTC m=+0.431431371,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}"
Sep 10 14:19:13.864950 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.864862    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18d3fb74480444c2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-234.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-09-10 14:19:13.83923629 +0000 UTC m=+0.431441050,LastTimestamp:2026-09-10 14:19:13.83923629 +0000 UTC m=+0.431441050,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}"
Sep 10 14:19:13.869952 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.869878    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-234.ec2.internal.18d3fb744803c417\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18d3fb744803c417  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-234.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-09-10 14:19:13.839203351 +0000 UTC m=+0.431408110,LastTimestamp:2026-09-10 14:19:13.840583416 +0000 UTC m=+0.432788175,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}"
Sep 10 14:19:13.881904 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.881833    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-234.ec2.internal.18d3fb7448041eef\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18d3fb7448041eef  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-234.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-09-10 14:19:13.839226607 +0000 UTC m=+0.431431371,LastTimestamp:2026-09-10 14:19:13.840606546 +0000 UTC m=+0.432811307,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}"
Sep 10 14:19:13.889490 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.889470    2579 manager.go:337] "Starting Device Plugin manager"
Sep 10 14:19:13.898844 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.889530    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 14:19:13.898844 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.889542    2579 server.go:87] "Starting device plugin registration server"
Sep 10 14:19:13.898844 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.889836    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 14:19:13.898844 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.889846    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 14:19:13.898844 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.889934    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 14:19:13.898844 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.890031    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 14:19:13.898844 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.890041    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 14:19:13.898844 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.890623    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 14:19:13.898844 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.890673    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-234.ec2.internal\" not found"
Sep 10 14:19:13.898844 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.896479    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-234.ec2.internal.18d3fb74480444c2\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18d3fb74480444c2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-234.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-09-10 14:19:13.83923629 +0000 UTC m=+0.431441050,LastTimestamp:2026-09-10 14:19:13.840616674 +0000 UTC m=+0.432821433,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}"
Sep 10 14:19:13.903742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.903702    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 14:19:13.905246 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.905228    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 14:19:13.905322 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.905283    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 14:19:13.905322 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.905308    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 14:19:13.905416 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.905356    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 14:19:13.908837 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.908806    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 10 14:19:13.909447 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.909370    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18d3fb744b414efb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-09-10 14:19:13.893568251 +0000 UTC m=+0.485772999,LastTimestamp:2026-09-10 14:19:13.893568251 +0000 UTC m=+0.485772999,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}"
Sep 10 14:19:13.930926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.930895    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j9zvx"
Sep 10 14:19:13.949635 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.949605    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j9zvx"
Sep 10 14:19:13.990667 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.990562    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:13.992000 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.991973    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:13.992127 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.992021    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:13.992127 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.992034    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:13.992127 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:13.992059    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-234.ec2.internal"
Sep 10 14:19:13.995182 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:13.995103    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-234.ec2.internal.18d3fb744803c417\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-234.ec2.internal.18d3fb744803c417  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-234.ec2.internal,UID:ip-10-0-128-234.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-234.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-234.ec2.internal,},FirstTimestamp:2026-09-10 14:19:13.839203351 +0000 UTC m=+0.431408110,LastTimestamp:2026-09-10 14:19:13.991997754 +0000 UTC m=+0.584202519,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-234.ec2.internal,}"
Sep 10 14:19:14.005432 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.005411    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"]
Sep 10 14:19:14.005531 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.005480    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:14.006465 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.006446    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:14.006532 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.006486    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:14.006532 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.006500    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:14.007111 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.007094    2579 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-128-234.ec2.internal\" not found" node="ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.007577 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.007565    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:14.007683 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.007670    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.007731 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.007703    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:14.008364 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.008347    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:14.008447 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.008378    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:14.008447 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.008393    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:14.008447 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.008401    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:14.008447 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.008420    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:14.008447 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.008431    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:14.009694 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.009538    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.011394 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.011365    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:14.012246 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.012228    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:14.012320 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.012258    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:14.012320 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.012272    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:14.021839 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.021813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9131ddd5d479ecade63813301f006514-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"9131ddd5d479ecade63813301f006514\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.021947 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.021844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9131ddd5d479ecade63813301f006514-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"9131ddd5d479ecade63813301f006514\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.021947 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.021860    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ff62f84e60801540483596fbfafdb74-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"8ff62f84e60801540483596fbfafdb74\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.038645 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.038618    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-234.ec2.internal\" not found" node="ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.039612 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.039593    2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-234.ec2.internal\" not found" node="ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.043264 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.043248    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-234.ec2.internal\" not found" node="ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.122925 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.122882    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ff62f84e60801540483596fbfafdb74-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"8ff62f84e60801540483596fbfafdb74\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.122925 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.122927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9131ddd5d479ecade63813301f006514-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"9131ddd5d479ecade63813301f006514\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.123118 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.122948    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9131ddd5d479ecade63813301f006514-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"9131ddd5d479ecade63813301f006514\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.123118 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.123000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9131ddd5d479ecade63813301f006514-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"9131ddd5d479ecade63813301f006514\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.123118 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.123002    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9131ddd5d479ecade63813301f006514-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal\" (UID: \"9131ddd5d479ecade63813301f006514\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.123118 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.123010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8ff62f84e60801540483596fbfafdb74-config\") pod \"kube-apiserver-proxy-ip-10-0-128-234.ec2.internal\" (UID: \"8ff62f84e60801540483596fbfafdb74\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.208088 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.208045    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 14:19:14.209156 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.209138    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 14:19:14.209254 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.209170    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 14:19:14.209254 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.209181    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeHasSufficientPID"
Sep 10 14:19:14.209254 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.209211    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.218821 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.218801    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.218874 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.218830    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-234.ec2.internal\": node \"ip-10-0-128-234.ec2.internal\" not found"
Sep 10 14:19:14.249269 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.249179    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Sep 10 14:19:14.342034 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.341994    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.346952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.346936    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.350062 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.350041    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Sep 10 14:19:14.450930 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.450888    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Sep 10 14:19:14.551546 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.551477    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Sep 10 14:19:14.625848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.625808    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:19:14.652151 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.652122    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Sep 10 14:19:14.752769 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.752728    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Sep 10 14:19:14.755921 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.755904    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 14:19:14.756066 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.756049    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 14:19:14.853061 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:14.852985    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-234.ec2.internal\" not found"
Sep 10 14:19:14.903232 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:14.903067    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ff62f84e60801540483596fbfafdb74.slice/crio-0719772e36bd15c75533f24f77e5c75ebfe0bab144a77c1fff5b0a2741c01695 WatchSource:0}: Error finding container 0719772e36bd15c75533f24f77e5c75ebfe0bab144a77c1fff5b0a2741c01695: Status 404 returned error can't find the container with id 0719772e36bd15c75533f24f77e5c75ebfe0bab144a77c1fff5b0a2741c01695
Sep 10 14:19:14.903545 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:14.903518    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9131ddd5d479ecade63813301f006514.slice/crio-a61f1fc6043cfc2d0578ad55cbf69dc10275392d8407556e1652f4877031e338 WatchSource:0}: Error finding container a61f1fc6043cfc2d0578ad55cbf69dc10275392d8407556e1652f4877031e338: Status 404 returned error can't find the container with id a61f1fc6043cfc2d0578ad55cbf69dc10275392d8407556e1652f4877031e338
Sep 10 14:19:14.904819 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.904775    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:19:14.909741 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.909724    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:19:14.919402 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.919382    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.929396 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.929373    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 14:19:14.930530 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.930515    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal"
Sep 10 14:19:14.943110 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.943087    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 14:19:14.951263 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.951227    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 14:14:14 +0000 UTC" deadline="2028-02-13 14:27:39.215257606 +0000 UTC"
Sep 10 14:19:14.951263 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:14.951260    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12504h8m24.264000781s"
Sep 10 14:19:15.275967 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.275892    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:19:15.369589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.369563    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:19:15.799037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.798730    2579 apiserver.go:52] "Watching apiserver"
Sep 10 14:19:15.807537 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.807507    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 14:19:15.808012 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.807980    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-ng6v4","kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal","openshift-image-registry/node-ca-7nftt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal","openshift-multus/network-metrics-daemon-fdw6t","openshift-network-diagnostics/network-check-target-hdns2","openshift-network-operator/iptables-alerter-2f8wj","kube-system/global-pull-secret-syncer-6mxcc","kube-system/konnectivity-agent-xtcfw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc","openshift-cluster-node-tuning-operator/tuned-trpqt","openshift-dns/node-resolver-67gs2","openshift-multus/multus-7dwqj","openshift-multus/multus-additional-cni-plugins-sd44h"]
Sep 10 14:19:15.812060 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.810935    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.814586 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.813673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7nftt"
Sep 10 14:19:15.831957 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.829763    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 14:19:15.831957 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.830161    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 14:19:15.831957 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.830644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:15.831957 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:15.830749    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:15.831957 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.831217    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 14:19:15.831957 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.831501    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 14:19:15.831957 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.831775    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 14:19:15.837120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.835414    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7dq9n\""
Sep 10 14:19:15.837120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.835685    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 14:19:15.837120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.835691    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 14:19:15.837120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.835912    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 14:19:15.837120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.836917    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 14:19:15.838444 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.838012    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f88xw\""
Sep 10 14:19:15.838444 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.838313    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 14:19:15.842363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.837093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-run-ovn\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.842363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.841941    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-slash\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.842363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.841980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-run-systemd\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.842363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.842019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7gdq\" (UniqueName: \"kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq\") pod \"network-check-target-hdns2\" (UID: \"228c052c-a318-4137-b48b-e57e30b41de9\") " pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:15.842363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.842055    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb5x5\" (UniqueName: \"kubernetes.io/projected/cf0343b6-f96b-4aa5-8b81-31a1c4183142-kube-api-access-rb5x5\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:15.842363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.842085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-etc-openvswitch\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.842363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.842117    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-node-log\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.842363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.842148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-log-socket\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.842363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.842178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-cni-bin\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.842211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce90b427-583b-43b5-8c33-f8c4be7b7674-env-overrides\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845076    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/782ecfa1-a54e-4937-8e35-0af8b48c5706-serviceca\") pod \"node-ca-7nftt\" (UID: \"782ecfa1-a54e-4937-8e35-0af8b48c5706\") " pod="openshift-image-registry/node-ca-7nftt"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845104    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-run-openvswitch\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845141    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7tcb\" (UniqueName: \"kubernetes.io/projected/782ecfa1-a54e-4937-8e35-0af8b48c5706-kube-api-access-f7tcb\") pod \"node-ca-7nftt\" (UID: \"782ecfa1-a54e-4937-8e35-0af8b48c5706\") " pod="openshift-image-registry/node-ca-7nftt"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-var-lib-openvswitch\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845186    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-cni-netd\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-systemd-units\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-run-ovn-kubernetes\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce90b427-583b-43b5-8c33-f8c4be7b7674-ovnkube-script-lib\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-run-netns\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce90b427-583b-43b5-8c33-f8c4be7b7674-ovnkube-config\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce90b427-583b-43b5-8c33-f8c4be7b7674-ovn-node-metrics-cert\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/782ecfa1-a54e-4937-8e35-0af8b48c5706-host\") pod \"node-ca-7nftt\" (UID: \"782ecfa1-a54e-4937-8e35-0af8b48c5706\") " pod="openshift-image-registry/node-ca-7nftt"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845382    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7nfc\" (UniqueName: \"kubernetes.io/projected/ce90b427-583b-43b5-8c33-f8c4be7b7674-kube-api-access-n7nfc\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.847860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845409    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:15.848474 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.845432    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-kubelet\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.848474 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.846033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:15.848474 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:15.846119    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:15.848474 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.848305    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 14:19:15.848622 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.848507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2f8wj"
Sep 10 14:19:15.850596 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.850576    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:15.850707 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:15.850661    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:15.853866 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.853248    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:15.857122 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.856043    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 14:19:15.857122 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.856277    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:19:15.857122 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.856432    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-65vj5\""
Sep 10 14:19:15.857122 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.856570    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 14:19:15.857122 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.856611    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:15.857122 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.856688    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 14:19:15.857122 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.856823    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 14:19:15.857122 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.856988    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7np9z\""
Sep 10 14:19:15.859383 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.859358    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.860384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.860021    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 14:19:15.860384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.860129    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q4hsx\""
Sep 10 14:19:15.861879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.861211    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 14:19:15.861879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.861243    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 14:19:15.862577 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.862551    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 14:19:15.862711 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.862691    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m5tqk\""
Sep 10 14:19:15.862948 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.862930    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:19:15.863026 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.862949    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-67gs2"
Sep 10 14:19:15.864579 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.864560    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.865484 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.865465    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 14:19:15.865605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.865585    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 14:19:15.865672 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.865470    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hmrq4\""
Sep 10 14:19:15.867146 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.867079    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 14:19:15.867489 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.867469    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 14:19:15.867574 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.867514    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 14:19:15.867636 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.867609    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:15.867917 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.867706    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 14:19:15.867917 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.867915    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kf4dz\""
Sep 10 14:19:15.870211 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.870189    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 14:19:15.870338 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.870278    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-f6gwc\""
Sep 10 14:19:15.870406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.870361    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 14:19:15.876683 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.876666    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vf6ww"
Sep 10 14:19:15.884047 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.883930    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vf6ww"
Sep 10 14:19:15.913452 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.913407    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" event={"ID":"8ff62f84e60801540483596fbfafdb74","Type":"ContainerStarted","Data":"0719772e36bd15c75533f24f77e5c75ebfe0bab144a77c1fff5b0a2741c01695"}
Sep 10 14:19:15.915255 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.915229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"9131ddd5d479ecade63813301f006514","Type":"ContainerStarted","Data":"a61f1fc6043cfc2d0578ad55cbf69dc10275392d8407556e1652f4877031e338"}
Sep 10 14:19:15.922758 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.922731    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 14:19:15.946232 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.946191    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fce03b0-6f05-4349-9b98-a5598a3ccf49-tmp-dir\") pod \"node-resolver-67gs2\" (UID: \"0fce03b0-6f05-4349-9b98-a5598a3ccf49\") " pod="openshift-dns/node-resolver-67gs2"
Sep 10 14:19:15.947562 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947533    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-daemon-config\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.947710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947574    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/192fda0e-5194-4acb-b418-b9438ce1c6d4-agent-certs\") pod \"konnectivity-agent-xtcfw\" (UID: \"192fda0e-5194-4acb-b418-b9438ce1c6d4\") " pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:15.947710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-etc-kubernetes\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.947710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29aba2b8-d986-4a26-bfd9-0816e2d4261a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:15.947710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:15.947710 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947669    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-tuned\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.947990 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce90b427-583b-43b5-8c33-f8c4be7b7674-ovn-node-metrics-cert\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.947990 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947810    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/782ecfa1-a54e-4937-8e35-0af8b48c5706-host\") pod \"node-ca-7nftt\" (UID: \"782ecfa1-a54e-4937-8e35-0af8b48c5706\") " pod="openshift-image-registry/node-ca-7nftt"
Sep 10 14:19:15.947990 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947874    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/782ecfa1-a54e-4937-8e35-0af8b48c5706-host\") pod \"node-ca-7nftt\" (UID: \"782ecfa1-a54e-4937-8e35-0af8b48c5706\") " pod="openshift-image-registry/node-ca-7nftt"
Sep 10 14:19:15.947990 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-socket-dir-parent\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.947990 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29aba2b8-d986-4a26-bfd9-0816e2d4261a-system-cni-dir\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:15.947990 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.947980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-host\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.948298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7nfc\" (UniqueName: \"kubernetes.io/projected/ce90b427-583b-43b5-8c33-f8c4be7b7674-kube-api-access-n7nfc\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.948298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948073    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-run-k8s-cni-cncf-io\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.948298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29aba2b8-d986-4a26-bfd9-0816e2d4261a-cni-binary-copy\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:15.948298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-socket-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:15.948298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-sysconfig\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.948298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-sys\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.948298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-lib-modules\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.948298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fce03b0-6f05-4349-9b98-a5598a3ccf49-hosts-file\") pod \"node-resolver-67gs2\" (UID: \"0fce03b0-6f05-4349-9b98-a5598a3ccf49\") " pod="openshift-dns/node-resolver-67gs2"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fd5s\" (UniqueName: \"kubernetes.io/projected/29aba2b8-d986-4a26-bfd9-0816e2d4261a-kube-api-access-7fd5s\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-sys-fs\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948400    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-slash\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gdq\" (UniqueName: \"kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq\") pod \"network-check-target-hdns2\" (UID: \"228c052c-a318-4137-b48b-e57e30b41de9\") " pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9kxh\" (UniqueName: \"kubernetes.io/projected/0fce03b0-6f05-4349-9b98-a5598a3ccf49-kube-api-access-r9kxh\") pod \"node-resolver-67gs2\" (UID: \"0fce03b0-6f05-4349-9b98-a5598a3ccf49\") " pod="openshift-dns/node-resolver-67gs2"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-cni-dir\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf7k8\" (UniqueName: \"kubernetes.io/projected/779b1fd9-b06e-47fd-8868-ca5641bb13f5-kube-api-access-zf7k8\") pod \"iptables-alerter-2f8wj\" (UID: \"779b1fd9-b06e-47fd-8868-ca5641bb13f5\") " pod="openshift-network-operator/iptables-alerter-2f8wj"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpqd2\" (UniqueName: \"kubernetes.io/projected/d608634a-23fb-4740-9ed5-f0e9358acd09-kube-api-access-gpqd2\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-tmp\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29aba2b8-d986-4a26-bfd9-0816e2d4261a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb5x5\" (UniqueName: \"kubernetes.io/projected/cf0343b6-f96b-4aa5-8b81-31a1c4183142-kube-api-access-rb5x5\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-log-socket\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.948784 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-cni-bin\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/782ecfa1-a54e-4937-8e35-0af8b48c5706-serviceca\") pod \"node-ca-7nftt\" (UID: \"782ecfa1-a54e-4937-8e35-0af8b48c5706\") " pod="openshift-image-registry/node-ca-7nftt"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7tcb\" (UniqueName: \"kubernetes.io/projected/782ecfa1-a54e-4937-8e35-0af8b48c5706-kube-api-access-f7tcb\") pod \"node-ca-7nftt\" (UID: \"782ecfa1-a54e-4937-8e35-0af8b48c5706\") " pod="openshift-image-registry/node-ca-7nftt"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-cnibin\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-run-openvswitch\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-var-lib-cni-bin\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.948992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-hostroot\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-run-multus-certs\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-registration-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-systemd\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-run\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-var-lib-openvswitch\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-cni-netd\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29aba2b8-d986-4a26-bfd9-0816e2d4261a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/779b1fd9-b06e-47fd-8868-ca5641bb13f5-host-slash\") pod \"iptables-alerter-2f8wj\" (UID: \"779b1fd9-b06e-47fd-8868-ca5641bb13f5\") " pod="openshift-network-operator/iptables-alerter-2f8wj"
Sep 10 14:19:15.949477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b37115a-c43a-48ef-a1dc-165c5db50d22-dbus\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949445    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-systemd-units\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-run-ovn-kubernetes\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce90b427-583b-43b5-8c33-f8c4be7b7674-ovnkube-script-lib\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-var-lib-kubelet\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-run-netns\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce90b427-583b-43b5-8c33-f8c4be7b7674-ovnkube-config\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-system-cni-dir\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949664    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-slash\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949679    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-run-netns\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949706    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-var-lib-kubelet\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b37115a-c43a-48ef-a1dc-165c5db50d22-kubelet-config\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949760    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-device-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-kubernetes\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:15.950404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-var-lib-cni-multus\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.949891    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29aba2b8-d986-4a26-bfd9-0816e2d4261a-cnibin\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950006    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-run-netns\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-modprobe-d\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-sysctl-d\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-sysctl-conf\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdd5p\" (UniqueName: \"kubernetes.io/projected/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-kube-api-access-jdd5p\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-kubelet\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-run-ovn\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950222    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-conf-dir\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950249    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/192fda0e-5194-4acb-b418-b9438ce1c6d4-konnectivity-ca\") pod \"konnectivity-agent-xtcfw\" (UID: \"192fda0e-5194-4acb-b418-b9438ce1c6d4\") " pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950280    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-run-systemd\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950307    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0628e16c-8aaa-4392-a640-946a3a9cfa3a-cni-binary-copy\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx2gw\" (UniqueName: \"kubernetes.io/projected/0628e16c-8aaa-4392-a640-946a3a9cfa3a-kube-api-access-kx2gw\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950364    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-etc-openvswitch\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950399    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-node-log\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce90b427-583b-43b5-8c33-f8c4be7b7674-env-overrides\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/779b1fd9-b06e-47fd-8868-ca5641bb13f5-iptables-alerter-script\") pod \"iptables-alerter-2f8wj\" (UID: \"779b1fd9-b06e-47fd-8868-ca5641bb13f5\") " pod="openshift-network-operator/iptables-alerter-2f8wj"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950460    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce90b427-583b-43b5-8c33-f8c4be7b7674-ovnkube-config\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-systemd-units\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-run-ovn-kubernetes\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950677    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-log-socket\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-cni-bin\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950732    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.950990    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-run-ovn\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:15.951070    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.951136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/782ecfa1-a54e-4937-8e35-0af8b48c5706-serviceca\") pod \"node-ca-7nftt\" (UID: \"782ecfa1-a54e-4937-8e35-0af8b48c5706\") " pod="openshift-image-registry/node-ca-7nftt"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.951142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-kubelet\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.951290    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-run-systemd\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:15.951314    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs podName:cf0343b6-f96b-4aa5-8b81-31a1c4183142 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:16.451191175 +0000 UTC m=+3.043395924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs") pod "network-metrics-daemon-fdw6t" (UID: "cf0343b6-f96b-4aa5-8b81-31a1c4183142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.951361    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-node-log\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.951351    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-run-openvswitch\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.951337    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-etc-openvswitch\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.951414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-host-cni-netd\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.951763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.951386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce90b427-583b-43b5-8c33-f8c4be7b7674-var-lib-openvswitch\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.952656 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.951703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce90b427-583b-43b5-8c33-f8c4be7b7674-env-overrides\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.952656 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.951931    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce90b427-583b-43b5-8c33-f8c4be7b7674-ovnkube-script-lib\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.954912 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.954772    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce90b427-583b-43b5-8c33-f8c4be7b7674-ovn-node-metrics-cert\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.956522 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:15.956402    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:15.956522 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:15.956427    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:15.956522 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:15.956443    2579 projected.go:196] Error preparing data for projected volume kube-api-access-r7gdq for pod openshift-network-diagnostics/network-check-target-hdns2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:15.956522 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:15.956522    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq podName:228c052c-a318-4137-b48b-e57e30b41de9 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:16.456502581 +0000 UTC m=+3.048707348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r7gdq" (UniqueName: "kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq") pod "network-check-target-hdns2" (UID: "228c052c-a318-4137-b48b-e57e30b41de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:15.961072 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.961047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7nfc\" (UniqueName: \"kubernetes.io/projected/ce90b427-583b-43b5-8c33-f8c4be7b7674-kube-api-access-n7nfc\") pod \"ovnkube-node-ng6v4\" (UID: \"ce90b427-583b-43b5-8c33-f8c4be7b7674\") " pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:15.963653 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.963627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb5x5\" (UniqueName: \"kubernetes.io/projected/cf0343b6-f96b-4aa5-8b81-31a1c4183142-kube-api-access-rb5x5\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:15.963775 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:15.963627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7tcb\" (UniqueName: \"kubernetes.io/projected/782ecfa1-a54e-4937-8e35-0af8b48c5706-kube-api-access-f7tcb\") pod \"node-ca-7nftt\" (UID: \"782ecfa1-a54e-4937-8e35-0af8b48c5706\") " pod="openshift-image-registry/node-ca-7nftt"
Sep 10 14:19:16.051803 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.051696    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-socket-dir-parent\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.051803 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.051746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29aba2b8-d986-4a26-bfd9-0816e2d4261a-system-cni-dir\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.051803 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.051774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-host\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.051820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-run-k8s-cni-cncf-io\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.051849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29aba2b8-d986-4a26-bfd9-0816e2d4261a-cni-binary-copy\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.051858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29aba2b8-d986-4a26-bfd9-0816e2d4261a-system-cni-dir\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.051879    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-socket-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.051928    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-sysconfig\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.051961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-sys\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.051989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-lib-modules\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052008    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-sysconfig\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fce03b0-6f05-4349-9b98-a5598a3ccf49-hosts-file\") pod \"node-resolver-67gs2\" (UID: \"0fce03b0-6f05-4349-9b98-a5598a3ccf49\") " pod="openshift-dns/node-resolver-67gs2"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052059    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fce03b0-6f05-4349-9b98-a5598a3ccf49-hosts-file\") pod \"node-resolver-67gs2\" (UID: \"0fce03b0-6f05-4349-9b98-a5598a3ccf49\") " pod="openshift-dns/node-resolver-67gs2"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052068    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fd5s\" (UniqueName: \"kubernetes.io/projected/29aba2b8-d986-4a26-bfd9-0816e2d4261a-kube-api-access-7fd5s\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052077    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-host\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.052098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-sys\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052034    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-socket-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.051961    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-socket-dir-parent\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052118    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-run-k8s-cni-cncf-io\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-sys-fs\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9kxh\" (UniqueName: \"kubernetes.io/projected/0fce03b0-6f05-4349-9b98-a5598a3ccf49-kube-api-access-r9kxh\") pod \"node-resolver-67gs2\" (UID: \"0fce03b0-6f05-4349-9b98-a5598a3ccf49\") " pod="openshift-dns/node-resolver-67gs2"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-cni-dir\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf7k8\" (UniqueName: \"kubernetes.io/projected/779b1fd9-b06e-47fd-8868-ca5641bb13f5-kube-api-access-zf7k8\") pod \"iptables-alerter-2f8wj\" (UID: \"779b1fd9-b06e-47fd-8868-ca5641bb13f5\") " pod="openshift-network-operator/iptables-alerter-2f8wj"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpqd2\" (UniqueName: \"kubernetes.io/projected/d608634a-23fb-4740-9ed5-f0e9358acd09-kube-api-access-gpqd2\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-tmp\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29aba2b8-d986-4a26-bfd9-0816e2d4261a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052355    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-cnibin\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-var-lib-cni-bin\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-hostroot\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-run-multus-certs\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-cni-dir\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:16.052742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052484    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-sys-fs\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-registration-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-systemd\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-run\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29aba2b8-d986-4a26-bfd9-0816e2d4261a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052596    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-lib-modules\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052631    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-hostroot\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/779b1fd9-b06e-47fd-8868-ca5641bb13f5-host-slash\") pod \"iptables-alerter-2f8wj\" (UID: \"779b1fd9-b06e-47fd-8868-ca5641bb13f5\") " pod="openshift-network-operator/iptables-alerter-2f8wj"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-var-lib-cni-bin\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b37115a-c43a-48ef-a1dc-165c5db50d22-dbus\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052722    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-var-lib-kubelet\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-system-cni-dir\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-run-netns\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052800    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-var-lib-kubelet\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b37115a-c43a-48ef-a1dc-165c5db50d22-kubelet-config\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-device-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.053605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-kubernetes\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052945    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-var-lib-cni-multus\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052972    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29aba2b8-d986-4a26-bfd9-0816e2d4261a-cnibin\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052998    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-modprobe-d\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-sysctl-d\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053089    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-sysctl-conf\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdd5p\" (UniqueName: \"kubernetes.io/projected/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-kube-api-access-jdd5p\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-registration-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-conf-dir\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-run-multus-certs\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053200    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-conf-dir\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/192fda0e-5194-4acb-b418-b9438ce1c6d4-konnectivity-ca\") pod \"konnectivity-agent-xtcfw\" (UID: \"192fda0e-5194-4acb-b418-b9438ce1c6d4\") " pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053245    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/779b1fd9-b06e-47fd-8868-ca5641bb13f5-host-slash\") pod \"iptables-alerter-2f8wj\" (UID: \"779b1fd9-b06e-47fd-8868-ca5641bb13f5\") " pod="openshift-network-operator/iptables-alerter-2f8wj"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053251    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0628e16c-8aaa-4392-a640-946a3a9cfa3a-cni-binary-copy\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053241    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-systemd\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.052514    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29aba2b8-d986-4a26-bfd9-0816e2d4261a-cni-binary-copy\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx2gw\" (UniqueName: \"kubernetes.io/projected/0628e16c-8aaa-4392-a640-946a3a9cfa3a-kube-api-access-kx2gw\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.054451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053289    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-run\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/779b1fd9-b06e-47fd-8868-ca5641bb13f5-iptables-alerter-script\") pod \"iptables-alerter-2f8wj\" (UID: \"779b1fd9-b06e-47fd-8868-ca5641bb13f5\") " pod="openshift-network-operator/iptables-alerter-2f8wj"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:16.053335    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053347    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fce03b0-6f05-4349-9b98-a5598a3ccf49-tmp-dir\") pod \"node-resolver-67gs2\" (UID: \"0fce03b0-6f05-4349-9b98-a5598a3ccf49\") " pod="openshift-dns/node-resolver-67gs2"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-daemon-config\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:16.053394    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret podName:1b37115a-c43a-48ef-a1dc-165c5db50d22 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:16.553375332 +0000 UTC m=+3.145580086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret") pod "global-pull-secret-syncer-6mxcc" (UID: "1b37115a-c43a-48ef-a1dc-165c5db50d22") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/192fda0e-5194-4acb-b418-b9438ce1c6d4-agent-certs\") pod \"konnectivity-agent-xtcfw\" (UID: \"192fda0e-5194-4acb-b418-b9438ce1c6d4\") " pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-etc-kubernetes\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29aba2b8-d986-4a26-bfd9-0816e2d4261a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-tuned\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29aba2b8-d986-4a26-bfd9-0816e2d4261a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/192fda0e-5194-4acb-b418-b9438ce1c6d4-konnectivity-ca\") pod \"konnectivity-agent-xtcfw\" (UID: \"192fda0e-5194-4acb-b418-b9438ce1c6d4\") " pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.053922    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29aba2b8-d986-4a26-bfd9-0816e2d4261a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054017    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0628e16c-8aaa-4392-a640-946a3a9cfa3a-multus-daemon-config\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1b37115a-c43a-48ef-a1dc-165c5db50d22-dbus\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.055335 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054239    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-system-cni-dir\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-run-netns\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054306    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-device-dir\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054358    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-kubernetes\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1b37115a-c43a-48ef-a1dc-165c5db50d22-kubelet-config\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054367    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0628e16c-8aaa-4392-a640-946a3a9cfa3a-cni-binary-copy\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054397    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-var-lib-cni-multus\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054437    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29aba2b8-d986-4a26-bfd9-0816e2d4261a-cnibin\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054493    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-sysctl-d\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054522    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-sysctl-conf\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-cnibin\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29aba2b8-d986-4a26-bfd9-0816e2d4261a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054602    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-etc-kubernetes\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054651    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-var-lib-kubelet\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d608634a-23fb-4740-9ed5-f0e9358acd09-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-modprobe-d\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.054775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0628e16c-8aaa-4392-a640-946a3a9cfa3a-host-var-lib-kubelet\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.055083    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fce03b0-6f05-4349-9b98-a5598a3ccf49-tmp-dir\") pod \"node-resolver-67gs2\" (UID: \"0fce03b0-6f05-4349-9b98-a5598a3ccf49\") " pod="openshift-dns/node-resolver-67gs2"
Sep 10 14:19:16.056214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.055301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/779b1fd9-b06e-47fd-8868-ca5641bb13f5-iptables-alerter-script\") pod \"iptables-alerter-2f8wj\" (UID: \"779b1fd9-b06e-47fd-8868-ca5641bb13f5\") " pod="openshift-network-operator/iptables-alerter-2f8wj"
Sep 10 14:19:16.056941 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.056093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-etc-tuned\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.056941 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.056526    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-tmp\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.057963 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.057935    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/192fda0e-5194-4acb-b418-b9438ce1c6d4-agent-certs\") pod \"konnectivity-agent-xtcfw\" (UID: \"192fda0e-5194-4acb-b418-b9438ce1c6d4\") " pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:16.064311 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.064069    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpqd2\" (UniqueName: \"kubernetes.io/projected/d608634a-23fb-4740-9ed5-f0e9358acd09-kube-api-access-gpqd2\") pod \"aws-ebs-csi-driver-node-fpbjc\" (UID: \"d608634a-23fb-4740-9ed5-f0e9358acd09\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.064449 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.064423    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fd5s\" (UniqueName: \"kubernetes.io/projected/29aba2b8-d986-4a26-bfd9-0816e2d4261a-kube-api-access-7fd5s\") pod \"multus-additional-cni-plugins-sd44h\" (UID: \"29aba2b8-d986-4a26-bfd9-0816e2d4261a\") " pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.064518 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.064492    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf7k8\" (UniqueName: \"kubernetes.io/projected/779b1fd9-b06e-47fd-8868-ca5641bb13f5-kube-api-access-zf7k8\") pod \"iptables-alerter-2f8wj\" (UID: \"779b1fd9-b06e-47fd-8868-ca5641bb13f5\") " pod="openshift-network-operator/iptables-alerter-2f8wj"
Sep 10 14:19:16.065477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.065453    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdd5p\" (UniqueName: \"kubernetes.io/projected/0a27b97b-8f74-4ac5-a1fb-cdf04c00211c-kube-api-access-jdd5p\") pod \"tuned-trpqt\" (UID: \"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c\") " pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.066564 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.066538    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx2gw\" (UniqueName: \"kubernetes.io/projected/0628e16c-8aaa-4392-a640-946a3a9cfa3a-kube-api-access-kx2gw\") pod \"multus-7dwqj\" (UID: \"0628e16c-8aaa-4392-a640-946a3a9cfa3a\") " pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.066669 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.066563    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9kxh\" (UniqueName: \"kubernetes.io/projected/0fce03b0-6f05-4349-9b98-a5598a3ccf49-kube-api-access-r9kxh\") pod \"node-resolver-67gs2\" (UID: \"0fce03b0-6f05-4349-9b98-a5598a3ccf49\") " pod="openshift-dns/node-resolver-67gs2"
Sep 10 14:19:16.156421 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.156381    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:16.159417 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.159379    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7nftt"
Sep 10 14:19:16.174475 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.174450    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2f8wj"
Sep 10 14:19:16.179244 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.179217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:16.188300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.188269    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc"
Sep 10 14:19:16.194384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.194358    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-trpqt"
Sep 10 14:19:16.205264 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.205236    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-67gs2"
Sep 10 14:19:16.217313 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.217290    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7dwqj"
Sep 10 14:19:16.224593 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.224568    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sd44h"
Sep 10 14:19:16.456438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.456348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:16.456576 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:16.456509    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:16.456576 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:16.456575    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs podName:cf0343b6-f96b-4aa5-8b81-31a1c4183142 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:17.456559829 +0000 UTC m=+4.048764578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs") pod "network-metrics-daemon-fdw6t" (UID: "cf0343b6-f96b-4aa5-8b81-31a1c4183142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:16.557371 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.557335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gdq\" (UniqueName: \"kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq\") pod \"network-check-target-hdns2\" (UID: \"228c052c-a318-4137-b48b-e57e30b41de9\") " pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:16.557371 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.557381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:16.557600 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:16.557503    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:16.557600 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:16.557523    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:16.557600 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:16.557552    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:16.557600 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:16.557563    2579 projected.go:196] Error preparing data for projected volume kube-api-access-r7gdq for pod openshift-network-diagnostics/network-check-target-hdns2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:16.557600 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:16.557581    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret podName:1b37115a-c43a-48ef-a1dc-165c5db50d22 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:17.557561877 +0000 UTC m=+4.149766625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret") pod "global-pull-secret-syncer-6mxcc" (UID: "1b37115a-c43a-48ef-a1dc-165c5db50d22") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:16.557797 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:16.557611    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq podName:228c052c-a318-4137-b48b-e57e30b41de9 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:17.55759643 +0000 UTC m=+4.149801183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7gdq" (UniqueName: "kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq") pod "network-check-target-hdns2" (UID: "228c052c-a318-4137-b48b-e57e30b41de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:16.649540 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.648632    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 14:19:16.889515 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.889392    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 14:14:16 +0000 UTC" deadline="2028-02-14 17:48:59.043498132 +0000 UTC"
Sep 10 14:19:16.889515 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:16.889457    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12531h29m42.154044916s"
Sep 10 14:19:17.233977 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:17.233948    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fce03b0_6f05_4349_9b98_a5598a3ccf49.slice/crio-19210c73fd5883fb3e5f7db406dbf0acb313c9ffcffe95288d3c1855088d66ee WatchSource:0}: Error finding container 19210c73fd5883fb3e5f7db406dbf0acb313c9ffcffe95288d3c1855088d66ee: Status 404 returned error can't find the container with id 19210c73fd5883fb3e5f7db406dbf0acb313c9ffcffe95288d3c1855088d66ee
Sep 10 14:19:17.235709 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:17.235647    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod779b1fd9_b06e_47fd_8868_ca5641bb13f5.slice/crio-d7268869bd127a79ba53c3ca3d5539cc3a6c922e57e87590b8d5e4c9634f214b WatchSource:0}: Error finding container d7268869bd127a79ba53c3ca3d5539cc3a6c922e57e87590b8d5e4c9634f214b: Status 404 returned error can't find the container with id d7268869bd127a79ba53c3ca3d5539cc3a6c922e57e87590b8d5e4c9634f214b
Sep 10 14:19:17.237251 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:17.237229    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a27b97b_8f74_4ac5_a1fb_cdf04c00211c.slice/crio-047c173e3b95b6c9d53ee23f58f49af1d39c77184cba7610e807d9e49012088c WatchSource:0}: Error finding container 047c173e3b95b6c9d53ee23f58f49af1d39c77184cba7610e807d9e49012088c: Status 404 returned error can't find the container with id 047c173e3b95b6c9d53ee23f58f49af1d39c77184cba7610e807d9e49012088c
Sep 10 14:19:17.242292 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:17.242267    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce90b427_583b_43b5_8c33_f8c4be7b7674.slice/crio-462ea9d87dc7d58f4b52a4f3d351117a25c101141c749cff4a4c52f414343ef6 WatchSource:0}: Error finding container 462ea9d87dc7d58f4b52a4f3d351117a25c101141c749cff4a4c52f414343ef6: Status 404 returned error can't find the container with id 462ea9d87dc7d58f4b52a4f3d351117a25c101141c749cff4a4c52f414343ef6
Sep 10 14:19:17.243316 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:17.243288    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782ecfa1_a54e_4937_8e35_0af8b48c5706.slice/crio-13e27f2096c9ec134672eb3b35c4562ac5f2cac0a3704eb9466bda153640262b WatchSource:0}: Error finding container 13e27f2096c9ec134672eb3b35c4562ac5f2cac0a3704eb9466bda153640262b: Status 404 returned error can't find the container with id 13e27f2096c9ec134672eb3b35c4562ac5f2cac0a3704eb9466bda153640262b
Sep 10 14:19:17.244463 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:17.244445    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0628e16c_8aaa_4392_a640_946a3a9cfa3a.slice/crio-48370491aef7298cac8a7aabba89596be3e2e4b96d4d93fd1fcfa37714aa6046 WatchSource:0}: Error finding container 48370491aef7298cac8a7aabba89596be3e2e4b96d4d93fd1fcfa37714aa6046: Status 404 returned error can't find the container with id 48370491aef7298cac8a7aabba89596be3e2e4b96d4d93fd1fcfa37714aa6046
Sep 10 14:19:17.466151 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.466113    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:17.466316 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:17.466281    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:17.466368 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:17.466357    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs podName:cf0343b6-f96b-4aa5-8b81-31a1c4183142 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:19.466340584 +0000 UTC m=+6.058545348 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs") pod "network-metrics-daemon-fdw6t" (UID: "cf0343b6-f96b-4aa5-8b81-31a1c4183142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:17.567123 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.567087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gdq\" (UniqueName: \"kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq\") pod \"network-check-target-hdns2\" (UID: \"228c052c-a318-4137-b48b-e57e30b41de9\") " pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:17.567289 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.567141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:17.567289 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:17.567270    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:17.567289 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:17.567272    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:17.567457 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:17.567300    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:17.567457 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:17.567311    2579 projected.go:196] Error preparing data for projected volume kube-api-access-r7gdq for pod openshift-network-diagnostics/network-check-target-hdns2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:17.567457 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:17.567344    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret podName:1b37115a-c43a-48ef-a1dc-165c5db50d22 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:19.56732236 +0000 UTC m=+6.159527130 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret") pod "global-pull-secret-syncer-6mxcc" (UID: "1b37115a-c43a-48ef-a1dc-165c5db50d22") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:17.567457 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:17.567365    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq podName:228c052c-a318-4137-b48b-e57e30b41de9 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:19.5673551 +0000 UTC m=+6.159559854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7gdq" (UniqueName: "kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq") pod "network-check-target-hdns2" (UID: "228c052c-a318-4137-b48b-e57e30b41de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:17.890562 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.890460    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 14:14:16 +0000 UTC" deadline="2028-06-16 00:51:19.145488088 +0000 UTC"
Sep 10 14:19:17.890562 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.890508    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15466h32m1.254984945s"
Sep 10 14:19:17.906972 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.906942    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:17.907140 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:17.907083    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:17.907529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.907504    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:17.907657 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:17.907613    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:17.907762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.907748    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:17.907839 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:17.907827    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:17.924296 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.924261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" event={"ID":"8ff62f84e60801540483596fbfafdb74","Type":"ContainerStarted","Data":"ab95a3d97b42d175a791b66c73222e9c23047d511fbe44c1a7b645064433f1c9"}
Sep 10 14:19:17.927063 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.927029    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xtcfw" event={"ID":"192fda0e-5194-4acb-b418-b9438ce1c6d4","Type":"ContainerStarted","Data":"4ca4564e863cf792671081befd58fefae5715e98adb8b7156f7d180a904d14e5"}
Sep 10 14:19:17.929403 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.929375    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sd44h" event={"ID":"29aba2b8-d986-4a26-bfd9-0816e2d4261a","Type":"ContainerStarted","Data":"30b5f34eed4daa32830b09d35153c76776d4caef59d2e044c109ed66b946d8e0"}
Sep 10 14:19:17.931198 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.931168    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2f8wj" event={"ID":"779b1fd9-b06e-47fd-8868-ca5641bb13f5","Type":"ContainerStarted","Data":"d7268869bd127a79ba53c3ca3d5539cc3a6c922e57e87590b8d5e4c9634f214b"}
Sep 10 14:19:17.932978 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.932951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-67gs2" event={"ID":"0fce03b0-6f05-4349-9b98-a5598a3ccf49","Type":"ContainerStarted","Data":"19210c73fd5883fb3e5f7db406dbf0acb313c9ffcffe95288d3c1855088d66ee"}
Sep 10 14:19:17.935188 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.935163    2579 generic.go:356] "Generic (PLEG): container finished" podID="9131ddd5d479ecade63813301f006514" containerID="742e172ae4004396ae145853a0f97649b79a392905daefe0d48e2f9a5b4979ed" exitCode=0
Sep 10 14:19:17.935276 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.935249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"9131ddd5d479ecade63813301f006514","Type":"ContainerDied","Data":"742e172ae4004396ae145853a0f97649b79a392905daefe0d48e2f9a5b4979ed"}
Sep 10 14:19:17.938618 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.938590    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7nftt" event={"ID":"782ecfa1-a54e-4937-8e35-0af8b48c5706","Type":"ContainerStarted","Data":"13e27f2096c9ec134672eb3b35c4562ac5f2cac0a3704eb9466bda153640262b"}
Sep 10 14:19:17.940405 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.940356    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-234.ec2.internal" podStartSLOduration=2.940338816 podStartE2EDuration="2.940338816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:17.940275255 +0000 UTC m=+4.532480028" watchObservedRunningTime="2026-09-10 14:19:17.940338816 +0000 UTC m=+4.532543584"
Sep 10 14:19:17.941074 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.941050    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc" event={"ID":"d608634a-23fb-4740-9ed5-f0e9358acd09","Type":"ContainerStarted","Data":"8513b7bc80fdc4fc6052d01a2c781425c3b7189d967e4588025f2a3f7c83cb23"}
Sep 10 14:19:17.942559 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.942534    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7dwqj" event={"ID":"0628e16c-8aaa-4392-a640-946a3a9cfa3a","Type":"ContainerStarted","Data":"48370491aef7298cac8a7aabba89596be3e2e4b96d4d93fd1fcfa37714aa6046"}
Sep 10 14:19:17.945139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.945113    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4" event={"ID":"ce90b427-583b-43b5-8c33-f8c4be7b7674","Type":"ContainerStarted","Data":"462ea9d87dc7d58f4b52a4f3d351117a25c101141c749cff4a4c52f414343ef6"}
Sep 10 14:19:17.947055 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:17.947031    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trpqt" event={"ID":"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c","Type":"ContainerStarted","Data":"047c173e3b95b6c9d53ee23f58f49af1d39c77184cba7610e807d9e49012088c"}
Sep 10 14:19:18.967995 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:18.967688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" event={"ID":"9131ddd5d479ecade63813301f006514","Type":"ContainerStarted","Data":"0270e141ee60bdaf162f8df7659e6621b36556e162a6b3e56290a3371d17d830"}
Sep 10 14:19:18.984773 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:18.983716    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-234.ec2.internal" podStartSLOduration=3.983695254 podStartE2EDuration="3.983695254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:18.98342659 +0000 UTC m=+5.575631363" watchObservedRunningTime="2026-09-10 14:19:18.983695254 +0000 UTC m=+5.575900046"
Sep 10 14:19:19.488722 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:19.488672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:19.488942 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:19.488921    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:19.489026 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:19.488998    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs podName:cf0343b6-f96b-4aa5-8b81-31a1c4183142 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:23.48897901 +0000 UTC m=+10.081183780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs") pod "network-metrics-daemon-fdw6t" (UID: "cf0343b6-f96b-4aa5-8b81-31a1c4183142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:19.589911 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:19.589867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gdq\" (UniqueName: \"kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq\") pod \"network-check-target-hdns2\" (UID: \"228c052c-a318-4137-b48b-e57e30b41de9\") " pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:19.590110 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:19.589939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:19.590190 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:19.590135    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:19.590244 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:19.590205    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret podName:1b37115a-c43a-48ef-a1dc-165c5db50d22 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:23.590185645 +0000 UTC m=+10.182390418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret") pod "global-pull-secret-syncer-6mxcc" (UID: "1b37115a-c43a-48ef-a1dc-165c5db50d22") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:19.590322 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:19.590306    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:19.590384 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:19.590332    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:19.590384 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:19.590347    2579 projected.go:196] Error preparing data for projected volume kube-api-access-r7gdq for pod openshift-network-diagnostics/network-check-target-hdns2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:19.590483 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:19.590389    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq podName:228c052c-a318-4137-b48b-e57e30b41de9 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:23.590376643 +0000 UTC m=+10.182581396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7gdq" (UniqueName: "kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq") pod "network-check-target-hdns2" (UID: "228c052c-a318-4137-b48b-e57e30b41de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:19.907302 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:19.906388    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:19.907302 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:19.906548    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:19.907302 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:19.906641    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:19.907302 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:19.906737    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:19.907302 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:19.906795    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:19.907302 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:19.906887    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:21.907748 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:21.907717    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:21.908266 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:21.907839    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:21.908266 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:21.907933    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:21.908266 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:21.908018    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:21.908266 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:21.908068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:21.908266 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:21.908140    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:23.527976 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:23.527927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:23.528393 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:23.528105    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:23.528393 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:23.528175    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs podName:cf0343b6-f96b-4aa5-8b81-31a1c4183142 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:31.528156248 +0000 UTC m=+18.120361015 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs") pod "network-metrics-daemon-fdw6t" (UID: "cf0343b6-f96b-4aa5-8b81-31a1c4183142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:23.628917 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:23.628870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gdq\" (UniqueName: \"kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq\") pod \"network-check-target-hdns2\" (UID: \"228c052c-a318-4137-b48b-e57e30b41de9\") " pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:23.629089 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:23.628942    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:23.629158 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:23.629108    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:23.629219 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:23.629177    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret podName:1b37115a-c43a-48ef-a1dc-165c5db50d22 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:31.629156692 +0000 UTC m=+18.221361461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret") pod "global-pull-secret-syncer-6mxcc" (UID: "1b37115a-c43a-48ef-a1dc-165c5db50d22") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:23.629729 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:23.629592    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:23.629729 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:23.629619    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:23.629729 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:23.629631    2579 projected.go:196] Error preparing data for projected volume kube-api-access-r7gdq for pod openshift-network-diagnostics/network-check-target-hdns2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:23.629729 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:23.629667    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq podName:228c052c-a318-4137-b48b-e57e30b41de9 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:31.629655919 +0000 UTC m=+18.221860668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7gdq" (UniqueName: "kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq") pod "network-check-target-hdns2" (UID: "228c052c-a318-4137-b48b-e57e30b41de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:23.907102 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:23.907009    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:23.907263 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:23.907139    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:23.907548 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:23.907528    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:23.907641 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:23.907612    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:23.907705 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:23.907668    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:23.907755 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:23.907730    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:25.906242 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:25.906206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:25.906242 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:25.906244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:25.906790 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:25.906206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:25.906790 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:25.906361    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:25.906790 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:25.906481    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:25.906790 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:25.906591    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:27.906055 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:27.906017    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:27.906459 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:27.906170    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:27.906561 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:27.906545    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:27.906655 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:27.906638    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:27.906700 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:27.906690    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:27.906764 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:27.906748    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:29.906214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:29.906173    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:29.906689 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:29.906173    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:29.906689 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:29.906315    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:29.906689 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:29.906377    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:29.906689 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:29.906184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:29.906689 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:29.906465    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:31.591868 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:31.591821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:31.592318 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:31.591994    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:31.592318 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:31.592066    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs podName:cf0343b6-f96b-4aa5-8b81-31a1c4183142 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:47.592050336 +0000 UTC m=+34.184255085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs") pod "network-metrics-daemon-fdw6t" (UID: "cf0343b6-f96b-4aa5-8b81-31a1c4183142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:31.692890 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:31.692856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:31.693046 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:31.692953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gdq\" (UniqueName: \"kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq\") pod \"network-check-target-hdns2\" (UID: \"228c052c-a318-4137-b48b-e57e30b41de9\") " pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:31.693046 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:31.693014    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:31.693046 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:31.693042    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:31.693177 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:31.693054    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:31.693177 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:31.693064    2579 projected.go:196] Error preparing data for projected volume kube-api-access-r7gdq for pod openshift-network-diagnostics/network-check-target-hdns2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:31.693177 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:31.693084    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret podName:1b37115a-c43a-48ef-a1dc-165c5db50d22 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:47.693067895 +0000 UTC m=+34.285272647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret") pod "global-pull-secret-syncer-6mxcc" (UID: "1b37115a-c43a-48ef-a1dc-165c5db50d22") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:31.693177 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:31.693101    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq podName:228c052c-a318-4137-b48b-e57e30b41de9 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:47.693091242 +0000 UTC m=+34.285295988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7gdq" (UniqueName: "kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq") pod "network-check-target-hdns2" (UID: "228c052c-a318-4137-b48b-e57e30b41de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:31.906119 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:31.906037    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:31.906119 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:31.906085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:31.906326 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:31.906038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:31.906326 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:31.906165    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:31.906326 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:31.906245    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:31.906460 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:31.906346    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:33.907462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:33.907425    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:33.907955 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:33.907551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:33.907955 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:33.907571    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:33.907955 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:33.907655    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:33.907955 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:33.907550    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:33.907955 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:33.907741    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:35.906148 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:35.906117    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:35.906534 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:35.906119    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:35.906534 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:35.906248    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:35.906534 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:35.906283    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:35.906534 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:35.906358    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:35.906534 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:35.906455    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:37.010766 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.010724    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7nftt" event={"ID":"782ecfa1-a54e-4937-8e35-0af8b48c5706","Type":"ContainerStarted","Data":"30f2930e5352ddc1a0b519964b5ad263b8b74ec5a97d29563bf5bb15251548a0"}
Sep 10 14:19:37.013618 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.013401    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc" event={"ID":"d608634a-23fb-4740-9ed5-f0e9358acd09","Type":"ContainerStarted","Data":"1526a161c6bfa19df21a3332226db4d0b7827369512ffca6639f28e75388e745"}
Sep 10 14:19:37.015619 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.015581    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7dwqj" event={"ID":"0628e16c-8aaa-4392-a640-946a3a9cfa3a","Type":"ContainerStarted","Data":"c8e7eddc4e359545d2cea6e9b86da23f972e6fc00e07e79fd0bfb0a0e68cff00"}
Sep 10 14:19:37.019417 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.019394    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:19:37.019827 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.019803    2579 generic.go:356] "Generic (PLEG): container finished" podID="ce90b427-583b-43b5-8c33-f8c4be7b7674" containerID="e09ab9dc556dcd4e34a2b6f8021ece745ad1051e26e23c0c082ceb58f05002e3" exitCode=1
Sep 10 14:19:37.019987 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.019879    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4" event={"ID":"ce90b427-583b-43b5-8c33-f8c4be7b7674","Type":"ContainerStarted","Data":"79b849587e416b28d632b1690c339697f687dc496fed20a297f818e4ab4177d6"}
Sep 10 14:19:37.019987 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.019948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4" event={"ID":"ce90b427-583b-43b5-8c33-f8c4be7b7674","Type":"ContainerStarted","Data":"add835ddb5d8facdbd9f4bd4da6111a8160789a4cf1c2064a2af3c2a4f18f8fa"}
Sep 10 14:19:37.020113 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.019993    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4" event={"ID":"ce90b427-583b-43b5-8c33-f8c4be7b7674","Type":"ContainerStarted","Data":"9c5cd566f4b9f28d9f5adaa3e42383e043bb48ad4b25e8bc0c0963c7fca13af7"}
Sep 10 14:19:37.020113 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.020035    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4" event={"ID":"ce90b427-583b-43b5-8c33-f8c4be7b7674","Type":"ContainerStarted","Data":"c691ba5e92672f527e1ff3f4465a480be2874838f27f48de82662cff95897b5e"}
Sep 10 14:19:37.020113 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.020082    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4" event={"ID":"ce90b427-583b-43b5-8c33-f8c4be7b7674","Type":"ContainerDied","Data":"e09ab9dc556dcd4e34a2b6f8021ece745ad1051e26e23c0c082ceb58f05002e3"}
Sep 10 14:19:37.020261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.020132    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4" event={"ID":"ce90b427-583b-43b5-8c33-f8c4be7b7674","Type":"ContainerStarted","Data":"14703cfc28c013c121df0b0e954c75e94f3100d852069814348cac0f3cfaffba"}
Sep 10 14:19:37.021525 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.021496    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-trpqt" event={"ID":"0a27b97b-8f74-4ac5-a1fb-cdf04c00211c","Type":"ContainerStarted","Data":"0a27c2dcf64c0aa0bd2ae500fb429f67fe5261455bfd288fd422f4a953562625"}
Sep 10 14:19:37.023086 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.023066    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xtcfw" event={"ID":"192fda0e-5194-4acb-b418-b9438ce1c6d4","Type":"ContainerStarted","Data":"6ac5532689f9626c024d74e68271261bde3384364e56c4a0c6c6a63277fc18cb"}
Sep 10 14:19:37.024935 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.024908    2579 generic.go:356] "Generic (PLEG): container finished" podID="29aba2b8-d986-4a26-bfd9-0816e2d4261a" containerID="192bbddff26aeb0eb6d1d8d7638a2c7446f96db81da83b97ad4ca4ff2900debb" exitCode=0
Sep 10 14:19:37.025027 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.024941    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sd44h" event={"ID":"29aba2b8-d986-4a26-bfd9-0816e2d4261a","Type":"ContainerDied","Data":"192bbddff26aeb0eb6d1d8d7638a2c7446f96db81da83b97ad4ca4ff2900debb"}
Sep 10 14:19:37.026633 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.026608    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-67gs2" event={"ID":"0fce03b0-6f05-4349-9b98-a5598a3ccf49","Type":"ContainerStarted","Data":"5c357452277b65a8b66827f80b4f85a0fbc0e2c23cee3a79092042660bb97dc1"}
Sep 10 14:19:37.029068 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.029031    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7nftt" podStartSLOduration=3.382148124 podStartE2EDuration="22.029017426s" totalImagesPullingTime="18.646869302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:37.028577625 +0000 UTC m=+23.620782395" watchObservedRunningTime="2026-09-10 14:19:37.029017426 +0000 UTC m=+23.621222195"
Sep 10 14:19:37.045773 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.045716    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-67gs2" podStartSLOduration=3.401310659 podStartE2EDuration="22.045700964s" totalImagesPullingTime="18.644390305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:37.045017099 +0000 UTC m=+23.637221872" watchObservedRunningTime="2026-09-10 14:19:37.045700964 +0000 UTC m=+23.637905732"
Sep 10 14:19:37.091636 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.091583    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xtcfw" podStartSLOduration=3.466978254 podStartE2EDuration="22.091564343s" totalImagesPullingTime="18.624586089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:37.091421974 +0000 UTC m=+23.683626772" watchObservedRunningTime="2026-09-10 14:19:37.091564343 +0000 UTC m=+23.683769113"
Sep 10 14:19:37.133805 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.133729    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-trpqt" podStartSLOduration=3.460120208 podStartE2EDuration="22.133708719s" totalImagesPullingTime="18.673588511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:37.112196628 +0000 UTC m=+23.704401409" watchObservedRunningTime="2026-09-10 14:19:37.133708719 +0000 UTC m=+23.725913488"
Sep 10 14:19:37.133985 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.133898    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7dwqj" podStartSLOduration=3.419912693 podStartE2EDuration="22.133891563s" totalImagesPullingTime="18.71397887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:37.133575898 +0000 UTC m=+23.725780669" watchObservedRunningTime="2026-09-10 14:19:37.133891563 +0000 UTC m=+23.726096369"
Sep 10 14:19:37.655547 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.655518    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 14:19:37.902859 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.902708    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T14:19:37.655542535Z","UUID":"b138a7cf-b755-45ba-9166-55b9976d570f","Handler":null,"Name":"","Endpoint":""}
Sep 10 14:19:37.904123 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.904106    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 14:19:37.904202 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.904133    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 14:19:37.906225 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.906201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:37.906225 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.906219    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:37.906367 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:37.906204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:37.906367 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:37.906326    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:37.906451 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:37.906383    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:37.906493 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:37.906470    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:38.031092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:38.031055    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc" event={"ID":"d608634a-23fb-4740-9ed5-f0e9358acd09","Type":"ContainerStarted","Data":"9cd451aec2b2c477a361f148646a394c03aa38eca96f4d3d751aaac9371cdc50"}
Sep 10 14:19:38.032601 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:38.032573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2f8wj" event={"ID":"779b1fd9-b06e-47fd-8868-ca5641bb13f5","Type":"ContainerStarted","Data":"c76e771a8eca716500481344d451a6b06ed561e0aed51865e8c37528a53fc163"}
Sep 10 14:19:38.057623 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:38.057558    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2f8wj" podStartSLOduration=4.381534637 podStartE2EDuration="23.057534984s" totalImagesPullingTime="18.676000347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:38.056746634 +0000 UTC m=+24.648951404" watchObservedRunningTime="2026-09-10 14:19:38.057534984 +0000 UTC m=+24.649739754"
Sep 10 14:19:39.038402 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:39.038360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc" event={"ID":"d608634a-23fb-4740-9ed5-f0e9358acd09","Type":"ContainerStarted","Data":"1b6b975bfd7686a53613dcc4826e7919274ee842632eb04942511a3b3be9c39c"}
Sep 10 14:19:39.042114 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:39.042089    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:19:39.042826 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:39.042795    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4" event={"ID":"ce90b427-583b-43b5-8c33-f8c4be7b7674","Type":"ContainerStarted","Data":"84bcadeaa4e0f751949cf4c107399f4ad5e3cd16ea80580fefc900b3f854eb75"}
Sep 10 14:19:39.058512 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:39.058454    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpbjc" podStartSLOduration=3.040328982 podStartE2EDuration="24.058437954s" totalImagesPullingTime="21.018108972s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:39.057986158 +0000 UTC m=+25.650190927" watchObservedRunningTime="2026-09-10 14:19:39.058437954 +0000 UTC m=+25.650642723"
Sep 10 14:19:39.906365 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:39.906332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:39.906529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:39.906332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:39.906529 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:39.906474    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:39.906650 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:39.906332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:39.906650 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:39.906543    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:39.906650 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:39.906611    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:41.610210 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:41.610170    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:41.610926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:41.610907    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:41.905679 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:41.905597    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:41.905679 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:41.905629    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:41.905679 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:41.905644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:41.905930 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:41.905734    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:41.905930 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:41.905890    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:41.906004 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:41.905980    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:42.050161 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:42.049937    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:42.050595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:42.050558    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xtcfw"
Sep 10 14:19:43.053649 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:43.053605    2579 generic.go:356] "Generic (PLEG): container finished" podID="29aba2b8-d986-4a26-bfd9-0816e2d4261a" containerID="e8de1e3489cb99779e7b926141bb5f4d58a0e68ee91efc9f1149ac27abde6dee" exitCode=0
Sep 10 14:19:43.054555 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:43.053713    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sd44h" event={"ID":"29aba2b8-d986-4a26-bfd9-0816e2d4261a","Type":"ContainerDied","Data":"e8de1e3489cb99779e7b926141bb5f4d58a0e68ee91efc9f1149ac27abde6dee"}
Sep 10 14:19:43.057913 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:43.057894    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:19:43.058401 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:43.058375    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4" event={"ID":"ce90b427-583b-43b5-8c33-f8c4be7b7674","Type":"ContainerStarted","Data":"f46e7083f87f657281e31e6d1ae64106c4f891b198bd0c893084e1bb2a7887d6"}
Sep 10 14:19:43.058740 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:43.058716    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:43.058955 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:43.058933    2579 scope.go:117] "RemoveContainer" containerID="e09ab9dc556dcd4e34a2b6f8021ece745ad1051e26e23c0c082ceb58f05002e3"
Sep 10 14:19:43.076261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:43.076239    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:43.906624 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:43.906441    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:43.906724 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:43.906505    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:43.906772 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:43.906728    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:43.906860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:43.906539    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:43.906860 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:43.906809    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:43.906860 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:43.906856    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:44.063055 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.063019    2579 generic.go:356] "Generic (PLEG): container finished" podID="29aba2b8-d986-4a26-bfd9-0816e2d4261a" containerID="5f1ff3ea3db326794e66dde2421a97387cfda2b3f027c13923428cb98047c123" exitCode=0
Sep 10 14:19:44.063442 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.063104    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sd44h" event={"ID":"29aba2b8-d986-4a26-bfd9-0816e2d4261a","Type":"ContainerDied","Data":"5f1ff3ea3db326794e66dde2421a97387cfda2b3f027c13923428cb98047c123"}
Sep 10 14:19:44.067279 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.067258    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:19:44.067612 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.067587    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4" event={"ID":"ce90b427-583b-43b5-8c33-f8c4be7b7674","Type":"ContainerStarted","Data":"8e213b55046045f1427ee0c5820b3075fd6a63a03a9e9d262ce25e5f96c611ec"}
Sep 10 14:19:44.067761 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.067744    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:44.067923 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.067906    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:44.083694 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.083671    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:19:44.107824 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.107748    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4" podStartSLOduration=10.419543645 podStartE2EDuration="29.107733189s" totalImagesPullingTime="18.688189544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:44.106546554 +0000 UTC m=+30.698751323" watchObservedRunningTime="2026-09-10 14:19:44.107733189 +0000 UTC m=+30.699937958"
Sep 10 14:19:44.212846 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.212731    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6mxcc"]
Sep 10 14:19:44.212985 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.212875    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:44.213025 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:44.212992    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:44.216107 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.216083    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hdns2"]
Sep 10 14:19:44.216281 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.216177    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:44.216339 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:44.216285    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:44.216770 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.216748    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdw6t"]
Sep 10 14:19:44.216885 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:44.216868    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:44.216997 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:44.216980    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:45.072534 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:45.072483    2579 generic.go:356] "Generic (PLEG): container finished" podID="29aba2b8-d986-4a26-bfd9-0816e2d4261a" containerID="ac31a07b77631218f72a674c8f30b35007f487f33aa0b0eb286495b1b0df7bfa" exitCode=0
Sep 10 14:19:45.072994 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:45.072527    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sd44h" event={"ID":"29aba2b8-d986-4a26-bfd9-0816e2d4261a","Type":"ContainerDied","Data":"ac31a07b77631218f72a674c8f30b35007f487f33aa0b0eb286495b1b0df7bfa"}
Sep 10 14:19:45.905545 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:45.905511    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:45.905735 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:45.905511    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:45.905735 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:45.905511    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:45.905735 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:45.905710    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:45.905908 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:45.905646    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:45.905908 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:45.905776    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:47.609247 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:47.609208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:47.609804 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:47.609334    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:47.609804 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:47.609396    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs podName:cf0343b6-f96b-4aa5-8b81-31a1c4183142 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:19.609379825 +0000 UTC m=+66.201584587 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs") pod "network-metrics-daemon-fdw6t" (UID: "cf0343b6-f96b-4aa5-8b81-31a1c4183142") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 14:19:47.710500 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:47.710462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gdq\" (UniqueName: \"kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq\") pod \"network-check-target-hdns2\" (UID: \"228c052c-a318-4137-b48b-e57e30b41de9\") " pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:47.710699 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:47.710518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:47.710699 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:47.710646    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:47.710699 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:47.710649    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 14:19:47.710699 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:47.710676    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 14:19:47.710699 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:47.710686    2579 projected.go:196] Error preparing data for projected volume kube-api-access-r7gdq for pod openshift-network-diagnostics/network-check-target-hdns2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:47.710989 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:47.710717    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret podName:1b37115a-c43a-48ef-a1dc-165c5db50d22 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:19.710698432 +0000 UTC m=+66.302903196 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret") pod "global-pull-secret-syncer-6mxcc" (UID: "1b37115a-c43a-48ef-a1dc-165c5db50d22") : object "kube-system"/"original-pull-secret" not registered
Sep 10 14:19:47.710989 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:47.710737    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq podName:228c052c-a318-4137-b48b-e57e30b41de9 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:19.710724641 +0000 UTC m=+66.302929387 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r7gdq" (UniqueName: "kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq") pod "network-check-target-hdns2" (UID: "228c052c-a318-4137-b48b-e57e30b41de9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 14:19:47.910032 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:47.909939    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:47.910032 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:47.909994    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:47.910032 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:47.910003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:47.910267 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:47.910093    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fdw6t" podUID="cf0343b6-f96b-4aa5-8b81-31a1c4183142"
Sep 10 14:19:47.910267 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:47.910179    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hdns2" podUID="228c052c-a318-4137-b48b-e57e30b41de9"
Sep 10 14:19:47.910342 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:47.910290    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mxcc" podUID="1b37115a-c43a-48ef-a1dc-165c5db50d22"
Sep 10 14:19:49.183495 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.183463    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-234.ec2.internal" event="NodeReady"
Sep 10 14:19:49.183899 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.183621    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 14:19:49.219285 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.219198    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-647f4f8798-8xdwk"]
Sep 10 14:19:49.249362 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.249332    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f5nfm"]
Sep 10 14:19:49.250291 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.250264    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.253215 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.253037    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 14:19:49.253215 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.253051    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 14:19:49.253215 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.253111    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cgxdb\""
Sep 10 14:19:49.253471 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.253457    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 14:19:49.258463 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.258440    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 14:19:49.262769 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.262727    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9w8m7"]
Sep 10 14:19:49.262908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.262875    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f5nfm"
Sep 10 14:19:49.265534 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.265513    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 14:19:49.265666 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.265590    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 14:19:49.265952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.265929    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tsxlz\""
Sep 10 14:19:49.266051 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.265955    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 14:19:49.282528 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.282500    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-647f4f8798-8xdwk"]
Sep 10 14:19:49.282679 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.282541    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f5nfm"]
Sep 10 14:19:49.282679 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.282565    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9w8m7"]
Sep 10 14:19:49.282679 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.282621    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.285507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.285479    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 14:19:49.285648 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.285509    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 14:19:49.285807 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.285765    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bskzl\""
Sep 10 14:19:49.423810 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.423756    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb89e2d9-8063-41da-a44c-7fb3ab0ae983-cert\") pod \"ingress-canary-f5nfm\" (UID: \"fb89e2d9-8063-41da-a44c-7fb3ab0ae983\") " pod="openshift-ingress-canary/ingress-canary-f5nfm"
Sep 10 14:19:49.423810 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.423814    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxd4f\" (UniqueName: \"kubernetes.io/projected/fb89e2d9-8063-41da-a44c-7fb3ab0ae983-kube-api-access-nxd4f\") pod \"ingress-canary-f5nfm\" (UID: \"fb89e2d9-8063-41da-a44c-7fb3ab0ae983\") " pod="openshift-ingress-canary/ingress-canary-f5nfm"
Sep 10 14:19:49.424056 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.423879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.424056 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.423942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-trusted-ca\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.424056 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.423995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.424056 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.424026    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-bound-sa-token\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.424217 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.424068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfz7j\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-kube-api-access-lfz7j\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.424217 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.424124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccksq\" (UniqueName: \"kubernetes.io/projected/989f9a38-9519-496d-a488-3febe9badc7a-kube-api-access-ccksq\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.424217 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.424157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-installation-pull-secrets\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.424217 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.424176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/989f9a38-9519-496d-a488-3febe9badc7a-config-volume\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.424217 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.424195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-image-registry-private-configuration\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.424421 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.424223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49c43416-4eff-4a7c-b551-17d7c6e9aa00-ca-trust-extracted\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.424421 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.424277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-certificates\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.424421 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.424332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989f9a38-9519-496d-a488-3febe9badc7a-tmp-dir\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.525452 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525415    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-certificates\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.525452 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989f9a38-9519-496d-a488-3febe9badc7a-tmp-dir\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.525749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525497    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb89e2d9-8063-41da-a44c-7fb3ab0ae983-cert\") pod \"ingress-canary-f5nfm\" (UID: \"fb89e2d9-8063-41da-a44c-7fb3ab0ae983\") " pod="openshift-ingress-canary/ingress-canary-f5nfm"
Sep 10 14:19:49.525749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxd4f\" (UniqueName: \"kubernetes.io/projected/fb89e2d9-8063-41da-a44c-7fb3ab0ae983-kube-api-access-nxd4f\") pod \"ingress-canary-f5nfm\" (UID: \"fb89e2d9-8063-41da-a44c-7fb3ab0ae983\") " pod="openshift-ingress-canary/ingress-canary-f5nfm"
Sep 10 14:19:49.525749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.525749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525593    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-trusted-ca\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.525749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.525749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-bound-sa-token\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.525749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfz7j\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-kube-api-access-lfz7j\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.525749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccksq\" (UniqueName: \"kubernetes.io/projected/989f9a38-9519-496d-a488-3febe9badc7a-kube-api-access-ccksq\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.525749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-installation-pull-secrets\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.526198 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/989f9a38-9519-496d-a488-3febe9badc7a-config-volume\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.526198 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-image-registry-private-configuration\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.526198 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49c43416-4eff-4a7c-b551-17d7c6e9aa00-ca-trust-extracted\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.526198 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.525864    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/989f9a38-9519-496d-a488-3febe9badc7a-tmp-dir\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.526198 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:49.526100    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:19:49.526198 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:49.526117    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647f4f8798-8xdwk: secret "image-registry-tls" not found
Sep 10 14:19:49.526198 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.526123    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-certificates\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.526198 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:49.526174    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls podName:49c43416-4eff-4a7c-b551-17d7c6e9aa00 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:50.026154025 +0000 UTC m=+36.618358772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls") pod "image-registry-647f4f8798-8xdwk" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00") : secret "image-registry-tls" not found
Sep 10 14:19:49.526592 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:49.526246    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:19:49.526592 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:49.526296    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls podName:989f9a38-9519-496d-a488-3febe9badc7a nodeName:}" failed. No retries permitted until 2026-09-10 14:19:50.026280413 +0000 UTC m=+36.618485177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls") pod "dns-default-9w8m7" (UID: "989f9a38-9519-496d-a488-3febe9badc7a") : secret "dns-default-metrics-tls" not found
Sep 10 14:19:49.526592 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.526343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/989f9a38-9519-496d-a488-3febe9badc7a-config-volume\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.526734 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.526659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49c43416-4eff-4a7c-b551-17d7c6e9aa00-ca-trust-extracted\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.526769 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.526751    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-trusted-ca\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.530655 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.530528    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-image-registry-private-configuration\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.530797 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.530532    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-installation-pull-secrets\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.530797 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.530575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb89e2d9-8063-41da-a44c-7fb3ab0ae983-cert\") pod \"ingress-canary-f5nfm\" (UID: \"fb89e2d9-8063-41da-a44c-7fb3ab0ae983\") " pod="openshift-ingress-canary/ingress-canary-f5nfm"
Sep 10 14:19:49.539142 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.539114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfz7j\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-kube-api-access-lfz7j\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.540175 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.540153    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxd4f\" (UniqueName: \"kubernetes.io/projected/fb89e2d9-8063-41da-a44c-7fb3ab0ae983-kube-api-access-nxd4f\") pod \"ingress-canary-f5nfm\" (UID: \"fb89e2d9-8063-41da-a44c-7fb3ab0ae983\") " pod="openshift-ingress-canary/ingress-canary-f5nfm"
Sep 10 14:19:49.540480 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.540462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-bound-sa-token\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:49.542045 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.542022    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccksq\" (UniqueName: \"kubernetes.io/projected/989f9a38-9519-496d-a488-3febe9badc7a-kube-api-access-ccksq\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:49.574090 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.574053    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f5nfm"
Sep 10 14:19:49.906249 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.906156    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:19:49.906407 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.906156    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:19:49.906407 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.906159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:19:49.909626 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.909601    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 14:19:49.909626 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.909613    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 14:19:49.909860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.909615    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c5vvv\""
Sep 10 14:19:49.911065 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.911045    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 14:19:49.911228 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.911130    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 14:19:49.911292 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:49.911271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q47dh\""
Sep 10 14:19:50.029942 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:50.029909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:50.030131 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:50.029996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:50.030131 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:50.030067    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:19:50.030131 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:50.030108    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:19:50.030131 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:50.030120    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647f4f8798-8xdwk: secret "image-registry-tls" not found
Sep 10 14:19:50.030338 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:50.030145    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls podName:989f9a38-9519-496d-a488-3febe9badc7a nodeName:}" failed. No retries permitted until 2026-09-10 14:19:51.030124544 +0000 UTC m=+37.622329317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls") pod "dns-default-9w8m7" (UID: "989f9a38-9519-496d-a488-3febe9badc7a") : secret "dns-default-metrics-tls" not found
Sep 10 14:19:50.030338 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:50.030163    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls podName:49c43416-4eff-4a7c-b551-17d7c6e9aa00 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:51.030152961 +0000 UTC m=+37.622357708 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls") pod "image-registry-647f4f8798-8xdwk" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00") : secret "image-registry-tls" not found
Sep 10 14:19:50.772833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:50.772811    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f5nfm"]
Sep 10 14:19:50.777896 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:19:50.776136    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb89e2d9_8063_41da_a44c_7fb3ab0ae983.slice/crio-3eda3ffed5a02bbccf553ae5ae44f1406a2225ec828d74c3156261b7a7ffd24e WatchSource:0}: Error finding container 3eda3ffed5a02bbccf553ae5ae44f1406a2225ec828d74c3156261b7a7ffd24e: Status 404 returned error can't find the container with id 3eda3ffed5a02bbccf553ae5ae44f1406a2225ec828d74c3156261b7a7ffd24e
Sep 10 14:19:51.036823 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:51.036766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:51.036976 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:51.036866    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:51.036976 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:51.036889    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:19:51.036976 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:51.036948    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls podName:989f9a38-9519-496d-a488-3febe9badc7a nodeName:}" failed. No retries permitted until 2026-09-10 14:19:53.036931421 +0000 UTC m=+39.629136185 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls") pod "dns-default-9w8m7" (UID: "989f9a38-9519-496d-a488-3febe9badc7a") : secret "dns-default-metrics-tls" not found
Sep 10 14:19:51.037131 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:51.036994    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:19:51.037131 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:51.037008    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647f4f8798-8xdwk: secret "image-registry-tls" not found
Sep 10 14:19:51.037131 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:51.037067    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls podName:49c43416-4eff-4a7c-b551-17d7c6e9aa00 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:53.037049823 +0000 UTC m=+39.629254593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls") pod "image-registry-647f4f8798-8xdwk" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00") : secret "image-registry-tls" not found
Sep 10 14:19:51.089403 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:51.089372    2579 generic.go:356] "Generic (PLEG): container finished" podID="29aba2b8-d986-4a26-bfd9-0816e2d4261a" containerID="0fcefb1c0131ddea4995287d0b605dc2fa2454f0256d370c2b7a48570ebe6437" exitCode=0
Sep 10 14:19:51.089658 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:51.089455    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sd44h" event={"ID":"29aba2b8-d986-4a26-bfd9-0816e2d4261a","Type":"ContainerDied","Data":"0fcefb1c0131ddea4995287d0b605dc2fa2454f0256d370c2b7a48570ebe6437"}
Sep 10 14:19:51.090657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:51.090629    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f5nfm" event={"ID":"fb89e2d9-8063-41da-a44c-7fb3ab0ae983","Type":"ContainerStarted","Data":"3eda3ffed5a02bbccf553ae5ae44f1406a2225ec828d74c3156261b7a7ffd24e"}
Sep 10 14:19:52.096492 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:52.096455    2579 generic.go:356] "Generic (PLEG): container finished" podID="29aba2b8-d986-4a26-bfd9-0816e2d4261a" containerID="2c581a59f2570eab9fbeff5a997d52ffe34abe79dbb8d551c73d037d23681f4f" exitCode=0
Sep 10 14:19:52.097174 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:52.096514    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sd44h" event={"ID":"29aba2b8-d986-4a26-bfd9-0816e2d4261a","Type":"ContainerDied","Data":"2c581a59f2570eab9fbeff5a997d52ffe34abe79dbb8d551c73d037d23681f4f"}
Sep 10 14:19:53.053866 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:53.053623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:53.054033 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:53.053833    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:19:53.054033 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:53.053998    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:19:53.054033 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:53.054011    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647f4f8798-8xdwk: secret "image-registry-tls" not found
Sep 10 14:19:53.054033 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:53.053923    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:53.054033 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:53.054022    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls podName:989f9a38-9519-496d-a488-3febe9badc7a nodeName:}" failed. No retries permitted until 2026-09-10 14:19:57.053998031 +0000 UTC m=+43.646202783 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls") pod "dns-default-9w8m7" (UID: "989f9a38-9519-496d-a488-3febe9badc7a") : secret "dns-default-metrics-tls" not found
Sep 10 14:19:53.054280 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:53.054069    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls podName:49c43416-4eff-4a7c-b551-17d7c6e9aa00 nodeName:}" failed. No retries permitted until 2026-09-10 14:19:57.054054711 +0000 UTC m=+43.646259467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls") pod "image-registry-647f4f8798-8xdwk" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00") : secret "image-registry-tls" not found
Sep 10 14:19:53.103666 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:53.103622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sd44h" event={"ID":"29aba2b8-d986-4a26-bfd9-0816e2d4261a","Type":"ContainerStarted","Data":"c39df8c8259d5f460a20ab2960a4ec61db0fd077c5d12999cf96b91e9bdacca2"}
Sep 10 14:19:53.129744 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:53.129678    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sd44h" podStartSLOduration=6.786627665 podStartE2EDuration="38.129662679s" totalImagesPullingTime="31.343035014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:53.12776316 +0000 UTC m=+39.719967950" watchObservedRunningTime="2026-09-10 14:19:53.129662679 +0000 UTC m=+39.721867448"
Sep 10 14:19:53.274283 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:53.274234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xtcfw_192fda0e-5194-4acb-b418-b9438ce1c6d4/konnectivity-agent/0.log" limit=1024
Sep 10 14:19:53.382657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:53.382609    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xtcfw_192fda0e-5194-4acb-b418-b9438ce1c6d4/konnectivity-agent/0.log" limit=1024
Sep 10 14:19:54.107437 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:54.107404    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f5nfm" event={"ID":"fb89e2d9-8063-41da-a44c-7fb3ab0ae983","Type":"ContainerStarted","Data":"17b9ac5193c652d5e9c67a4a4f1c8cb08e1b0c37d6d86728705b0506675edbeb"}
Sep 10 14:19:54.122741 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:54.122692    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f5nfm" podStartSLOduration=2.224191627 podStartE2EDuration="5.122676295s" totalImagesPullingTime="2.898484668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:19:54.122547976 +0000 UTC m=+40.714752744" watchObservedRunningTime="2026-09-10 14:19:54.122676295 +0000 UTC m=+40.714881065"
Sep 10 14:19:54.305612 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:54.305577    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xtcfw_192fda0e-5194-4acb-b418-b9438ce1c6d4/konnectivity-agent/0.log" limit=1024
Sep 10 14:19:54.406060 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:54.405968    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xtcfw_192fda0e-5194-4acb-b418-b9438ce1c6d4/konnectivity-agent/0.log" limit=1024
Sep 10 14:19:57.084659 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:57.084612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:19:57.085125 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:19:57.084679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:19:57.085125 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:57.084770    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:19:57.085125 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:57.084776    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:19:57.085125 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:57.084819    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647f4f8798-8xdwk: secret "image-registry-tls" not found
Sep 10 14:19:57.085125 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:57.084846    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls podName:989f9a38-9519-496d-a488-3febe9badc7a nodeName:}" failed. No retries permitted until 2026-09-10 14:20:05.08483326 +0000 UTC m=+51.677038020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls") pod "dns-default-9w8m7" (UID: "989f9a38-9519-496d-a488-3febe9badc7a") : secret "dns-default-metrics-tls" not found
Sep 10 14:19:57.085125 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:19:57.084865    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls podName:49c43416-4eff-4a7c-b551-17d7c6e9aa00 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:05.084852965 +0000 UTC m=+51.677057712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls") pod "image-registry-647f4f8798-8xdwk" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00") : secret "image-registry-tls" not found
Sep 10 14:20:00.195424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:00.195389    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xtcfw_192fda0e-5194-4acb-b418-b9438ce1c6d4/konnectivity-agent/0.log" limit=1024
Sep 10 14:20:00.246876 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:00.246841    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-xtcfw_192fda0e-5194-4acb-b418-b9438ce1c6d4/konnectivity-agent/0.log" limit=1024
Sep 10 14:20:05.146189 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:05.146147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:20:05.146584 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:05.146237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:20:05.146584 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:05.146340    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:20:05.146584 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:05.146339    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:20:05.146584 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:05.146362    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647f4f8798-8xdwk: secret "image-registry-tls" not found
Sep 10 14:20:05.146584 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:05.146432    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls podName:49c43416-4eff-4a7c-b551-17d7c6e9aa00 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:21.146411225 +0000 UTC m=+67.738615972 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls") pod "image-registry-647f4f8798-8xdwk" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00") : secret "image-registry-tls" not found
Sep 10 14:20:05.146584 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:05.146445    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls podName:989f9a38-9519-496d-a488-3febe9badc7a nodeName:}" failed. No retries permitted until 2026-09-10 14:20:21.146439537 +0000 UTC m=+67.738644284 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls") pod "dns-default-9w8m7" (UID: "989f9a38-9519-496d-a488-3febe9badc7a") : secret "dns-default-metrics-tls" not found
Sep 10 14:20:13.700627 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.700564    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pgtlm"]
Sep 10 14:20:13.702356 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.702338    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"]
Sep 10 14:20:13.702497 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.702478    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pgtlm"
Sep 10 14:20:13.704371 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.704350    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"]
Sep 10 14:20:13.704495 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.704479    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"
Sep 10 14:20:13.705368 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.705347    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.705471 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.705346    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xzr5w\""
Sep 10 14:20:13.705471 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.705351    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.706193 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.706179    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-z58wp"]
Sep 10 14:20:13.706292 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.706280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:13.706982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.706968    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 10 14:20:13.707508 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.707481    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.707585 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.707555    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 10 14:20:13.707637 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.707584    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jmxdz\""
Sep 10 14:20:13.707637 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.707560    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.707936 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.707919    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.708843 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.708826    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.710604 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.710584    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bkwj6\""
Sep 10 14:20:13.710694 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.710586    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 14:20:13.710694 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.710619    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.710694 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.710630    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 14:20:13.711325 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.711309    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 14:20:13.712115 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.712094    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.712197 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.712151    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pbp7v\""
Sep 10 14:20:13.712968 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.712950    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.713055 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.712950    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 14:20:13.717681 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.717657    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 14:20:13.718892 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.718868    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pgtlm"]
Sep 10 14:20:13.719991 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.719971    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"]
Sep 10 14:20:13.729676 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.729652    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-z58wp"]
Sep 10 14:20:13.731049 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.731018    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"]
Sep 10 14:20:13.794992 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.794962    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-dj7p4"]
Sep 10 14:20:13.797253 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.797134    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-dj7p4"
Sep 10 14:20:13.798799 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.798757    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"]
Sep 10 14:20:13.799593 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.799575    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rs7nx\""
Sep 10 14:20:13.800500 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.800486    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"
Sep 10 14:20:13.803308 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.803286    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"]
Sep 10 14:20:13.804495 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.804471    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-88jcp\""
Sep 10 14:20:13.804495 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.804495    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 10 14:20:13.804659 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.804531    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.804659 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.804541    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 10 14:20:13.804659 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.804531    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.805345 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.805327    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ktd97"]
Sep 10 14:20:13.805592 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.805576    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:13.807350 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.807332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:13.808071 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808053    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 10 14:20:13.808297 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808280    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.808587 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-serving-cert\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.808587 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808581    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nq2f8\""
Sep 10 14:20:13.808716 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlj9g\" (UniqueName: \"kubernetes.io/projected/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-kube-api-access-dlj9g\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.808716 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p95s\" (UniqueName: \"kubernetes.io/projected/d4109b1b-3105-4cc8-a5a2-b25d67f53b88-kube-api-access-5p95s\") pod \"volume-data-source-validator-695c895bd6-pgtlm\" (UID: \"d4109b1b-3105-4cc8-a5a2-b25d67f53b88\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pgtlm"
Sep 10 14:20:13.808716 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:13.808716 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808692    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29pfq\" (UniqueName: \"kubernetes.io/projected/6d08be70-1756-4f7d-9f95-d387672ceea0-kube-api-access-29pfq\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:13.808908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.808908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.808908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808771    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d08be70-1756-4f7d-9f95-d387672ceea0-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:13.808908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808820    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1275791-9f56-4136-a9c9-90f542081308-serving-cert\") pod \"service-ca-operator-859f94c4b-mpsrv\" (UID: \"c1275791-9f56-4136-a9c9-90f542081308\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"
Sep 10 14:20:13.808908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808841    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1275791-9f56-4136-a9c9-90f542081308-config\") pod \"service-ca-operator-859f94c4b-mpsrv\" (UID: \"c1275791-9f56-4136-a9c9-90f542081308\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"
Sep 10 14:20:13.808908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808860    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzmhz\" (UniqueName: \"kubernetes.io/projected/c1275791-9f56-4136-a9c9-90f542081308-kube-api-access-pzmhz\") pod \"service-ca-operator-859f94c4b-mpsrv\" (UID: \"c1275791-9f56-4136-a9c9-90f542081308\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"
Sep 10 14:20:13.808908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-tmp\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.809204 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.808927    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-snapshots\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.809833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.809818    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.810091 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.810076    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.810445 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.810429    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.810522 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.810491    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 10 14:20:13.810578 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.810494    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9rg8z\""
Sep 10 14:20:13.811142 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.811100    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 10 14:20:13.814038 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.814016    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-dj7p4"]
Sep 10 14:20:13.815741 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.815722    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 10 14:20:13.818244 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.818221    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"]
Sep 10 14:20:13.823797 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.823755    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"]
Sep 10 14:20:13.824491 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.824470    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ktd97"]
Sep 10 14:20:13.900352 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.900322    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-sc5ml"]
Sep 10 14:20:13.903150 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.903124    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:13.903822 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.903799    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56968c8f6-wb7q7"]
Sep 10 14:20:13.905588 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.905567    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 10 14:20:13.905707 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.905627    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7cp7p\""
Sep 10 14:20:13.905707 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.905702    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:13.906012 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.905996    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 10 14:20:13.908111 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.908095    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pgwbr\""
Sep 10 14:20:13.908211 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.908116    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 14:20:13.908287 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.908228    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 14:20:13.908336 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.908323    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.908395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.908353    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.908718 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.908702    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 14:20:13.908829 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.908736    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 14:20:13.909445 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.909428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1275791-9f56-4136-a9c9-90f542081308-serving-cert\") pod \"service-ca-operator-859f94c4b-mpsrv\" (UID: \"c1275791-9f56-4136-a9c9-90f542081308\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"
Sep 10 14:20:13.909584 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.909454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-prjbn\" (UID: \"f90ae0f0-05c2-411d-a91f-68023bc3694b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:13.909584 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.909473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-serving-cert\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:13.909584 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.909503    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-trusted-ca\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:13.909746 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.909674    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1275791-9f56-4136-a9c9-90f542081308-config\") pod \"service-ca-operator-859f94c4b-mpsrv\" (UID: \"c1275791-9f56-4136-a9c9-90f542081308\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"
Sep 10 14:20:13.909746 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.909706    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-tmp\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.909746 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.909739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d08be70-1756-4f7d-9f95-d387672ceea0-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:13.909918 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.909879    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29pfq\" (UniqueName: \"kubernetes.io/projected/6d08be70-1756-4f7d-9f95-d387672ceea0-kube-api-access-29pfq\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:13.910187 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-tmp\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.910250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-config\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:13.910300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gqgz\" (UniqueName: \"kubernetes.io/projected/ab7a49a1-0d53-4e4b-8e7d-9628afb42b13-kube-api-access-7gqgz\") pod \"network-check-source-685456655f-dj7p4\" (UID: \"ab7a49a1-0d53-4e4b-8e7d-9628afb42b13\") " pod="openshift-network-diagnostics/network-check-source-685456655f-dj7p4"
Sep 10 14:20:13.910343 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.910394 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1d3db75-b02d-428b-8cb6-9a6577b51a42-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-z8pn5\" (UID: \"e1d3db75-b02d-428b-8cb6-9a6577b51a42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"
Sep 10 14:20:13.910452 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzmhz\" (UniqueName: \"kubernetes.io/projected/c1275791-9f56-4136-a9c9-90f542081308-kube-api-access-pzmhz\") pod \"service-ca-operator-859f94c4b-mpsrv\" (UID: \"c1275791-9f56-4136-a9c9-90f542081308\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"
Sep 10 14:20:13.910452 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-snapshots\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.910549 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlj9g\" (UniqueName: \"kubernetes.io/projected/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-kube-api-access-dlj9g\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.910549 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdb8s\" (UniqueName: \"kubernetes.io/projected/e1d3db75-b02d-428b-8cb6-9a6577b51a42-kube-api-access-kdb8s\") pod \"kube-storage-version-migrator-operator-8d7dd4675-z8pn5\" (UID: \"e1d3db75-b02d-428b-8cb6-9a6577b51a42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"
Sep 10 14:20:13.910549 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-serving-cert\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.910695 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d3db75-b02d-428b-8cb6-9a6577b51a42-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-z8pn5\" (UID: \"e1d3db75-b02d-428b-8cb6-9a6577b51a42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"
Sep 10 14:20:13.910695 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910614    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p95s\" (UniqueName: \"kubernetes.io/projected/d4109b1b-3105-4cc8-a5a2-b25d67f53b88-kube-api-access-5p95s\") pod \"volume-data-source-validator-695c895bd6-pgtlm\" (UID: \"d4109b1b-3105-4cc8-a5a2-b25d67f53b88\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pgtlm"
Sep 10 14:20:13.910695 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84rjq\" (UniqueName: \"kubernetes.io/projected/f90ae0f0-05c2-411d-a91f-68023bc3694b-kube-api-access-84rjq\") pod \"cluster-samples-operator-7cdcfcf76c-prjbn\" (UID: \"f90ae0f0-05c2-411d-a91f-68023bc3694b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:13.910695 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:13.910695 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.910962 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.910711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5plc\" (UniqueName: \"kubernetes.io/projected/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-kube-api-access-x5plc\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:13.911137 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.911065    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-snapshots\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.913569 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.913357    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 10 14:20:13.913569 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.913434    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 10 14:20:13.914427 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.914407    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-sc5ml"]
Sep 10 14:20:13.914652 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.914626    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 10 14:20:13.914747 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.914683    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 10 14:20:13.915027 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.915007    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 14:20:13.915114 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.915034    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 14:20:13.919488 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.919461    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 14:20:13.919584 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.919550    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56968c8f6-wb7q7"]
Sep 10 14:20:13.920356 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.920335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1275791-9f56-4136-a9c9-90f542081308-config\") pod \"service-ca-operator-859f94c4b-mpsrv\" (UID: \"c1275791-9f56-4136-a9c9-90f542081308\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"
Sep 10 14:20:13.920680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.920657    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6d08be70-1756-4f7d-9f95-d387672ceea0-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:13.921193 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:13.921171    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:13.921293 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:13.921236    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls podName:6d08be70-1756-4f7d-9f95-d387672ceea0 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:14.421218977 +0000 UTC m=+61.013423739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jhpqg" (UID: "6d08be70-1756-4f7d-9f95-d387672ceea0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:13.921770 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.921604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.921895 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.921875    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.923409 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.923386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1275791-9f56-4136-a9c9-90f542081308-serving-cert\") pod \"service-ca-operator-859f94c4b-mpsrv\" (UID: \"c1275791-9f56-4136-a9c9-90f542081308\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"
Sep 10 14:20:13.924071 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.924051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-serving-cert\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.925266 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.925249    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.925499 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.925483    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.926463 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.926447    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.929174 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.929156    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 10 14:20:13.935254 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.935234    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.935420 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.935405    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.936689 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.936675    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.939043 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.939028    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:20:13.946487 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.946466    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzmhz\" (UniqueName: \"kubernetes.io/projected/c1275791-9f56-4136-a9c9-90f542081308-kube-api-access-pzmhz\") pod \"service-ca-operator-859f94c4b-mpsrv\" (UID: \"c1275791-9f56-4136-a9c9-90f542081308\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"
Sep 10 14:20:13.946807 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.946739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29pfq\" (UniqueName: \"kubernetes.io/projected/6d08be70-1756-4f7d-9f95-d387672ceea0-kube-api-access-29pfq\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:13.948013 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.947992    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlj9g\" (UniqueName: \"kubernetes.io/projected/b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a-kube-api-access-dlj9g\") pod \"insights-operator-76bcd6ccf5-z58wp\" (UID: \"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a\") " pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:13.949682 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:13.949665    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p95s\" (UniqueName: \"kubernetes.io/projected/d4109b1b-3105-4cc8-a5a2-b25d67f53b88-kube-api-access-5p95s\") pod \"volume-data-source-validator-695c895bd6-pgtlm\" (UID: \"d4109b1b-3105-4cc8-a5a2-b25d67f53b88\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pgtlm"
Sep 10 14:20:14.011041 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011004    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84rjq\" (UniqueName: \"kubernetes.io/projected/f90ae0f0-05c2-411d-a91f-68023bc3694b-kube-api-access-84rjq\") pod \"cluster-samples-operator-7cdcfcf76c-prjbn\" (UID: \"f90ae0f0-05c2-411d-a91f-68023bc3694b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:14.011041 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-default-certificate\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.011256 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.011256 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5plc\" (UniqueName: \"kubernetes.io/projected/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-kube-api-access-x5plc\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:14.011256 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011142    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-prjbn\" (UID: \"f90ae0f0-05c2-411d-a91f-68023bc3694b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:14.011256 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011174    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-serving-cert\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:14.011256 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-trusted-ca\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:14.011489 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.011268    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 14:20:14.011489 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/979ab872-4173-4dd3-846f-9e1a53f155b6-nginx-conf\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:14.011489 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.011324    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls podName:f90ae0f0-05c2-411d-a91f-68023bc3694b nodeName:}" failed. No retries permitted until 2026-09-10 14:20:14.511305583 +0000 UTC m=+61.103510333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-prjbn" (UID: "f90ae0f0-05c2-411d-a91f-68023bc3694b") : secret "samples-operator-tls" not found
Sep 10 14:20:14.011489 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011351    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-config\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:14.011489 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gqgz\" (UniqueName: \"kubernetes.io/projected/ab7a49a1-0d53-4e4b-8e7d-9628afb42b13-kube-api-access-7gqgz\") pod \"network-check-source-685456655f-dj7p4\" (UID: \"ab7a49a1-0d53-4e4b-8e7d-9628afb42b13\") " pod="openshift-network-diagnostics/network-check-source-685456655f-dj7p4"
Sep 10 14:20:14.011489 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011414    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1d3db75-b02d-428b-8cb6-9a6577b51a42-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-z8pn5\" (UID: \"e1d3db75-b02d-428b-8cb6-9a6577b51a42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"
Sep 10 14:20:14.011489 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011444    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:14.011816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011561    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-stats-auth\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.011816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011612    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69gzs\" (UniqueName: \"kubernetes.io/projected/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-kube-api-access-69gzs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.011816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdb8s\" (UniqueName: \"kubernetes.io/projected/e1d3db75-b02d-428b-8cb6-9a6577b51a42-kube-api-access-kdb8s\") pod \"kube-storage-version-migrator-operator-8d7dd4675-z8pn5\" (UID: \"e1d3db75-b02d-428b-8cb6-9a6577b51a42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"
Sep 10 14:20:14.011816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011702    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d3db75-b02d-428b-8cb6-9a6577b51a42-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-z8pn5\" (UID: \"e1d3db75-b02d-428b-8cb6-9a6577b51a42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"
Sep 10 14:20:14.011816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.011730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.012126 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.012107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-config\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:14.012280 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.012253    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e1d3db75-b02d-428b-8cb6-9a6577b51a42-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-z8pn5\" (UID: \"e1d3db75-b02d-428b-8cb6-9a6577b51a42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"
Sep 10 14:20:14.012884 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.012867    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-trusted-ca\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:14.013990 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.013965    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-serving-cert\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:14.014294 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.014278    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e1d3db75-b02d-428b-8cb6-9a6577b51a42-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-z8pn5\" (UID: \"e1d3db75-b02d-428b-8cb6-9a6577b51a42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"
Sep 10 14:20:14.016126 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.016111    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-xzr5w\""
Sep 10 14:20:14.022190 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.022160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdb8s\" (UniqueName: \"kubernetes.io/projected/e1d3db75-b02d-428b-8cb6-9a6577b51a42-kube-api-access-kdb8s\") pod \"kube-storage-version-migrator-operator-8d7dd4675-z8pn5\" (UID: \"e1d3db75-b02d-428b-8cb6-9a6577b51a42\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"
Sep 10 14:20:14.022330 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.022287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84rjq\" (UniqueName: \"kubernetes.io/projected/f90ae0f0-05c2-411d-a91f-68023bc3694b-kube-api-access-84rjq\") pod \"cluster-samples-operator-7cdcfcf76c-prjbn\" (UID: \"f90ae0f0-05c2-411d-a91f-68023bc3694b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:14.022418 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.022400    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jmxdz\""
Sep 10 14:20:14.022699 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.022684    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 14:20:14.022985 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.022968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5plc\" (UniqueName: \"kubernetes.io/projected/d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca-kube-api-access-x5plc\") pod \"console-operator-85b454874b-ktd97\" (UID: \"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca\") " pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:14.023028 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.023020    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pgtlm"
Sep 10 14:20:14.030838 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.030816    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"
Sep 10 14:20:14.033250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.033230    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 14:20:14.038703 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.038680    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-pbp7v\""
Sep 10 14:20:14.044463 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.044353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gqgz\" (UniqueName: \"kubernetes.io/projected/ab7a49a1-0d53-4e4b-8e7d-9628afb42b13-kube-api-access-7gqgz\") pod \"network-check-source-685456655f-dj7p4\" (UID: \"ab7a49a1-0d53-4e4b-8e7d-9628afb42b13\") " pod="openshift-network-diagnostics/network-check-source-685456655f-dj7p4"
Sep 10 14:20:14.046930 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.046900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp"
Sep 10 14:20:14.109182 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.109147    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-dj7p4"
Sep 10 14:20:14.112366 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.112348    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:14.112405 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.112378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-stats-auth\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.112441 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.112411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69gzs\" (UniqueName: \"kubernetes.io/projected/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-kube-api-access-69gzs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.112474 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.112440    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.112474 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.112458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-default-certificate\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.112474 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.112471    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.112566 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.112536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/979ab872-4173-4dd3-846f-9e1a53f155b6-nginx-conf\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:14.112898 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.112714    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:14.112898 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.112723    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 14:20:14.112898 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.112772    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert podName:979ab872-4173-4dd3-846f-9e1a53f155b6 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:14.612756622 +0000 UTC m=+61.204961369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-sc5ml" (UID: "979ab872-4173-4dd3-846f-9e1a53f155b6") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:14.112898 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.112805    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:14.612797618 +0000 UTC m=+61.205002365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : secret "router-metrics-certs-default" not found
Sep 10 14:20:14.112898 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.112871    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:14.612854314 +0000 UTC m=+61.205059085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : configmap references non-existent config key: service-ca.crt
Sep 10 14:20:14.113246 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.113231    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/979ab872-4173-4dd3-846f-9e1a53f155b6-nginx-conf\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:14.115197 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.115172    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-stats-auth\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.115426 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.115407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-default-certificate\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.117599 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.117209    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"
Sep 10 14:20:14.124404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.124267    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69gzs\" (UniqueName: \"kubernetes.io/projected/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-kube-api-access-69gzs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.130976 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.130951    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:14.297053 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.296974    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pgtlm"]
Sep 10 14:20:14.300802 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:14.300763    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4109b1b_3105_4cc8_a5a2_b25d67f53b88.slice/crio-cb08c9cde40f79f52f7485c4f84025ebd2263a149f898270ff65b823e12357fe WatchSource:0}: Error finding container cb08c9cde40f79f52f7485c4f84025ebd2263a149f898270ff65b823e12357fe: Status 404 returned error can't find the container with id cb08c9cde40f79f52f7485c4f84025ebd2263a149f898270ff65b823e12357fe
Sep 10 14:20:14.308666 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.308640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv"]
Sep 10 14:20:14.313324 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:14.313300    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1275791_9f56_4136_a9c9_90f542081308.slice/crio-c14c6148219399078c8972ca6755ae912de48b89be007b8bd59802468f5bbc5b WatchSource:0}: Error finding container c14c6148219399078c8972ca6755ae912de48b89be007b8bd59802468f5bbc5b: Status 404 returned error can't find the container with id c14c6148219399078c8972ca6755ae912de48b89be007b8bd59802468f5bbc5b
Sep 10 14:20:14.340006 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.339975    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-z58wp"]
Sep 10 14:20:14.342708 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:14.342686    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6eab2d4_3c13_4cd4_9a7b_654912e5fa5a.slice/crio-60c6025b42f32dc5dd5d52bb1210973ef460ab439212f9bb7b0fa0d4d6c525e4 WatchSource:0}: Error finding container 60c6025b42f32dc5dd5d52bb1210973ef460ab439212f9bb7b0fa0d4d6c525e4: Status 404 returned error can't find the container with id 60c6025b42f32dc5dd5d52bb1210973ef460ab439212f9bb7b0fa0d4d6c525e4
Sep 10 14:20:14.393807 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.393758    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-dj7p4"]
Sep 10 14:20:14.397350 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:14.397322    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7a49a1_0d53_4e4b_8e7d_9628afb42b13.slice/crio-1b8e7e33174bfab05e81d5702fdf1ba56d9533a059094ed19ec6276569198b81 WatchSource:0}: Error finding container 1b8e7e33174bfab05e81d5702fdf1ba56d9533a059094ed19ec6276569198b81: Status 404 returned error can't find the container with id 1b8e7e33174bfab05e81d5702fdf1ba56d9533a059094ed19ec6276569198b81
Sep 10 14:20:14.409958 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.409933    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5"]
Sep 10 14:20:14.413639 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:14.413613    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d3db75_b02d_428b_8cb6_9a6577b51a42.slice/crio-34faa64142dd65ea06390a90049fddd1fc0d05a1a93eb678ec15176fa41c9c51 WatchSource:0}: Error finding container 34faa64142dd65ea06390a90049fddd1fc0d05a1a93eb678ec15176fa41c9c51: Status 404 returned error can't find the container with id 34faa64142dd65ea06390a90049fddd1fc0d05a1a93eb678ec15176fa41c9c51
Sep 10 14:20:14.422082 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.422056    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-ktd97"]
Sep 10 14:20:14.425857 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:14.425830    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ce7bd1_dd3e_4318_b1dd_61c1862e0aca.slice/crio-4e29b4e763b6752b2ee2594ea086b954fa5f92587c9494e8e1e189166a59ce84 WatchSource:0}: Error finding container 4e29b4e763b6752b2ee2594ea086b954fa5f92587c9494e8e1e189166a59ce84: Status 404 returned error can't find the container with id 4e29b4e763b6752b2ee2594ea086b954fa5f92587c9494e8e1e189166a59ce84
Sep 10 14:20:14.515414 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.515375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:14.515414 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.515420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-prjbn\" (UID: \"f90ae0f0-05c2-411d-a91f-68023bc3694b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:14.515611 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.515536    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:14.515611 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.515553    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 14:20:14.515611 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.515602    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls podName:f90ae0f0-05c2-411d-a91f-68023bc3694b nodeName:}" failed. No retries permitted until 2026-09-10 14:20:15.515588659 +0000 UTC m=+62.107793406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-prjbn" (UID: "f90ae0f0-05c2-411d-a91f-68023bc3694b") : secret "samples-operator-tls" not found
Sep 10 14:20:14.515758 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.515616    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls podName:6d08be70-1756-4f7d-9f95-d387672ceea0 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:15.515609979 +0000 UTC m=+62.107814725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jhpqg" (UID: "6d08be70-1756-4f7d-9f95-d387672ceea0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:14.615927 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.615854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.615927 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.615893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:14.616063 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.616016    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 14:20:14.616063 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.616060    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:15.616048688 +0000 UTC m=+62.208253436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : secret "router-metrics-certs-default" not found
Sep 10 14:20:14.616132 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.616076    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:14.616132 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.616127    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert podName:979ab872-4173-4dd3-846f-9e1a53f155b6 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:15.616115433 +0000 UTC m=+62.208320184 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-sc5ml" (UID: "979ab872-4173-4dd3-846f-9e1a53f155b6") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:14.616191 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:14.616014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:14.616191 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:14.616146    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:15.616132821 +0000 UTC m=+62.208337568 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : configmap references non-existent config key: service-ca.crt
Sep 10 14:20:15.157718 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:15.157679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-dj7p4" event={"ID":"ab7a49a1-0d53-4e4b-8e7d-9628afb42b13","Type":"ContainerStarted","Data":"1b8e7e33174bfab05e81d5702fdf1ba56d9533a059094ed19ec6276569198b81"}
Sep 10 14:20:15.159328 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:15.159297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ktd97" event={"ID":"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca","Type":"ContainerStarted","Data":"4e29b4e763b6752b2ee2594ea086b954fa5f92587c9494e8e1e189166a59ce84"}
Sep 10 14:20:15.160888 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:15.160854    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5" event={"ID":"e1d3db75-b02d-428b-8cb6-9a6577b51a42","Type":"ContainerStarted","Data":"34faa64142dd65ea06390a90049fddd1fc0d05a1a93eb678ec15176fa41c9c51"}
Sep 10 14:20:15.162244 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:15.162221    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp" event={"ID":"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a","Type":"ContainerStarted","Data":"60c6025b42f32dc5dd5d52bb1210973ef460ab439212f9bb7b0fa0d4d6c525e4"}
Sep 10 14:20:15.163860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:15.163807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pgtlm" event={"ID":"d4109b1b-3105-4cc8-a5a2-b25d67f53b88","Type":"ContainerStarted","Data":"cb08c9cde40f79f52f7485c4f84025ebd2263a149f898270ff65b823e12357fe"}
Sep 10 14:20:15.165187 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:15.165165    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv" event={"ID":"c1275791-9f56-4136-a9c9-90f542081308","Type":"ContainerStarted","Data":"c14c6148219399078c8972ca6755ae912de48b89be007b8bd59802468f5bbc5b"}
Sep 10 14:20:15.525033 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:15.524996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:15.525197 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:15.525050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-prjbn\" (UID: \"f90ae0f0-05c2-411d-a91f-68023bc3694b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:15.525303 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:15.525288    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 14:20:15.525392 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:15.525353    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls podName:f90ae0f0-05c2-411d-a91f-68023bc3694b nodeName:}" failed. No retries permitted until 2026-09-10 14:20:17.525335694 +0000 UTC m=+64.117540446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-prjbn" (UID: "f90ae0f0-05c2-411d-a91f-68023bc3694b") : secret "samples-operator-tls" not found
Sep 10 14:20:15.525740 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:15.525722    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:15.525811 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:15.525798    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls podName:6d08be70-1756-4f7d-9f95-d387672ceea0 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:17.525763275 +0000 UTC m=+64.117968021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jhpqg" (UID: "6d08be70-1756-4f7d-9f95-d387672ceea0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:15.627181 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:15.626169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:15.627181 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:15.626224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:15.627181 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:15.626350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:15.627181 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:15.626485    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:15.627181 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:15.626549    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert podName:979ab872-4173-4dd3-846f-9e1a53f155b6 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:17.626530846 +0000 UTC m=+64.218735615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-sc5ml" (UID: "979ab872-4173-4dd3-846f-9e1a53f155b6") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:15.627181 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:15.626976    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:17.626956632 +0000 UTC m=+64.219161391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : configmap references non-existent config key: service-ca.crt
Sep 10 14:20:15.627181 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:15.627046    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 14:20:15.627181 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:15.627079    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:17.62706898 +0000 UTC m=+64.219273742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : secret "router-metrics-certs-default" not found
Sep 10 14:20:16.098939 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:16.098906    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ng6v4"
Sep 10 14:20:17.547809 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:17.547605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:17.547809 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:17.547658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-prjbn\" (UID: \"f90ae0f0-05c2-411d-a91f-68023bc3694b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:17.547809 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:17.547775    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 14:20:17.547809 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:17.547795    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:17.548345 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:17.547860    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls podName:6d08be70-1756-4f7d-9f95-d387672ceea0 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:21.54784159 +0000 UTC m=+68.140046343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jhpqg" (UID: "6d08be70-1756-4f7d-9f95-d387672ceea0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:17.548345 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:17.547875    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls podName:f90ae0f0-05c2-411d-a91f-68023bc3694b nodeName:}" failed. No retries permitted until 2026-09-10 14:20:21.547868648 +0000 UTC m=+68.140073395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-prjbn" (UID: "f90ae0f0-05c2-411d-a91f-68023bc3694b") : secret "samples-operator-tls" not found
Sep 10 14:20:17.649129 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:17.649087    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:17.649309 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:17.649190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:17.649309 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:17.649222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:17.649309 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:17.649285    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:17.649465 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:17.649330    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 14:20:17.649465 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:17.649368    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert podName:979ab872-4173-4dd3-846f-9e1a53f155b6 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:21.64934558 +0000 UTC m=+68.241550333 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-sc5ml" (UID: "979ab872-4173-4dd3-846f-9e1a53f155b6") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:17.649465 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:17.649389    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:21.649379014 +0000 UTC m=+68.241583767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : configmap references non-existent config key: service-ca.crt
Sep 10 14:20:17.649465 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:17.649404    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:21.64939531 +0000 UTC m=+68.241600062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : secret "router-metrics-certs-default" not found
Sep 10 14:20:19.667314 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:19.666997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:20:19.669831 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:19.669805    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 14:20:19.678189 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:19.678160    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 14:20:19.678311 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:19.678249    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs podName:cf0343b6-f96b-4aa5-8b81-31a1c4183142 nodeName:}" failed. No retries permitted until 2026-09-10 14:21:23.678225382 +0000 UTC m=+130.270430145 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs") pod "network-metrics-daemon-fdw6t" (UID: "cf0343b6-f96b-4aa5-8b81-31a1c4183142") : secret "metrics-daemon-secret" not found
Sep 10 14:20:19.768390 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:19.768351    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7gdq\" (UniqueName: \"kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq\") pod \"network-check-target-hdns2\" (UID: \"228c052c-a318-4137-b48b-e57e30b41de9\") " pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:20:19.768583 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:19.768428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:20:19.771382 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:19.771360    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 14:20:19.771682 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:19.771663    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7gdq\" (UniqueName: \"kubernetes.io/projected/228c052c-a318-4137-b48b-e57e30b41de9-kube-api-access-r7gdq\") pod \"network-check-target-hdns2\" (UID: \"228c052c-a318-4137-b48b-e57e30b41de9\") " pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:20:19.781379 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:19.781352    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1b37115a-c43a-48ef-a1dc-165c5db50d22-original-pull-secret\") pod \"global-pull-secret-syncer-6mxcc\" (UID: \"1b37115a-c43a-48ef-a1dc-165c5db50d22\") " pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:20:19.924462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:19.924427    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mxcc"
Sep 10 14:20:19.933184 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:19.933152    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q47dh\""
Sep 10 14:20:19.941569 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:19.941542    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:20:20.186009 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.185538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-dj7p4" event={"ID":"ab7a49a1-0d53-4e4b-8e7d-9628afb42b13","Type":"ContainerStarted","Data":"1caa55dbf4caec1576b01d2878775d7aab9d172e97b71cb6bb9d0738e3ed0b71"}
Sep 10 14:20:20.187601 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.187580    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/0.log"
Sep 10 14:20:20.187694 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.187623    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca" containerID="b241ac326134a66d3c863378f391a1579c7310124d5004ecf66f09a71bcf8ca1" exitCode=255
Sep 10 14:20:20.187762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.187699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ktd97" event={"ID":"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca","Type":"ContainerDied","Data":"b241ac326134a66d3c863378f391a1579c7310124d5004ecf66f09a71bcf8ca1"}
Sep 10 14:20:20.188175 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.187914    2579 scope.go:117] "RemoveContainer" containerID="b241ac326134a66d3c863378f391a1579c7310124d5004ecf66f09a71bcf8ca1"
Sep 10 14:20:20.191437 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.191412    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5" event={"ID":"e1d3db75-b02d-428b-8cb6-9a6577b51a42","Type":"ContainerStarted","Data":"47810ed31207791396940e095c918b787d9b29d1e8fdbc7cf78f44390d241a8f"}
Sep 10 14:20:20.193298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.193250    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp" event={"ID":"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a","Type":"ContainerStarted","Data":"d479e4c32d790e26e2fd2a8b2224c0214ae76917f9df3f439d621eae33cc3758"}
Sep 10 14:20:20.195361 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.195109    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pgtlm" event={"ID":"d4109b1b-3105-4cc8-a5a2-b25d67f53b88","Type":"ContainerStarted","Data":"a7327e621219af997ae4fd8e5f2d7d972bb45696a32f8c958f3397c48aac87f0"}
Sep 10 14:20:20.197227 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.197205    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv" event={"ID":"c1275791-9f56-4136-a9c9-90f542081308","Type":"ContainerStarted","Data":"0c6d8971837f4a85cb7ae55cdc495cafa58642328a77873ce151f12ed885ed62"}
Sep 10 14:20:20.202532 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.202486    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-dj7p4" podStartSLOduration=2.125112164 podStartE2EDuration="7.202470172s" totalImagesPullingTime="5.077358008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:20.201064251 +0000 UTC m=+66.793269022" watchObservedRunningTime="2026-09-10 14:20:20.202470172 +0000 UTC m=+66.794674940"
Sep 10 14:20:20.209516 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.209330    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6mxcc"]
Sep 10 14:20:20.212713 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:20.212692    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b37115a_c43a_48ef_a1dc_165c5db50d22.slice/crio-cd420b487e20b4d18ce2a1fd2ac1786cad4b85bff46177ba05c27541e641a39f WatchSource:0}: Error finding container cd420b487e20b4d18ce2a1fd2ac1786cad4b85bff46177ba05c27541e641a39f: Status 404 returned error can't find the container with id cd420b487e20b4d18ce2a1fd2ac1786cad4b85bff46177ba05c27541e641a39f
Sep 10 14:20:20.220764 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.220712    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv" podStartSLOduration=2.083817293 podStartE2EDuration="7.220693112s" totalImagesPullingTime="5.136875819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:20.219198814 +0000 UTC m=+66.811403584" watchObservedRunningTime="2026-09-10 14:20:20.220693112 +0000 UTC m=+66.812897885"
Sep 10 14:20:20.239057 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.237609    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-pgtlm" podStartSLOduration=2.092006258 podStartE2EDuration="7.237586356s" totalImagesPullingTime="5.145580098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:20.236297869 +0000 UTC m=+66.828502639" watchObservedRunningTime="2026-09-10 14:20:20.237586356 +0000 UTC m=+66.829791126"
Sep 10 14:20:20.257713 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.257614    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp" podStartSLOduration=2.136862027 podStartE2EDuration="7.257589819s" totalImagesPullingTime="5.120727792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:20.255983651 +0000 UTC m=+66.848188438" watchObservedRunningTime="2026-09-10 14:20:20.257589819 +0000 UTC m=+66.849794589"
Sep 10 14:20:20.258852 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.258829    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hdns2"]
Sep 10 14:20:20.278110 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:20.278017    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5" podStartSLOduration=2.245180586 podStartE2EDuration="7.278000049s" totalImagesPullingTime="5.032819463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:20.277077883 +0000 UTC m=+66.869282663" watchObservedRunningTime="2026-09-10 14:20:20.278000049 +0000 UTC m=+66.870204817"
Sep 10 14:20:21.031848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.030355    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4sbrm"]
Sep 10 14:20:21.052150 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.052113    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4sbrm"]
Sep 10 14:20:21.052297 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.052283    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.057282 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.056663    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mdxkp\""
Sep 10 14:20:21.057282 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.056958    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 14:20:21.057282 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.057132    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 14:20:21.185977 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.185939    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.186182 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.186069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:20:21.186182 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.186112    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.186182 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.186150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c3d57b6-e775-4ccf-819d-50396ceb2283-data-volume\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.186332 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.186203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57gx5\" (UniqueName: \"kubernetes.io/projected/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-api-access-57gx5\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.186332 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.186236    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 10 14:20:21.186332 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.186243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:20:21.186332 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.186250    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-647f4f8798-8xdwk: secret "image-registry-tls" not found
Sep 10 14:20:21.186332 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.186281    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c3d57b6-e775-4ccf-819d-50396ceb2283-crio-socket\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.186332 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.186313    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls podName:49c43416-4eff-4a7c-b551-17d7c6e9aa00 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:53.18629451 +0000 UTC m=+99.778499263 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls") pod "image-registry-647f4f8798-8xdwk" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00") : secret "image-registry-tls" not found
Sep 10 14:20:21.186587 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.186363    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 14:20:21.186587 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.186419    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls podName:989f9a38-9519-496d-a488-3febe9badc7a nodeName:}" failed. No retries permitted until 2026-09-10 14:20:53.186403355 +0000 UTC m=+99.778608106 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls") pod "dns-default-9w8m7" (UID: "989f9a38-9519-496d-a488-3febe9badc7a") : secret "dns-default-metrics-tls" not found
Sep 10 14:20:21.204702 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.204672    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/1.log"
Sep 10 14:20:21.205178 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.205152    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/0.log"
Sep 10 14:20:21.205310 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.205197    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca" containerID="91c2dd33bc216eccb1db69f95ffe64469bffa334551422ce9526e29f3a94c544" exitCode=255
Sep 10 14:20:21.205310 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.205249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ktd97" event={"ID":"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca","Type":"ContainerDied","Data":"91c2dd33bc216eccb1db69f95ffe64469bffa334551422ce9526e29f3a94c544"}
Sep 10 14:20:21.205410 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.205323    2579 scope.go:117] "RemoveContainer" containerID="b241ac326134a66d3c863378f391a1579c7310124d5004ecf66f09a71bcf8ca1"
Sep 10 14:20:21.205597 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.205579    2579 scope.go:117] "RemoveContainer" containerID="91c2dd33bc216eccb1db69f95ffe64469bffa334551422ce9526e29f3a94c544"
Sep 10 14:20:21.205833 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.205808    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ktd97_openshift-console-operator(d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca)\"" pod="openshift-console-operator/console-operator-85b454874b-ktd97" podUID="d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca"
Sep 10 14:20:21.207683 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.207648    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hdns2" event={"ID":"228c052c-a318-4137-b48b-e57e30b41de9","Type":"ContainerStarted","Data":"23c0a5af9f481f413690fc029f1688e1beaf13a0d03bdf051b228a365957214e"}
Sep 10 14:20:21.207801 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.207695    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hdns2" event={"ID":"228c052c-a318-4137-b48b-e57e30b41de9","Type":"ContainerStarted","Data":"275a4b37a80486ad8fd2dbba58e4175a8c53873b443dc7f49ef4294d3237f0d2"}
Sep 10 14:20:21.208177 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.208158    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:20:21.210044 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.210017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6mxcc" event={"ID":"1b37115a-c43a-48ef-a1dc-165c5db50d22","Type":"ContainerStarted","Data":"cd420b487e20b4d18ce2a1fd2ac1786cad4b85bff46177ba05c27541e641a39f"}
Sep 10 14:20:21.238571 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.238527    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hdns2" podStartSLOduration=66.238509423 podStartE2EDuration="1m6.238509423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:21.237990857 +0000 UTC m=+67.830195626" watchObservedRunningTime="2026-09-10 14:20:21.238509423 +0000 UTC m=+67.830714188"
Sep 10 14:20:21.287168 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.287080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.287328 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.287232    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:20:21.287328 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.287302    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm podName:2c3d57b6-e775-4ccf-819d-50396ceb2283 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:21.787284137 +0000 UTC m=+68.379488898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4sbrm" (UID: "2c3d57b6-e775-4ccf-819d-50396ceb2283") : configmap "kube-rbac-proxy" not found
Sep 10 14:20:21.287460 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.287436    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c3d57b6-e775-4ccf-819d-50396ceb2283-data-volume\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.287529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.287498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57gx5\" (UniqueName: \"kubernetes.io/projected/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-api-access-57gx5\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.287584 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.287573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c3d57b6-e775-4ccf-819d-50396ceb2283-crio-socket\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.287752 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.287729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.287856 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.287760    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c3d57b6-e775-4ccf-819d-50396ceb2283-data-volume\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.288071 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.288052    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:21.288153 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.288108    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls podName:2c3d57b6-e775-4ccf-819d-50396ceb2283 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:21.788092658 +0000 UTC m=+68.380297408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sbrm" (UID: "2c3d57b6-e775-4ccf-819d-50396ceb2283") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:21.288550 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.287731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2c3d57b6-e775-4ccf-819d-50396ceb2283-crio-socket\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.298805 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.298761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57gx5\" (UniqueName: \"kubernetes.io/projected/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-api-access-57gx5\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.591625 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.591535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:21.591625 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.591585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-prjbn\" (UID: \"f90ae0f0-05c2-411d-a91f-68023bc3694b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:21.591885 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.591700    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:21.591885 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.591703    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 10 14:20:21.591885 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.591801    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls podName:6d08be70-1756-4f7d-9f95-d387672ceea0 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:29.591767937 +0000 UTC m=+76.183972684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jhpqg" (UID: "6d08be70-1756-4f7d-9f95-d387672ceea0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:21.592026 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.591901    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls podName:f90ae0f0-05c2-411d-a91f-68023bc3694b nodeName:}" failed. No retries permitted until 2026-09-10 14:20:29.591878259 +0000 UTC m=+76.184083012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-prjbn" (UID: "f90ae0f0-05c2-411d-a91f-68023bc3694b") : secret "samples-operator-tls" not found
Sep 10 14:20:21.693173 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.693129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:21.693361 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.693228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:21.693361 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.693265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:21.693361 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.693305    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:21.693517 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.693385    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 14:20:21.693517 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.693397    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert podName:979ab872-4173-4dd3-846f-9e1a53f155b6 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:29.693375769 +0000 UTC m=+76.285580521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-sc5ml" (UID: "979ab872-4173-4dd3-846f-9e1a53f155b6") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:21.693517 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.693416    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:29.693406969 +0000 UTC m=+76.285611722 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : configmap references non-existent config key: service-ca.crt
Sep 10 14:20:21.693517 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.693443    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:29.693422878 +0000 UTC m=+76.285627629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : secret "router-metrics-certs-default" not found
Sep 10 14:20:21.794011 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.793973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.794211 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:21.794098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:21.794211 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.794114    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:20:21.794321 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.794203    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm podName:2c3d57b6-e775-4ccf-819d-50396ceb2283 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:22.794180499 +0000 UTC m=+69.386385245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4sbrm" (UID: "2c3d57b6-e775-4ccf-819d-50396ceb2283") : configmap "kube-rbac-proxy" not found
Sep 10 14:20:21.794321 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.794254    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:21.794411 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:21.794322    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls podName:2c3d57b6-e775-4ccf-819d-50396ceb2283 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:22.794303139 +0000 UTC m=+69.386507895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sbrm" (UID: "2c3d57b6-e775-4ccf-819d-50396ceb2283") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:22.215339 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:22.215309    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/1.log"
Sep 10 14:20:22.215883 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:22.215762    2579 scope.go:117] "RemoveContainer" containerID="91c2dd33bc216eccb1db69f95ffe64469bffa334551422ce9526e29f3a94c544"
Sep 10 14:20:22.215991 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:22.215968    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ktd97_openshift-console-operator(d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca)\"" pod="openshift-console-operator/console-operator-85b454874b-ktd97" podUID="d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca"
Sep 10 14:20:22.805302 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:22.805259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:22.805505 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:22.805379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:22.805505 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:22.805446    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:22.805610 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:22.805519    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls podName:2c3d57b6-e775-4ccf-819d-50396ceb2283 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:24.805504451 +0000 UTC m=+71.397709198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sbrm" (UID: "2c3d57b6-e775-4ccf-819d-50396ceb2283") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:22.805610 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:22.805521    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:20:22.805610 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:22.805585    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm podName:2c3d57b6-e775-4ccf-819d-50396ceb2283 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:24.805567931 +0000 UTC m=+71.397772704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4sbrm" (UID: "2c3d57b6-e775-4ccf-819d-50396ceb2283") : configmap "kube-rbac-proxy" not found
Sep 10 14:20:23.593578 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:23.593548    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-67gs2_0fce03b0-6f05-4349-9b98-a5598a3ccf49/dns-node-resolver/0.log"
Sep 10 14:20:24.132241 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:24.132204    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:24.132419 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:24.132258    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:24.132647 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:24.132631    2579 scope.go:117] "RemoveContainer" containerID="91c2dd33bc216eccb1db69f95ffe64469bffa334551422ce9526e29f3a94c544"
Sep 10 14:20:24.132877 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:24.132853    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-ktd97_openshift-console-operator(d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca)\"" pod="openshift-console-operator/console-operator-85b454874b-ktd97" podUID="d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca"
Sep 10 14:20:24.793269 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:24.793235    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7nftt_782ecfa1-a54e-4937-8e35-0af8b48c5706/node-ca/0.log"
Sep 10 14:20:24.828562 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:24.828527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:24.828736 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:24.828633    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:24.828736 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:24.828694    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:20:24.828832 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:24.828766    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm podName:2c3d57b6-e775-4ccf-819d-50396ceb2283 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:28.828750665 +0000 UTC m=+75.420955411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4sbrm" (UID: "2c3d57b6-e775-4ccf-819d-50396ceb2283") : configmap "kube-rbac-proxy" not found
Sep 10 14:20:24.828832 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:24.828694    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:24.828950 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:24.828844    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls podName:2c3d57b6-e775-4ccf-819d-50396ceb2283 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:28.828832786 +0000 UTC m=+75.421037541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sbrm" (UID: "2c3d57b6-e775-4ccf-819d-50396ceb2283") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:25.228705 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:25.228666    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6mxcc" event={"ID":"1b37115a-c43a-48ef-a1dc-165c5db50d22","Type":"ContainerStarted","Data":"7f890ce27c248a87536902304ad0f36ec6e7e26422acfbb54f4c913351c7acc8"}
Sep 10 14:20:25.246885 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:25.246835    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6mxcc" podStartSLOduration=65.864487588 podStartE2EDuration="1m10.24681909s" totalImagesPullingTime="4.382331502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:25.246655162 +0000 UTC m=+71.838859932" watchObservedRunningTime="2026-09-10 14:20:25.24681909 +0000 UTC m=+71.839023867"
Sep 10 14:20:25.594059 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:25.594025    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f5nfm_fb89e2d9-8063-41da-a44c-7fb3ab0ae983/serve-healthcheck-canary/0.log"
Sep 10 14:20:26.395450 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:26.395416    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-z8pn5_e1d3db75-b02d-428b-8cb6-9a6577b51a42/kube-storage-version-migrator-operator/0.log"
Sep 10 14:20:28.865621 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:28.865579    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:28.866034 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:28.865689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:28.866034 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:28.865706    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 14:20:28.866034 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:28.865770    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm podName:2c3d57b6-e775-4ccf-819d-50396ceb2283 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:36.865754052 +0000 UTC m=+83.457958799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4sbrm" (UID: "2c3d57b6-e775-4ccf-819d-50396ceb2283") : configmap "kube-rbac-proxy" not found
Sep 10 14:20:28.866034 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:28.865865    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:28.866034 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:28.865917    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls podName:2c3d57b6-e775-4ccf-819d-50396ceb2283 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:36.865901466 +0000 UTC m=+83.458106214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sbrm" (UID: "2c3d57b6-e775-4ccf-819d-50396ceb2283") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:29.672296 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:29.672240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:29.672296 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:29.672298    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-prjbn\" (UID: \"f90ae0f0-05c2-411d-a91f-68023bc3694b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:29.672529 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:29.672417    2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:29.672529 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:29.672490    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls podName:6d08be70-1756-4f7d-9f95-d387672ceea0 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:45.672474347 +0000 UTC m=+92.264679094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jhpqg" (UID: "6d08be70-1756-4f7d-9f95-d387672ceea0") : secret "cluster-monitoring-operator-tls" not found
Sep 10 14:20:29.674851 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:29.674821    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f90ae0f0-05c2-411d-a91f-68023bc3694b-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-prjbn\" (UID: \"f90ae0f0-05c2-411d-a91f-68023bc3694b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:29.725534 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:29.725492    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"
Sep 10 14:20:29.773223 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:29.773191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:29.773401 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:29.773289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:29.773401 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:29.773332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:29.773401 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:29.773354    2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 10 14:20:29.773554 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:29.773422    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert podName:979ab872-4173-4dd3-846f-9e1a53f155b6 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:45.773403205 +0000 UTC m=+92.365607975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-sc5ml" (UID: "979ab872-4173-4dd3-846f-9e1a53f155b6") : secret "networking-console-plugin-cert" not found
Sep 10 14:20:29.773554 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:29.773430    2579 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 14:20:29.773554 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:29.773463    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:45.773451392 +0000 UTC m=+92.365656153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : secret "router-metrics-certs-default" not found
Sep 10 14:20:29.773554 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:29.773520    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle podName:3d0eff48-1682-45f1-a3c4-2f2f0a8f4732 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:45.773510064 +0000 UTC m=+92.365714824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle") pod "router-default-56968c8f6-wb7q7" (UID: "3d0eff48-1682-45f1-a3c4-2f2f0a8f4732") : configmap references non-existent config key: service-ca.crt
Sep 10 14:20:29.997814 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:29.997773    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn"]
Sep 10 14:20:30.245040 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:30.245005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn" event={"ID":"f90ae0f0-05c2-411d-a91f-68023bc3694b","Type":"ContainerStarted","Data":"6f4290874ed637c73f7b63a594f8dae4f00177c01c0dbf058ddc0d1196929b55"}
Sep 10 14:20:33.256322 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:33.256284    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn" event={"ID":"f90ae0f0-05c2-411d-a91f-68023bc3694b","Type":"ContainerStarted","Data":"9750f0df1b110351e3914761ef99034463cdb537bca964c432e414e3a02a1754"}
Sep 10 14:20:33.256827 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:33.256345    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn" event={"ID":"f90ae0f0-05c2-411d-a91f-68023bc3694b","Type":"ContainerStarted","Data":"19a4baa320334398c8f01b81970207929232b009c7abdc561cdb1bb6a23e62d1"}
Sep 10 14:20:33.273559 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:33.273507    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-prjbn" podStartSLOduration=17.460322978 podStartE2EDuration="20.273488738s" totalImagesPullingTime="2.81316576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:33.273362742 +0000 UTC m=+79.865567511" watchObservedRunningTime="2026-09-10 14:20:33.273488738 +0000 UTC m=+79.865693506"
Sep 10 14:20:36.936069 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:36.935923    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:36.936069 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:36.936035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:36.936478 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:36.936079    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:36.936478 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:36.936139    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls podName:2c3d57b6-e775-4ccf-819d-50396ceb2283 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:52.936123647 +0000 UTC m=+99.528328394 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4sbrm" (UID: "2c3d57b6-e775-4ccf-819d-50396ceb2283") : secret "insights-runtime-extractor-tls" not found
Sep 10 14:20:36.936563 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:36.936543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2c3d57b6-e775-4ccf-819d-50396ceb2283-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:37.906537 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:37.906508    2579 scope.go:117] "RemoveContainer" containerID="91c2dd33bc216eccb1db69f95ffe64469bffa334551422ce9526e29f3a94c544"
Sep 10 14:20:38.272157 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:38.272134    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:20:38.272553 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:38.272533    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/1.log"
Sep 10 14:20:38.272599 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:38.272566    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca" containerID="f194779125b11b423caa3e01752c74f545a95f0df5b1a74c33a1d7a604a8cee6" exitCode=255
Sep 10 14:20:38.272632 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:38.272619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ktd97" event={"ID":"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca","Type":"ContainerDied","Data":"f194779125b11b423caa3e01752c74f545a95f0df5b1a74c33a1d7a604a8cee6"}
Sep 10 14:20:38.272672 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:38.272662    2579 scope.go:117] "RemoveContainer" containerID="91c2dd33bc216eccb1db69f95ffe64469bffa334551422ce9526e29f3a94c544"
Sep 10 14:20:38.272994 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:38.272970    2579 scope.go:117] "RemoveContainer" containerID="f194779125b11b423caa3e01752c74f545a95f0df5b1a74c33a1d7a604a8cee6"
Sep 10 14:20:38.273162 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:38.273144    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-ktd97_openshift-console-operator(d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca)\"" pod="openshift-console-operator/console-operator-85b454874b-ktd97" podUID="d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca"
Sep 10 14:20:39.277532 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:39.277504    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:20:44.132205 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:44.132157    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:44.132205 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:44.132213    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:44.132681 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:44.132506    2579 scope.go:117] "RemoveContainer" containerID="f194779125b11b423caa3e01752c74f545a95f0df5b1a74c33a1d7a604a8cee6"
Sep 10 14:20:44.132681 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:44.132652    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-ktd97_openshift-console-operator(d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca)\"" pod="openshift-console-operator/console-operator-85b454874b-ktd97" podUID="d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca"
Sep 10 14:20:45.705414 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:45.705370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:45.708058 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:45.708028    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6d08be70-1756-4f7d-9f95-d387672ceea0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jhpqg\" (UID: \"6d08be70-1756-4f7d-9f95-d387672ceea0\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:45.805742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:45.805694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:45.805921 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:45.805760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:45.805921 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:45.805871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:45.806619 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:45.806540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-service-ca-bundle\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:45.808224 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:45.808200    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d0eff48-1682-45f1-a3c4-2f2f0a8f4732-metrics-certs\") pod \"router-default-56968c8f6-wb7q7\" (UID: \"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732\") " pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:45.808343 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:45.808292    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/979ab872-4173-4dd3-846f-9e1a53f155b6-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-sc5ml\" (UID: \"979ab872-4173-4dd3-846f-9e1a53f155b6\") " pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:45.829832 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:45.829800    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bkwj6\""
Sep 10 14:20:45.838112 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:45.838091    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"
Sep 10 14:20:46.015173 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:46.015138    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml"
Sep 10 14:20:46.022077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:46.022046    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:46.110386 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:46.110341    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg"]
Sep 10 14:20:46.112926 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:46.112898    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d08be70_1756_4f7d_9f95_d387672ceea0.slice/crio-a6f2c45c69b566c1da0c5686edfae4e7b9873b35640628fe0c086df7b8a48c9d WatchSource:0}: Error finding container a6f2c45c69b566c1da0c5686edfae4e7b9873b35640628fe0c086df7b8a48c9d: Status 404 returned error can't find the container with id a6f2c45c69b566c1da0c5686edfae4e7b9873b35640628fe0c086df7b8a48c9d
Sep 10 14:20:46.287577 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:46.287463    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-sc5ml"]
Sep 10 14:20:46.292137 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:46.292107    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979ab872_4173_4dd3_846f_9e1a53f155b6.slice/crio-09dc9511d4b4ada591657a38d3ff2f8396361bb28a587a7a3ebfdef486972111 WatchSource:0}: Error finding container 09dc9511d4b4ada591657a38d3ff2f8396361bb28a587a7a3ebfdef486972111: Status 404 returned error can't find the container with id 09dc9511d4b4ada591657a38d3ff2f8396361bb28a587a7a3ebfdef486972111
Sep 10 14:20:46.302147 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:46.302107    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml" event={"ID":"979ab872-4173-4dd3-846f-9e1a53f155b6","Type":"ContainerStarted","Data":"09dc9511d4b4ada591657a38d3ff2f8396361bb28a587a7a3ebfdef486972111"}
Sep 10 14:20:46.303289 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:46.303259    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg" event={"ID":"6d08be70-1756-4f7d-9f95-d387672ceea0","Type":"ContainerStarted","Data":"a6f2c45c69b566c1da0c5686edfae4e7b9873b35640628fe0c086df7b8a48c9d"}
Sep 10 14:20:46.314537 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:46.314507    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56968c8f6-wb7q7"]
Sep 10 14:20:46.317260 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:46.317233    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0eff48_1682_45f1_a3c4_2f2f0a8f4732.slice/crio-233c9a9400fc2c8147e92985df5bd66d4c3280a57441685ca23eed7f657c4849 WatchSource:0}: Error finding container 233c9a9400fc2c8147e92985df5bd66d4c3280a57441685ca23eed7f657c4849: Status 404 returned error can't find the container with id 233c9a9400fc2c8147e92985df5bd66d4c3280a57441685ca23eed7f657c4849
Sep 10 14:20:47.309964 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:47.309922    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56968c8f6-wb7q7" event={"ID":"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732","Type":"ContainerStarted","Data":"a783d8742039446cb9dc99106e7688c212d6aaf99ea1f682fcf053b5b0b9afe3"}
Sep 10 14:20:47.310500 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:47.309988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56968c8f6-wb7q7" event={"ID":"3d0eff48-1682-45f1-a3c4-2f2f0a8f4732","Type":"ContainerStarted","Data":"233c9a9400fc2c8147e92985df5bd66d4c3280a57441685ca23eed7f657c4849"}
Sep 10 14:20:47.338467 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:47.338405    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56968c8f6-wb7q7" podStartSLOduration=34.338379202 podStartE2EDuration="34.338379202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:47.337305953 +0000 UTC m=+93.929510721" watchObservedRunningTime="2026-09-10 14:20:47.338379202 +0000 UTC m=+93.930583973"
Sep 10 14:20:48.022334 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.022298    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:48.025302 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.025278    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:48.315807 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.315694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml" event={"ID":"979ab872-4173-4dd3-846f-9e1a53f155b6","Type":"ContainerStarted","Data":"81f9b35ede55814a77ef2f718eef8edf4ffc93992ccc1b93d400b53ea3192cc8"}
Sep 10 14:20:48.317497 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.317472    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg" event={"ID":"6d08be70-1756-4f7d-9f95-d387672ceea0","Type":"ContainerStarted","Data":"6c6404227f0ee720e24f6d224d8305caa02ac2c854ffed1ae563827405a80c25"}
Sep 10 14:20:48.317762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.317740    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:48.318948 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.318927    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56968c8f6-wb7q7"
Sep 10 14:20:48.344259 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.344211    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-sc5ml" podStartSLOduration=33.535966486 podStartE2EDuration="35.34419416s" totalImagesPullingTime="1.808227674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:48.343401857 +0000 UTC m=+94.935606626" watchObservedRunningTime="2026-09-10 14:20:48.34419416 +0000 UTC m=+94.936398929"
Sep 10 14:20:48.373743 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.373694    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jhpqg" podStartSLOduration=33.381924404 podStartE2EDuration="35.373676313s" totalImagesPullingTime="1.991751909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:48.372042362 +0000 UTC m=+94.964247132" watchObservedRunningTime="2026-09-10 14:20:48.373676313 +0000 UTC m=+94.965881084"
Sep 10 14:20:48.740230 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.740148    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm"]
Sep 10 14:20:48.775044 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.775003    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm"]
Sep 10 14:20:48.775225 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.775146    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm"
Sep 10 14:20:48.778620 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.778595    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wtkgx\""
Sep 10 14:20:48.779045 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.779028    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 10 14:20:48.831772 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.831737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2326e8e8-1494-441a-bf3a-e0a4d51d19d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-kfqtm\" (UID: \"2326e8e8-1494-441a-bf3a-e0a4d51d19d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm"
Sep 10 14:20:48.932441 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:48.932402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2326e8e8-1494-441a-bf3a-e0a4d51d19d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-kfqtm\" (UID: \"2326e8e8-1494-441a-bf3a-e0a4d51d19d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm"
Sep 10 14:20:48.932619 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:48.932516    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 14:20:48.932619 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:20:48.932575    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2326e8e8-1494-441a-bf3a-e0a4d51d19d3-tls-certificates podName:2326e8e8-1494-441a-bf3a-e0a4d51d19d3 nodeName:}" failed. No retries permitted until 2026-09-10 14:20:49.432561406 +0000 UTC m=+96.024766153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/2326e8e8-1494-441a-bf3a-e0a4d51d19d3-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-kfqtm" (UID: "2326e8e8-1494-441a-bf3a-e0a4d51d19d3") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 10 14:20:49.438413 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:49.438372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2326e8e8-1494-441a-bf3a-e0a4d51d19d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-kfqtm\" (UID: \"2326e8e8-1494-441a-bf3a-e0a4d51d19d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm"
Sep 10 14:20:49.440965 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:49.440937    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/2326e8e8-1494-441a-bf3a-e0a4d51d19d3-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-kfqtm\" (UID: \"2326e8e8-1494-441a-bf3a-e0a4d51d19d3\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm"
Sep 10 14:20:49.683527 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:49.683491    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm"
Sep 10 14:20:49.973768 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:49.973558    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm"]
Sep 10 14:20:49.976349 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:49.976323    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2326e8e8_1494_441a_bf3a_e0a4d51d19d3.slice/crio-9b31b1c6b2e943c9d173a38fe9910879874d77303253638c2940463bca8f8f04 WatchSource:0}: Error finding container 9b31b1c6b2e943c9d173a38fe9910879874d77303253638c2940463bca8f8f04: Status 404 returned error can't find the container with id 9b31b1c6b2e943c9d173a38fe9910879874d77303253638c2940463bca8f8f04
Sep 10 14:20:50.325286 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:50.325250    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm" event={"ID":"2326e8e8-1494-441a-bf3a-e0a4d51d19d3","Type":"ContainerStarted","Data":"9b31b1c6b2e943c9d173a38fe9910879874d77303253638c2940463bca8f8f04"}
Sep 10 14:20:52.336232 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:52.336199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm" event={"ID":"2326e8e8-1494-441a-bf3a-e0a4d51d19d3","Type":"ContainerStarted","Data":"2ad04649a6ab84c826f7a8e9d70b0dabcc3501503e16cb55c684f6645c05c2b3"}
Sep 10 14:20:52.336674 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:52.336509    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm"
Sep 10 14:20:52.341153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:52.341128    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm"
Sep 10 14:20:52.353836 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:52.353759    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kfqtm" podStartSLOduration=2.66505181 podStartE2EDuration="4.353738167s" totalImagesPullingTime="1.688686357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:52.35203424 +0000 UTC m=+98.944239019" watchObservedRunningTime="2026-09-10 14:20:52.353738167 +0000 UTC m=+98.945942936"
Sep 10 14:20:52.969962 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:52.969920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:52.972413 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:52.972384    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2c3d57b6-e775-4ccf-819d-50396ceb2283-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4sbrm\" (UID: \"2c3d57b6-e775-4ccf-819d-50396ceb2283\") " pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:53.166270 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.166238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4sbrm"
Sep 10 14:20:53.223392 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.223325    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hdns2"
Sep 10 14:20:53.273018 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.272988    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:20:53.273184 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.273038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:20:53.275554 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.275526    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/989f9a38-9519-496d-a488-3febe9badc7a-metrics-tls\") pod \"dns-default-9w8m7\" (UID: \"989f9a38-9519-496d-a488-3febe9badc7a\") " pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:20:53.275715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.275695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") pod \"image-registry-647f4f8798-8xdwk\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") " pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:20:53.440247 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.440203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4sbrm"]
Sep 10 14:20:53.444936 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:53.444908    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3d57b6_e775_4ccf_819d_50396ceb2283.slice/crio-ca5a7a802306278ede4e370911c597c93d3daadd11f5f6cd1d259e765823acc0 WatchSource:0}: Error finding container ca5a7a802306278ede4e370911c597c93d3daadd11f5f6cd1d259e765823acc0: Status 404 returned error can't find the container with id ca5a7a802306278ede4e370911c597c93d3daadd11f5f6cd1d259e765823acc0
Sep 10 14:20:53.464671 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.464646    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cgxdb\""
Sep 10 14:20:53.472433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.472403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:20:53.494730 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.494701    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bskzl\""
Sep 10 14:20:53.502731 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.502698    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:20:53.757354 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.757317    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-647f4f8798-8xdwk"]
Sep 10 14:20:53.760731 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:53.760704    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c43416_4eff_4a7c_b551_17d7c6e9aa00.slice/crio-00228d7bd03d0719b99598864a7ed686aa4f19a2bfcb292c45b13e23e0261a05 WatchSource:0}: Error finding container 00228d7bd03d0719b99598864a7ed686aa4f19a2bfcb292c45b13e23e0261a05: Status 404 returned error can't find the container with id 00228d7bd03d0719b99598864a7ed686aa4f19a2bfcb292c45b13e23e0261a05
Sep 10 14:20:53.785236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:53.785195    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9w8m7"]
Sep 10 14:20:53.789856 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:20:53.789823    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989f9a38_9519_496d_a488_3febe9badc7a.slice/crio-bee6c673428cdad2a96ec508af2c4b6bfca4822e5d11d65ecd817013c53338fa WatchSource:0}: Error finding container bee6c673428cdad2a96ec508af2c4b6bfca4822e5d11d65ecd817013c53338fa: Status 404 returned error can't find the container with id bee6c673428cdad2a96ec508af2c4b6bfca4822e5d11d65ecd817013c53338fa
Sep 10 14:20:54.346098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:54.346062    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk" event={"ID":"49c43416-4eff-4a7c-b551-17d7c6e9aa00","Type":"ContainerStarted","Data":"3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe"}
Sep 10 14:20:54.346289 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:54.346126    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk" event={"ID":"49c43416-4eff-4a7c-b551-17d7c6e9aa00","Type":"ContainerStarted","Data":"00228d7bd03d0719b99598864a7ed686aa4f19a2bfcb292c45b13e23e0261a05"}
Sep 10 14:20:54.346289 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:54.346188    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:20:54.348517 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:54.348475    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4sbrm" event={"ID":"2c3d57b6-e775-4ccf-819d-50396ceb2283","Type":"ContainerStarted","Data":"2685b59e8a5456beaa79984dfa5749a86e7f8d544e80b5a368619606e796e694"}
Sep 10 14:20:54.348669 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:54.348551    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4sbrm" event={"ID":"2c3d57b6-e775-4ccf-819d-50396ceb2283","Type":"ContainerStarted","Data":"0c343328172fd1ace43740d6fbc0b29f20fa8ebb2493b372e74560da43e4aa54"}
Sep 10 14:20:54.348669 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:54.348573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4sbrm" event={"ID":"2c3d57b6-e775-4ccf-819d-50396ceb2283","Type":"ContainerStarted","Data":"ca5a7a802306278ede4e370911c597c93d3daadd11f5f6cd1d259e765823acc0"}
Sep 10 14:20:54.349870 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:54.349840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9w8m7" event={"ID":"989f9a38-9519-496d-a488-3febe9badc7a","Type":"ContainerStarted","Data":"bee6c673428cdad2a96ec508af2c4b6bfca4822e5d11d65ecd817013c53338fa"}
Sep 10 14:20:54.378026 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:54.377968    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk" podStartSLOduration=99.377947803 podStartE2EDuration="1m39.377947803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:54.376408963 +0000 UTC m=+100.968613743" watchObservedRunningTime="2026-09-10 14:20:54.377947803 +0000 UTC m=+100.970152572"
Sep 10 14:20:56.359539 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:56.359503    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9w8m7" event={"ID":"989f9a38-9519-496d-a488-3febe9badc7a","Type":"ContainerStarted","Data":"baa07d81f175f6f521ce85ffd09d4308384c7816a68a61fc5ad375e18b3879e9"}
Sep 10 14:20:56.360040 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:56.359557    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9w8m7" event={"ID":"989f9a38-9519-496d-a488-3febe9badc7a","Type":"ContainerStarted","Data":"d1119e0f08a0ba0a4cd46be79fa35a1d281c610692414a72fe583511d7ab5cb5"}
Sep 10 14:20:56.360040 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:56.359629    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:20:56.361657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:56.361634    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4sbrm" event={"ID":"2c3d57b6-e775-4ccf-819d-50396ceb2283","Type":"ContainerStarted","Data":"8dd5fb610c6152a1b8fc81be12810b387fd2e9cd58b5d92850bfa5c10a1e8a95"}
Sep 10 14:20:56.386130 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:56.386077    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9w8m7" podStartSLOduration=65.678751347 podStartE2EDuration="1m7.386060951s" totalImagesPullingTime="1.707309604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:56.384179941 +0000 UTC m=+102.976384710" watchObservedRunningTime="2026-09-10 14:20:56.386060951 +0000 UTC m=+102.978265720"
Sep 10 14:20:56.409656 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:56.409604    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4sbrm" podStartSLOduration=32.960074176 podStartE2EDuration="35.409587784s" totalImagesPullingTime="2.449513608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:20:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:56.407538038 +0000 UTC m=+102.999742807" watchObservedRunningTime="2026-09-10 14:20:56.409587784 +0000 UTC m=+103.001792553"
Sep 10 14:20:58.906583 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:58.906550    2579 scope.go:117] "RemoveContainer" containerID="f194779125b11b423caa3e01752c74f545a95f0df5b1a74c33a1d7a604a8cee6"
Sep 10 14:20:59.374833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.374806    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:20:59.374996 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.374930    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-ktd97" event={"ID":"d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca","Type":"ContainerStarted","Data":"b81f74078e402d2beec285ceb6b8e39c2f5f9d5bd3eafed4d7306800145a8cff"}
Sep 10 14:20:59.375302 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.375277    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:59.393339 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.393290    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-ktd97" podStartSLOduration=41.355347605 podStartE2EDuration="46.393274592s" totalImagesPullingTime="5.037926987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:20:59.392218809 +0000 UTC m=+105.984423599" watchObservedRunningTime="2026-09-10 14:20:59.393274592 +0000 UTC m=+105.985479360"
Sep 10 14:20:59.507843 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.507814    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-ktd97"
Sep 10 14:20:59.780645 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.780608    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-r4bvz"]
Sep 10 14:20:59.804025 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.803992    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-r4bvz"
Sep 10 14:20:59.806747 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.806716    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-r4bvz"]
Sep 10 14:20:59.809404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.809374    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 14:20:59.809582 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.809507    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5gl76\""
Sep 10 14:20:59.809826 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.809764    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 14:20:59.926624 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:20:59.926590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4dbw\" (UniqueName: \"kubernetes.io/projected/f2a5fa75-ef93-42d4-973c-f57f5bad88ea-kube-api-access-d4dbw\") pod \"downloads-85d98c998f-r4bvz\" (UID: \"f2a5fa75-ef93-42d4-973c-f57f5bad88ea\") " pod="openshift-console/downloads-85d98c998f-r4bvz"
Sep 10 14:21:00.027263 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:00.027224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4dbw\" (UniqueName: \"kubernetes.io/projected/f2a5fa75-ef93-42d4-973c-f57f5bad88ea-kube-api-access-d4dbw\") pod \"downloads-85d98c998f-r4bvz\" (UID: \"f2a5fa75-ef93-42d4-973c-f57f5bad88ea\") " pod="openshift-console/downloads-85d98c998f-r4bvz"
Sep 10 14:21:00.040806 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:00.040719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4dbw\" (UniqueName: \"kubernetes.io/projected/f2a5fa75-ef93-42d4-973c-f57f5bad88ea-kube-api-access-d4dbw\") pod \"downloads-85d98c998f-r4bvz\" (UID: \"f2a5fa75-ef93-42d4-973c-f57f5bad88ea\") " pod="openshift-console/downloads-85d98c998f-r4bvz"
Sep 10 14:21:00.114508 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:00.114473    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-r4bvz"
Sep 10 14:21:00.412749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:00.412725    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-r4bvz"]
Sep 10 14:21:00.415164 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:21:00.415135    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a5fa75_ef93_42d4_973c_f57f5bad88ea.slice/crio-4c9e8e04d3ebd07134dcc0011dac2e1cdb8a2a997b0712d924912228165022dd WatchSource:0}: Error finding container 4c9e8e04d3ebd07134dcc0011dac2e1cdb8a2a997b0712d924912228165022dd: Status 404 returned error can't find the container with id 4c9e8e04d3ebd07134dcc0011dac2e1cdb8a2a997b0712d924912228165022dd
Sep 10 14:21:01.383763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:01.383729    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-r4bvz" event={"ID":"f2a5fa75-ef93-42d4-973c-f57f5bad88ea","Type":"ContainerStarted","Data":"4c9e8e04d3ebd07134dcc0011dac2e1cdb8a2a997b0712d924912228165022dd"}
Sep 10 14:21:02.448759 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.448731    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"]
Sep 10 14:21:02.451260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.451234    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9tzcr"]
Sep 10 14:21:02.451417 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.451326    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.453704 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.453681    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.455043 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.454648    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 14:21:02.455547 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.454699    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9x5fk\""
Sep 10 14:21:02.455722 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.454753    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 14:21:02.455722 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.454903    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 14:21:02.456317 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.456262    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 14:21:02.456657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.456326    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7t8jk\""
Sep 10 14:21:02.456657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.456556    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 14:21:02.457086 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.457066    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 14:21:02.461016 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.460994    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 14:21:02.472672 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.472588    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"]
Sep 10 14:21:02.548931 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.548893    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-tls\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.549136 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.548956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.549136 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.548988    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.549136 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/535fe263-5e53-46b0-9b73-9cbbed34a1b4-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.549136 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549058    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3ffab79-8933-46ce-9496-15055479e49f-metrics-client-ca\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.549136 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549080    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8f86\" (UniqueName: \"kubernetes.io/projected/f3ffab79-8933-46ce-9496-15055479e49f-kube-api-access-l8f86\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.549136 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdz7f\" (UniqueName: \"kubernetes.io/projected/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-api-access-tdz7f\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.549136 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3ffab79-8933-46ce-9496-15055479e49f-sys\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.549504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.549504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549187    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-textfile\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.549504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549287    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.549504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.549504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-wtmp\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.549504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f3ffab79-8933-46ce-9496-15055479e49f-root\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.549504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.549470    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/535fe263-5e53-46b0-9b73-9cbbed34a1b4-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.650494 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.650458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-tls\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.650494 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.650514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.650753 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.650650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.650753 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.650700    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/535fe263-5e53-46b0-9b73-9cbbed34a1b4-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.650753 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.650731    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3ffab79-8933-46ce-9496-15055479e49f-metrics-client-ca\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.651007 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.650859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8f86\" (UniqueName: \"kubernetes.io/projected/f3ffab79-8933-46ce-9496-15055479e49f-kube-api-access-l8f86\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.651007 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.650902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdz7f\" (UniqueName: \"kubernetes.io/projected/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-api-access-tdz7f\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.651007 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.650933    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3ffab79-8933-46ce-9496-15055479e49f-sys\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.651007 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.650960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.651007 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.650992    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-textfile\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.651241 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.651241 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651042    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f3ffab79-8933-46ce-9496-15055479e49f-sys\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.651241 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.651241 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651117    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/535fe263-5e53-46b0-9b73-9cbbed34a1b4-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.651241 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-wtmp\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.651241 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651164    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f3ffab79-8933-46ce-9496-15055479e49f-root\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.651241 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651192    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/535fe263-5e53-46b0-9b73-9cbbed34a1b4-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.654952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651261    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-wtmp\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.654952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651348    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3ffab79-8933-46ce-9496-15055479e49f-metrics-client-ca\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.654952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651522    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-textfile\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.654952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.654952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651548    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f3ffab79-8933-46ce-9496-15055479e49f-root\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.654952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.651642    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.654952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.652062    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/535fe263-5e53-46b0-9b73-9cbbed34a1b4-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.654952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.653806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.654952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.654118    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.654952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.654244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f3ffab79-8933-46ce-9496-15055479e49f-node-exporter-tls\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.656863 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.656837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.665199 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.664662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8f86\" (UniqueName: \"kubernetes.io/projected/f3ffab79-8933-46ce-9496-15055479e49f-kube-api-access-l8f86\") pod \"node-exporter-9tzcr\" (UID: \"f3ffab79-8933-46ce-9496-15055479e49f\") " pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.668424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.668393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdz7f\" (UniqueName: \"kubernetes.io/projected/535fe263-5e53-46b0-9b73-9cbbed34a1b4-kube-api-access-tdz7f\") pod \"kube-state-metrics-74cb57df7-l7bvm\" (UID: \"535fe263-5e53-46b0-9b73-9cbbed34a1b4\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.765906 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.765871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"
Sep 10 14:21:02.774539 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:02.774504    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9tzcr"
Sep 10 14:21:02.788660 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:21:02.788621    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ffab79_8933_46ce_9496_15055479e49f.slice/crio-5ac9585297bb2ec74c7d3115ce5a46630d9c097538bd92cd2be6a7cf7a0fada2 WatchSource:0}: Error finding container 5ac9585297bb2ec74c7d3115ce5a46630d9c097538bd92cd2be6a7cf7a0fada2: Status 404 returned error can't find the container with id 5ac9585297bb2ec74c7d3115ce5a46630d9c097538bd92cd2be6a7cf7a0fada2
Sep 10 14:21:03.057644 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.057555    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm"]
Sep 10 14:21:03.061707 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:21:03.061631    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535fe263_5e53_46b0_9b73_9cbbed34a1b4.slice/crio-24777ae2cee0ad1193e50bfec43055a73559525e405d79ef7e373eae1b94618b WatchSource:0}: Error finding container 24777ae2cee0ad1193e50bfec43055a73559525e405d79ef7e373eae1b94618b: Status 404 returned error can't find the container with id 24777ae2cee0ad1193e50bfec43055a73559525e405d79ef7e373eae1b94618b
Sep 10 14:21:03.331633 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.331543    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:21:03.335076 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.335051    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.338906 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.338875    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 10 14:21:03.338906 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.338875    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 10 14:21:03.339105 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.338921    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 10 14:21:03.339105 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.338989    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 10 14:21:03.342261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.341050    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 10 14:21:03.342261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.341337    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 10 14:21:03.342261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.341453    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 10 14:21:03.342261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.341853    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 10 14:21:03.342261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.341866    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 10 14:21:03.342261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.342109    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t9cwl\""
Sep 10 14:21:03.357051 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.357016    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:21:03.394431 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.394379    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm" event={"ID":"535fe263-5e53-46b0-9b73-9cbbed34a1b4","Type":"ContainerStarted","Data":"24777ae2cee0ad1193e50bfec43055a73559525e405d79ef7e373eae1b94618b"}
Sep 10 14:21:03.395750 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.395695    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tzcr" event={"ID":"f3ffab79-8933-46ce-9496-15055479e49f","Type":"ContainerStarted","Data":"5ac9585297bb2ec74c7d3115ce5a46630d9c097538bd92cd2be6a7cf7a0fada2"}
Sep 10 14:21:03.457996 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.457958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.457996 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.458481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.458481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458068    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8cgd\" (UniqueName: \"kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-kube-api-access-q8cgd\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.458481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.458481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458119    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-web-config\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.458481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.458481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.458481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458265    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-config-volume\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.458481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.458481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458359    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.458481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-config-out\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.458481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.458419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.559701 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.559658    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-config-out\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.559911 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.559714    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.559911 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.559756    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.559911 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.559793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.559911 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.559851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.559911 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.559877    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8cgd\" (UniqueName: \"kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-kube-api-access-q8cgd\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.559911 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.559899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.560212 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.559924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-web-config\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.560212 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.559950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.560212 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.559988    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.560212 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.560016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-config-volume\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.560212 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.560053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.560212 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.560123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.561052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.560955    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.562088 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:21:03.561323    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-trusted-ca-bundle podName:878d024f-74c8-40ba-8621-f336fa83527a nodeName:}" failed. No retries permitted until 2026-09-10 14:21:04.061300418 +0000 UTC m=+110.653505181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "878d024f-74c8-40ba-8621-f336fa83527a") : configmap references non-existent config key: ca-bundle.crt
Sep 10 14:21:03.562088 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.562030    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.564198 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.564140    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.564198 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.564165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.564367 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.564258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.564523 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.564502    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-config-out\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.565180 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.565141    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.565424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.565403    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.566206 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.566166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-web-config\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.566460 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.566438    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.567984 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.567964    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-config-volume\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:03.570340 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:03.570313    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8cgd\" (UniqueName: \"kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-kube-api-access-q8cgd\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:04.065501 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:04.065463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:04.066568 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:04.066539    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:04.252486 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:04.252253    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:21:04.583617 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:04.583543    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:21:04.811010 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:21:04.810965    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878d024f_74c8_40ba_8621_f336fa83527a.slice/crio-0e0bb6030ffd9330ec767dcb3b519d615ddce7d486887ddd8fa773af8790759c WatchSource:0}: Error finding container 0e0bb6030ffd9330ec767dcb3b519d615ddce7d486887ddd8fa773af8790759c: Status 404 returned error can't find the container with id 0e0bb6030ffd9330ec767dcb3b519d615ddce7d486887ddd8fa773af8790759c
Sep 10 14:21:05.413794 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:05.413739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tzcr" event={"ID":"f3ffab79-8933-46ce-9496-15055479e49f","Type":"ContainerDied","Data":"11812d95028544a12313f865086db85c2ec7eed57d22711516bb464f9b5fd7a1"}
Sep 10 14:21:05.413963 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:05.413122    2579 generic.go:356] "Generic (PLEG): container finished" podID="f3ffab79-8933-46ce-9496-15055479e49f" containerID="11812d95028544a12313f865086db85c2ec7eed57d22711516bb464f9b5fd7a1" exitCode=0
Sep 10 14:21:05.415610 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:05.415573    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerStarted","Data":"0e0bb6030ffd9330ec767dcb3b519d615ddce7d486887ddd8fa773af8790759c"}
Sep 10 14:21:05.418994 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:05.418946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm" event={"ID":"535fe263-5e53-46b0-9b73-9cbbed34a1b4","Type":"ContainerStarted","Data":"200898c40c5cd7a7f33e1692b432b7f72b3a3c4b26ac2d333ce3931ffeae8258"}
Sep 10 14:21:05.419106 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:05.419009    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm" event={"ID":"535fe263-5e53-46b0-9b73-9cbbed34a1b4","Type":"ContainerStarted","Data":"ee0fb07b595765a68e5b3cc2fbdeb8eebc5abe272106280ef29a7b33d23291d3"}
Sep 10 14:21:05.419106 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:05.419038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm" event={"ID":"535fe263-5e53-46b0-9b73-9cbbed34a1b4","Type":"ContainerStarted","Data":"8643b4f41e1adc129cb3bba8e559e5a55a12103187236ac8ee452b193b0b19af"}
Sep 10 14:21:05.459484 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:05.459426    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-l7bvm" podStartSLOduration=1.6650961739999999 podStartE2EDuration="3.459407864s" totalImagesPullingTime="1.79431169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:21:05.456793826 +0000 UTC m=+112.048998589" watchObservedRunningTime="2026-09-10 14:21:05.459407864 +0000 UTC m=+112.051612635"
Sep 10 14:21:06.367376 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:06.367348    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9w8m7"
Sep 10 14:21:06.427219 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:06.427182    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tzcr" event={"ID":"f3ffab79-8933-46ce-9496-15055479e49f","Type":"ContainerStarted","Data":"931d3ea18156a144ba8ddcd89764265ba38aaf391ac2ef2ae128f155700ee73d"}
Sep 10 14:21:06.427391 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:06.427248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tzcr" event={"ID":"f3ffab79-8933-46ce-9496-15055479e49f","Type":"ContainerStarted","Data":"75ded46ddd6b1938ffe738bf710886cffec7b80d493c6bfe83a134dcff019d2d"}
Sep 10 14:21:06.429205 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:06.429175    2579 generic.go:356] "Generic (PLEG): container finished" podID="878d024f-74c8-40ba-8621-f336fa83527a" containerID="d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7" exitCode=0
Sep 10 14:21:06.429363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:06.429293    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerDied","Data":"d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7"}
Sep 10 14:21:06.471055 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:06.470981    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9tzcr" podStartSLOduration=2.8586283999999997 podStartE2EDuration="4.470958652s" totalImagesPullingTime="1.524023296s" totalInitContainerRuntime="88.306956ms" isStatefulPod=true podCreationTimestamp="2026-09-10 14:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:21:06.469635919 +0000 UTC m=+113.061840693" watchObservedRunningTime="2026-09-10 14:21:06.470958652 +0000 UTC m=+113.063163420"
Sep 10 14:21:08.663707 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.660421    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:21:08.664595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.664571    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.667616 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.667589    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cmf5q\""
Sep 10 14:21:08.667843 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.667828    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 14:21:08.668022 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.668006    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eh42a842s9a31\""
Sep 10 14:21:08.668572 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.668552    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 14:21:08.668803 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.668761    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 14:21:08.668892 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.668866    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 14:21:08.668960 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.668912    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 14:21:08.669092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.669074    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 14:21:08.669163 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.669146    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 14:21:08.669357 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.669339    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 14:21:08.669558 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.669532    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 14:21:08.670415 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.670395    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 14:21:08.671039 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.670731    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 14:21:08.673242 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.671150    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 14:21:08.673242 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.671391    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 14:21:08.673242 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.671801    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 14:21:08.676185 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.676163    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 14:21:08.685519 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.685492    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:21:08.709961 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.709929    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710095 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710095 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710095 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710175    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710342    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710367    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710414    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710461    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc2wn\" (UniqueName: \"kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-kube-api-access-zc2wn\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710492    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710958 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.710958 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.710580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812121 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812196 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812196 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812323 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812323 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812299    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc2wn\" (UniqueName: \"kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-kube-api-access-zc2wn\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812380 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812380 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812442 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812472 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812472 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812469    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812532 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812532 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812522    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812540    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812670 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812670 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.812670 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.812621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.813200 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.813161    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.813820 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.813678    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.814929 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.814605    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.814929 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.814654    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.819857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.816493    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.819857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.817160    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.819857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.818764    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.819857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.819220    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.819857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.819320    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.819857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.819328    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.819857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.819706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.819857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.819718    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config-out\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.820318 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.820051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.820318 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.820173    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.820742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.820639    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.821551 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.821258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.821996 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.821973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.822610 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.822590    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-web-config\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.822823 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.822760    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.823975 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.823956    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc2wn\" (UniqueName: \"kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-kube-api-access-zc2wn\") pod \"prometheus-k8s-0\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:08.984292 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:08.984261    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:09.279637 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:09.279599    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:21:09.283402 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:21:09.283367    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe30309a_c7d5_47d6_b7d6_3fd5dfb0b507.slice/crio-904cf09ca7de3caedf1e32a1fcbf0b82840c45a929e26e716a1aed5f1c4fc604 WatchSource:0}: Error finding container 904cf09ca7de3caedf1e32a1fcbf0b82840c45a929e26e716a1aed5f1c4fc604: Status 404 returned error can't find the container with id 904cf09ca7de3caedf1e32a1fcbf0b82840c45a929e26e716a1aed5f1c4fc604
Sep 10 14:21:09.447751 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:09.447704    2579 generic.go:356] "Generic (PLEG): container finished" podID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerID="b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c" exitCode=0
Sep 10 14:21:09.447942 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:09.447822    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerDied","Data":"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"}
Sep 10 14:21:09.447942 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:09.447901    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerStarted","Data":"904cf09ca7de3caedf1e32a1fcbf0b82840c45a929e26e716a1aed5f1c4fc604"}
Sep 10 14:21:09.454289 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:09.454262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerStarted","Data":"2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6"}
Sep 10 14:21:09.454396 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:09.454346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerStarted","Data":"338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821"}
Sep 10 14:21:09.454396 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:09.454386    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerStarted","Data":"75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee"}
Sep 10 14:21:09.454475 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:09.454425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerStarted","Data":"bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0"}
Sep 10 14:21:09.454475 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:09.454465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerStarted","Data":"32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294"}
Sep 10 14:21:10.466015 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:10.465977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerStarted","Data":"5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c"}
Sep 10 14:21:10.496460 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:10.496405    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.044860343 podStartE2EDuration="7.496388988s" totalImagesPullingTime="4.433498031s" totalInitContainerRuntime="18.030614ms" isStatefulPod=false podCreationTimestamp="2026-09-10 14:21:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:21:10.495767251 +0000 UTC m=+117.087972033" watchObservedRunningTime="2026-09-10 14:21:10.496388988 +0000 UTC m=+117.088593799"
Sep 10 14:21:12.245638 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:12.245602    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-647f4f8798-8xdwk"]
Sep 10 14:21:12.250619 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:12.250593    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:21:20.516212 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:20.515808    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-r4bvz" event={"ID":"f2a5fa75-ef93-42d4-973c-f57f5bad88ea","Type":"ContainerStarted","Data":"ffe032063ae35029158ab07d6a4bfbf362409f26bf6004fcf379bb00ad280235"}
Sep 10 14:21:20.516212 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:20.516160    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-r4bvz"
Sep 10 14:21:20.519091 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:20.519063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerStarted","Data":"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"}
Sep 10 14:21:20.519215 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:20.519127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerStarted","Data":"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"}
Sep 10 14:21:20.532015 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:20.531983    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-r4bvz"
Sep 10 14:21:20.538217 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:20.538140    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-r4bvz" podStartSLOduration=2.041340738 podStartE2EDuration="21.538115647s" totalImagesPullingTime="19.496774909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:21:20.534712719 +0000 UTC m=+127.126917489" watchObservedRunningTime="2026-09-10 14:21:20.538115647 +0000 UTC m=+127.130320416"
Sep 10 14:21:23.538607 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:23.538568    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerStarted","Data":"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"}
Sep 10 14:21:23.539219 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:23.538657    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerStarted","Data":"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"}
Sep 10 14:21:23.539219 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:23.538699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerStarted","Data":"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"}
Sep 10 14:21:23.539219 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:23.538738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerStarted","Data":"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"}
Sep 10 14:21:23.569665 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:23.569606    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.638484129 podStartE2EDuration="15.569583433s" totalImagesPullingTime="12.908225409s" totalInitContainerRuntime="22.873895ms" isStatefulPod=false podCreationTimestamp="2026-09-10 14:21:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:21:23.566557704 +0000 UTC m=+130.158762518" watchObservedRunningTime="2026-09-10 14:21:23.569583433 +0000 UTC m=+130.161788203"
Sep 10 14:21:23.764482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:23.764435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:21:23.767306 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:23.767272    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf0343b6-f96b-4aa5-8b81-31a1c4183142-metrics-certs\") pod \"network-metrics-daemon-fdw6t\" (UID: \"cf0343b6-f96b-4aa5-8b81-31a1c4183142\") " pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:21:23.820360 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:23.820268    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c5vvv\""
Sep 10 14:21:23.827870 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:23.827838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fdw6t"
Sep 10 14:21:23.984729 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:23.984687    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:21:24.137461 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:24.137379    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fdw6t"]
Sep 10 14:21:24.140835 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:21:24.140797    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0343b6_f96b_4aa5_8b81_31a1c4183142.slice/crio-099699b84d55faea41b2ac93226c86ae9f9961883ed94b3fcf83daecd9ec9cd3 WatchSource:0}: Error finding container 099699b84d55faea41b2ac93226c86ae9f9961883ed94b3fcf83daecd9ec9cd3: Status 404 returned error can't find the container with id 099699b84d55faea41b2ac93226c86ae9f9961883ed94b3fcf83daecd9ec9cd3
Sep 10 14:21:24.545343 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:24.545292    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdw6t" event={"ID":"cf0343b6-f96b-4aa5-8b81-31a1c4183142","Type":"ContainerStarted","Data":"099699b84d55faea41b2ac93226c86ae9f9961883ed94b3fcf83daecd9ec9cd3"}
Sep 10 14:21:25.552942 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:25.552862    2579 generic.go:356] "Generic (PLEG): container finished" podID="e1d3db75-b02d-428b-8cb6-9a6577b51a42" containerID="47810ed31207791396940e095c918b787d9b29d1e8fdbc7cf78f44390d241a8f" exitCode=0
Sep 10 14:21:25.553395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:25.552951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5" event={"ID":"e1d3db75-b02d-428b-8cb6-9a6577b51a42","Type":"ContainerDied","Data":"47810ed31207791396940e095c918b787d9b29d1e8fdbc7cf78f44390d241a8f"}
Sep 10 14:21:25.553744 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:25.553718    2579 scope.go:117] "RemoveContainer" containerID="47810ed31207791396940e095c918b787d9b29d1e8fdbc7cf78f44390d241a8f"
Sep 10 14:21:26.561691 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:26.561638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdw6t" event={"ID":"cf0343b6-f96b-4aa5-8b81-31a1c4183142","Type":"ContainerStarted","Data":"9fbd966eb9e240b88220a7c29ed5b6c41ddc74d1ae1ceb2bbc093fec093168e6"}
Sep 10 14:21:26.562267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:26.561715    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fdw6t" event={"ID":"cf0343b6-f96b-4aa5-8b81-31a1c4183142","Type":"ContainerStarted","Data":"92b33e662783234ce6cbc6551fa2e2860d4b7632e9ec96dfc11101bf03edfdd1"}
Sep 10 14:21:26.563857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:26.563832    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-z8pn5" event={"ID":"e1d3db75-b02d-428b-8cb6-9a6577b51a42","Type":"ContainerStarted","Data":"0b02b5b26441999c99f0a34ed8bbaca874ccb885f47aa312df6556109ed31bde"}
Sep 10 14:21:26.604435 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:26.604369    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fdw6t" podStartSLOduration=129.92305656 podStartE2EDuration="2m11.60434775s" totalImagesPullingTime="1.68129119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:19:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:21:26.582970965 +0000 UTC m=+133.175175734" watchObservedRunningTime="2026-09-10 14:21:26.60434775 +0000 UTC m=+133.196552522"
Sep 10 14:21:31.588680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:31.588649    2579 generic.go:356] "Generic (PLEG): container finished" podID="c1275791-9f56-4136-a9c9-90f542081308" containerID="0c6d8971837f4a85cb7ae55cdc495cafa58642328a77873ce151f12ed885ed62" exitCode=0
Sep 10 14:21:31.589166 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:31.588725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv" event={"ID":"c1275791-9f56-4136-a9c9-90f542081308","Type":"ContainerDied","Data":"0c6d8971837f4a85cb7ae55cdc495cafa58642328a77873ce151f12ed885ed62"}
Sep 10 14:21:31.589166 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:31.589034    2579 scope.go:117] "RemoveContainer" containerID="0c6d8971837f4a85cb7ae55cdc495cafa58642328a77873ce151f12ed885ed62"
Sep 10 14:21:32.595622 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:32.595586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-mpsrv" event={"ID":"c1275791-9f56-4136-a9c9-90f542081308","Type":"ContainerStarted","Data":"a33a75062c6eb427c1e62704ddb1f76a8d104ba18956876c421b248b712ea356"}
Sep 10 14:21:37.269446 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.269397    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk" podUID="49c43416-4eff-4a7c-b551-17d7c6e9aa00" containerName="registry" containerID="cri-o://3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe" gracePeriod=30
Sep 10 14:21:37.548737 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.548654    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:21:37.603248 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.603210    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") pod \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") "
Sep 10 14:21:37.603248 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.603249    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-image-registry-private-configuration\") pod \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") "
Sep 10 14:21:37.603477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.603271    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-certificates\") pod \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") "
Sep 10 14:21:37.603477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.603342    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-trusted-ca\") pod \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") "
Sep 10 14:21:37.603477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.603388    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49c43416-4eff-4a7c-b551-17d7c6e9aa00-ca-trust-extracted\") pod \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") "
Sep 10 14:21:37.603477 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.603436    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-bound-sa-token\") pod \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") "
Sep 10 14:21:37.603672 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.603492    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfz7j\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-kube-api-access-lfz7j\") pod \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") "
Sep 10 14:21:37.603672 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.603542    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-installation-pull-secrets\") pod \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\" (UID: \"49c43416-4eff-4a7c-b551-17d7c6e9aa00\") "
Sep 10 14:21:37.603880 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.603848    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "49c43416-4eff-4a7c-b551-17d7c6e9aa00" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:21:37.603975 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.603876    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "49c43416-4eff-4a7c-b551-17d7c6e9aa00" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:21:37.605908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.605884    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "49c43416-4eff-4a7c-b551-17d7c6e9aa00" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:21:37.606077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.606048    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "49c43416-4eff-4a7c-b551-17d7c6e9aa00" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:21:37.606382 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.606345    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "49c43416-4eff-4a7c-b551-17d7c6e9aa00" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:21:37.606543 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.606524    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "49c43416-4eff-4a7c-b551-17d7c6e9aa00" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:21:37.606592 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.606568    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-kube-api-access-lfz7j" (OuterVolumeSpecName: "kube-api-access-lfz7j") pod "49c43416-4eff-4a7c-b551-17d7c6e9aa00" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00"). InnerVolumeSpecName "kube-api-access-lfz7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:21:37.612737 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.612703    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49c43416-4eff-4a7c-b551-17d7c6e9aa00-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "49c43416-4eff-4a7c-b551-17d7c6e9aa00" (UID: "49c43416-4eff-4a7c-b551-17d7c6e9aa00"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:21:37.618957 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.618929    2579 generic.go:356] "Generic (PLEG): container finished" podID="49c43416-4eff-4a7c-b551-17d7c6e9aa00" containerID="3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe" exitCode=0
Sep 10 14:21:37.619052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.618980    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk"
Sep 10 14:21:37.619052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.619003    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk" event={"ID":"49c43416-4eff-4a7c-b551-17d7c6e9aa00","Type":"ContainerDied","Data":"3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe"}
Sep 10 14:21:37.619126 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.619054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-647f4f8798-8xdwk" event={"ID":"49c43416-4eff-4a7c-b551-17d7c6e9aa00","Type":"ContainerDied","Data":"00228d7bd03d0719b99598864a7ed686aa4f19a2bfcb292c45b13e23e0261a05"}
Sep 10 14:21:37.619126 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.619074    2579 scope.go:117] "RemoveContainer" containerID="3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe"
Sep 10 14:21:37.628078 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.628060    2579 scope.go:117] "RemoveContainer" containerID="3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe"
Sep 10 14:21:37.628398 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:21:37.628377    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe\": container with ID starting with 3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe not found: ID does not exist" containerID="3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe"
Sep 10 14:21:37.628447 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.628407    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe"} err="failed to get container status \"3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe\": rpc error: code = NotFound desc = could not find container \"3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe\": container with ID starting with 3214d1f71c36859aaa93d0cfd99b8656dd9dd71db93c10276da684ad21b1dbbe not found: ID does not exist"
Sep 10 14:21:37.639526 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.639500    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-647f4f8798-8xdwk"]
Sep 10 14:21:37.647147 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.647120    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-647f4f8798-8xdwk"]
Sep 10 14:21:37.704876 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.704843    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-installation-pull-secrets\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:21:37.704876 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.704872    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:21:37.705077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.704885    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49c43416-4eff-4a7c-b551-17d7c6e9aa00-image-registry-private-configuration\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:21:37.705077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.704896    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-registry-certificates\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:21:37.705077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.704905    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49c43416-4eff-4a7c-b551-17d7c6e9aa00-trusted-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:21:37.705077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.704914    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49c43416-4eff-4a7c-b551-17d7c6e9aa00-ca-trust-extracted\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:21:37.705077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.704921    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-bound-sa-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:21:37.705077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.704929    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfz7j\" (UniqueName: \"kubernetes.io/projected/49c43416-4eff-4a7c-b551-17d7c6e9aa00-kube-api-access-lfz7j\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:21:37.912951 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:37.912876    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49c43416-4eff-4a7c-b551-17d7c6e9aa00" path="/var/lib/kubelet/pods/49c43416-4eff-4a7c-b551-17d7c6e9aa00/volumes"
Sep 10 14:21:40.634514 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:40.634429    2579 generic.go:356] "Generic (PLEG): container finished" podID="b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a" containerID="d479e4c32d790e26e2fd2a8b2224c0214ae76917f9df3f439d621eae33cc3758" exitCode=0
Sep 10 14:21:40.634514 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:40.634500    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp" event={"ID":"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a","Type":"ContainerDied","Data":"d479e4c32d790e26e2fd2a8b2224c0214ae76917f9df3f439d621eae33cc3758"}
Sep 10 14:21:40.634934 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:40.634908    2579 scope.go:117] "RemoveContainer" containerID="d479e4c32d790e26e2fd2a8b2224c0214ae76917f9df3f439d621eae33cc3758"
Sep 10 14:21:41.127496 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:41.127466    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56968c8f6-wb7q7_3d0eff48-1682-45f1-a3c4-2f2f0a8f4732/router/0.log"
Sep 10 14:21:41.139253 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:41.139224    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f5nfm_fb89e2d9-8063-41da-a44c-7fb3ab0ae983/serve-healthcheck-canary/0.log"
Sep 10 14:21:41.641731 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:21:41.641699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-z58wp" event={"ID":"b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a","Type":"ContainerStarted","Data":"62da8aa31a5cfbaa5bde69a3f510f98347e153b1d69d9449fba5d7f166165772"}
Sep 10 14:22:08.985053 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:08.984953    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:09.001745 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:09.001715    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:09.787034 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:09.787003    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:22.800126 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:22.800087    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:22:22.800505 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:22.800422    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="alertmanager" containerID="cri-o://32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294" gracePeriod=120
Sep 10 14:22:22.800577 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:22.800494    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy-web" containerID="cri-o://75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee" gracePeriod=120
Sep 10 14:22:22.800577 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:22.800542    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="prom-label-proxy" containerID="cri-o://5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c" gracePeriod=120
Sep 10 14:22:22.800577 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:22.800540    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="config-reloader" containerID="cri-o://bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0" gracePeriod=120
Sep 10 14:22:22.800742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:22.800502    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy" containerID="cri-o://338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821" gracePeriod=120
Sep 10 14:22:22.800742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:22.800490    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy-metric" containerID="cri-o://2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6" gracePeriod=120
Sep 10 14:22:23.835417 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:23.835385    2579 generic.go:356] "Generic (PLEG): container finished" podID="878d024f-74c8-40ba-8621-f336fa83527a" containerID="5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c" exitCode=0
Sep 10 14:22:23.835417 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:23.835410    2579 generic.go:356] "Generic (PLEG): container finished" podID="878d024f-74c8-40ba-8621-f336fa83527a" containerID="338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821" exitCode=0
Sep 10 14:22:23.835417 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:23.835418    2579 generic.go:356] "Generic (PLEG): container finished" podID="878d024f-74c8-40ba-8621-f336fa83527a" containerID="bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0" exitCode=0
Sep 10 14:22:23.835417 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:23.835424    2579 generic.go:356] "Generic (PLEG): container finished" podID="878d024f-74c8-40ba-8621-f336fa83527a" containerID="32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294" exitCode=0
Sep 10 14:22:23.835935 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:23.835456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerDied","Data":"5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c"}
Sep 10 14:22:23.835935 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:23.835506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerDied","Data":"338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821"}
Sep 10 14:22:23.835935 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:23.835531    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerDied","Data":"bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0"}
Sep 10 14:22:23.835935 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:23.835556    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerDied","Data":"32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294"}
Sep 10 14:22:24.043485 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.043431    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:22:24.116982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.116896    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-web\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.116982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.116936    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-cluster-tls-config\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.116982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.116972    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-config-volume\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.117249 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117092    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-main-tls\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.117249 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117135    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-metrics-client-ca\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.117249 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117166    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8cgd\" (UniqueName: \"kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-kube-api-access-q8cgd\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.117249 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117200    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-config-out\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.117249 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117248    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-trusted-ca-bundle\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.117511 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117301    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-tls-assets\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.117511 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117329    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-main-db\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.117511 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117374    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.117511 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117403    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-web-config\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.117511 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117427    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy\") pod \"878d024f-74c8-40ba-8621-f336fa83527a\" (UID: \"878d024f-74c8-40ba-8621-f336fa83527a\") "
Sep 10 14:22:24.117948 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117565    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:22:24.117948 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.117729    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-metrics-client-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.118501 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.118176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:22:24.118703 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.118549    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:22:24.121140 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.121106    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:24.121277 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.121215    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-config-volume" (OuterVolumeSpecName: "config-volume") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:24.121466 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.121432    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:22:24.121987 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.121944    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:24.122094 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.122064    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:24.122540 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.122512    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-config-out" (OuterVolumeSpecName: "config-out") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:22:24.122653 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.122591    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-kube-api-access-q8cgd" (OuterVolumeSpecName: "kube-api-access-q8cgd") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "kube-api-access-q8cgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:22:24.122719 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.122646    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:24.127050 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.127021    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:24.135295 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.135266    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-web-config" (OuterVolumeSpecName: "web-config") pod "878d024f-74c8-40ba-8621-f336fa83527a" (UID: "878d024f-74c8-40ba-8621-f336fa83527a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:24.218310 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218279    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.218310 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218308    2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-cluster-tls-config\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.218482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218317    2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.218482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218327    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-main-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.218482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218336    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8cgd\" (UniqueName: \"kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-kube-api-access-q8cgd\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.218482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218344    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-config-out\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.218482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218352    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.218482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218361    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/878d024f-74c8-40ba-8621-f336fa83527a-tls-assets\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.218482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218370    2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/878d024f-74c8-40ba-8621-f336fa83527a-alertmanager-main-db\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.218482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218380    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.218482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218389    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-web-config\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.218482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.218396    2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/878d024f-74c8-40ba-8621-f336fa83527a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:24.843286 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.843240    2579 generic.go:356] "Generic (PLEG): container finished" podID="878d024f-74c8-40ba-8621-f336fa83527a" containerID="2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6" exitCode=0
Sep 10 14:22:24.843286 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.843267    2579 generic.go:356] "Generic (PLEG): container finished" podID="878d024f-74c8-40ba-8621-f336fa83527a" containerID="75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee" exitCode=0
Sep 10 14:22:24.843950 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.843330    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerDied","Data":"2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6"}
Sep 10 14:22:24.843950 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.843347    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 10 14:22:24.843950 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.843430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerDied","Data":"75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee"}
Sep 10 14:22:24.843950 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.843457    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"878d024f-74c8-40ba-8621-f336fa83527a","Type":"ContainerDied","Data":"0e0bb6030ffd9330ec767dcb3b519d615ddce7d486887ddd8fa773af8790759c"}
Sep 10 14:22:24.843950 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.843489    2579 scope.go:117] "RemoveContainer" containerID="5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c"
Sep 10 14:22:24.855747 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.855726    2579 scope.go:117] "RemoveContainer" containerID="2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6"
Sep 10 14:22:24.865318 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.865293    2579 scope.go:117] "RemoveContainer" containerID="338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821"
Sep 10 14:22:24.872449 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.872431    2579 scope.go:117] "RemoveContainer" containerID="75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee"
Sep 10 14:22:24.877113 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.877085    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:22:24.881126 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.881089    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 10 14:22:24.882292 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.882275    2579 scope.go:117] "RemoveContainer" containerID="bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0"
Sep 10 14:22:24.890414 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.890392    2579 scope.go:117] "RemoveContainer" containerID="32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294"
Sep 10 14:22:24.898708 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.898685    2579 scope.go:117] "RemoveContainer" containerID="d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7"
Sep 10 14:22:24.909597 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.909575    2579 scope.go:117] "RemoveContainer" containerID="5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c"
Sep 10 14:22:24.909983 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:24.909965    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c\": container with ID starting with 5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c not found: ID does not exist" containerID="5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c"
Sep 10 14:22:24.910036 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.909990    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c"} err="failed to get container status \"5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c\": rpc error: code = NotFound desc = could not find container \"5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c\": container with ID starting with 5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c not found: ID does not exist"
Sep 10 14:22:24.910036 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.910011    2579 scope.go:117] "RemoveContainer" containerID="2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6"
Sep 10 14:22:24.910290 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:24.910270    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6\": container with ID starting with 2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6 not found: ID does not exist" containerID="2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6"
Sep 10 14:22:24.910359 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.910302    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6"} err="failed to get container status \"2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6\": rpc error: code = NotFound desc = could not find container \"2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6\": container with ID starting with 2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6 not found: ID does not exist"
Sep 10 14:22:24.910359 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.910325    2579 scope.go:117] "RemoveContainer" containerID="338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821"
Sep 10 14:22:24.910612 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:24.910596    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821\": container with ID starting with 338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821 not found: ID does not exist" containerID="338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821"
Sep 10 14:22:24.910652 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.910618    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821"} err="failed to get container status \"338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821\": rpc error: code = NotFound desc = could not find container \"338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821\": container with ID starting with 338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821 not found: ID does not exist"
Sep 10 14:22:24.910652 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.910631    2579 scope.go:117] "RemoveContainer" containerID="75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee"
Sep 10 14:22:24.910868 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:24.910852    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee\": container with ID starting with 75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee not found: ID does not exist" containerID="75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee"
Sep 10 14:22:24.910926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.910872    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee"} err="failed to get container status \"75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee\": rpc error: code = NotFound desc = could not find container \"75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee\": container with ID starting with 75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee not found: ID does not exist"
Sep 10 14:22:24.910926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.910884    2579 scope.go:117] "RemoveContainer" containerID="bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0"
Sep 10 14:22:24.911111 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:24.911094    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0\": container with ID starting with bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0 not found: ID does not exist" containerID="bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0"
Sep 10 14:22:24.911175 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.911119    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0"} err="failed to get container status \"bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0\": rpc error: code = NotFound desc = could not find container \"bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0\": container with ID starting with bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0 not found: ID does not exist"
Sep 10 14:22:24.911175 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.911138    2579 scope.go:117] "RemoveContainer" containerID="32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294"
Sep 10 14:22:24.911372 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:24.911357    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294\": container with ID starting with 32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294 not found: ID does not exist" containerID="32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294"
Sep 10 14:22:24.911429 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.911375    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294"} err="failed to get container status \"32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294\": rpc error: code = NotFound desc = could not find container \"32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294\": container with ID starting with 32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294 not found: ID does not exist"
Sep 10 14:22:24.911429 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.911387    2579 scope.go:117] "RemoveContainer" containerID="d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7"
Sep 10 14:22:24.911655 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:24.911639    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7\": container with ID starting with d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7 not found: ID does not exist" containerID="d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7"
Sep 10 14:22:24.911711 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.911660    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7"} err="failed to get container status \"d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7\": rpc error: code = NotFound desc = could not find container \"d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7\": container with ID starting with d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7 not found: ID does not exist"
Sep 10 14:22:24.911711 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.911674    2579 scope.go:117] "RemoveContainer" containerID="5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c"
Sep 10 14:22:24.911905 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.911886    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c"} err="failed to get container status \"5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c\": rpc error: code = NotFound desc = could not find container \"5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c\": container with ID starting with 5fb619c8364368756e7d1a8fca2ff9b9a993b6f67f53fadc0cae184441749a6c not found: ID does not exist"
Sep 10 14:22:24.911979 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.911908    2579 scope.go:117] "RemoveContainer" containerID="2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6"
Sep 10 14:22:24.912101 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.912084    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6"} err="failed to get container status \"2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6\": rpc error: code = NotFound desc = could not find container \"2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6\": container with ID starting with 2b375724144aa70213f076692da99f87929dda070f1943700ff5b44ac5fea4d6 not found: ID does not exist"
Sep 10 14:22:24.912151 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.912101    2579 scope.go:117] "RemoveContainer" containerID="338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821"
Sep 10 14:22:24.912288 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.912270    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821"} err="failed to get container status \"338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821\": rpc error: code = NotFound desc = could not find container \"338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821\": container with ID starting with 338b40ff28892fd96f2f5dccfdf9258f33b913b8cbb3b63c0728c369da1e9821 not found: ID does not exist"
Sep 10 14:22:24.912353 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.912288    2579 scope.go:117] "RemoveContainer" containerID="75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee"
Sep 10 14:22:24.912533 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.912518    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee"} err="failed to get container status \"75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee\": rpc error: code = NotFound desc = could not find container \"75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee\": container with ID starting with 75ceae63cdac9d48772677cb27d253fe554f74d7755308e5b6448fa1644a74ee not found: ID does not exist"
Sep 10 14:22:24.912590 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.912533    2579 scope.go:117] "RemoveContainer" containerID="bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0"
Sep 10 14:22:24.912743 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.912728    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0"} err="failed to get container status \"bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0\": rpc error: code = NotFound desc = could not find container \"bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0\": container with ID starting with bdb18fde5a3e854d8a258648894a4ff997f43e543292305a532d85ed26f645d0 not found: ID does not exist"
Sep 10 14:22:24.912743 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.912742    2579 scope.go:117] "RemoveContainer" containerID="32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294"
Sep 10 14:22:24.913008 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.912991    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294"} err="failed to get container status \"32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294\": rpc error: code = NotFound desc = could not find container \"32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294\": container with ID starting with 32940552d447825494fed380ef99a2c4ae1ef847dd0e7f6765ddbcebebc18294 not found: ID does not exist"
Sep 10 14:22:24.913078 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.913010    2579 scope.go:117] "RemoveContainer" containerID="d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7"
Sep 10 14:22:24.913231 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:24.913214    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7"} err="failed to get container status \"d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7\": rpc error: code = NotFound desc = could not find container \"d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7\": container with ID starting with d7e7fa7000797154bc94e23018be5709504a76bbd7a8edde8253711a5ffe38a7 not found: ID does not exist"
Sep 10 14:22:25.911518 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:25.911481    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="878d024f-74c8-40ba-8621-f336fa83527a" path="/var/lib/kubelet/pods/878d024f-74c8-40ba-8621-f336fa83527a/volumes"
Sep 10 14:22:27.029662 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.029623    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:22:27.030111 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.029921    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="prometheus" containerID="cri-o://5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b" gracePeriod=600
Sep 10 14:22:27.030111 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.029959    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy" containerID="cri-o://f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1" gracePeriod=600
Sep 10 14:22:27.030111 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.029978    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="thanos-sidecar" containerID="cri-o://a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d" gracePeriod=600
Sep 10 14:22:27.030111 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.029984    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy-web" containerID="cri-o://1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29" gracePeriod=600
Sep 10 14:22:27.030111 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.030035    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="config-reloader" containerID="cri-o://65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6" gracePeriod=600
Sep 10 14:22:27.030334 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.030035    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy-thanos" containerID="cri-o://34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6" gracePeriod=600
Sep 10 14:22:27.289284 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.289260    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.344210 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344181    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-0\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344210 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344216    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-web-config\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344457 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344240    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344457 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344266    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-db\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344457 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344294    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-trusted-ca-bundle\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344457 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344329    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344457 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344372    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-metrics-client-certs\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344457 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344402    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-kube-rbac-proxy\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344457 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344425    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344457 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344448    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-2\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344472    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-metrics-client-ca\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344509    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-serving-certs-ca-bundle\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344531    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-tls-assets\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344561    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc2wn\" (UniqueName: \"kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-kube-api-access-zc2wn\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344593    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-grpc-tls\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344641    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-kubelet-serving-ca-bundle\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344678    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config-out\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344704    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-tls\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344728    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-1\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.344861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344748    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:22:27.344861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.344760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-thanos-prometheus-http-client-file\") pod \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\" (UID: \"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507\") "
Sep 10 14:22:27.345369 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.345188    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.345369 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.345306    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:22:27.346302 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.345687    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:22:27.346504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.346471    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:22:27.347609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.346811    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:22:27.347609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.346909    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:22:27.347609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.346963    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:22:27.347609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.347562    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:22:27.348022 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.347867    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:27.348224 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.348198    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:27.348514 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.348462    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config" (OuterVolumeSpecName: "config") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:27.349184 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.349155    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:27.350347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.350310    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:27.350446 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.350406    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:22:27.350701 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.350674    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-kube-api-access-zc2wn" (OuterVolumeSpecName: "kube-api-access-zc2wn") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "kube-api-access-zc2wn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:22:27.350862 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.350842    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:27.350976 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.350860    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config-out" (OuterVolumeSpecName: "config-out") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:22:27.351243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.351224    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:27.351311 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.351292    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:27.359276 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.359251    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-web-config" (OuterVolumeSpecName: "web-config") pod "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" (UID: "fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:22:27.446146 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446105    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446146 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446139    2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-web-config\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446146 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446150    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446146 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446159    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-db\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446168    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446177    2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-metrics-client-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446185    2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-kube-rbac-proxy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446193    2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446202    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446211    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-metrics-client-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446219    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446227    2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-tls-assets\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446235    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc2wn\" (UniqueName: \"kubernetes.io/projected/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-kube-api-access-zc2wn\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446243    2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-grpc-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446251    2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446258    2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-config-out\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446266    2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446274    2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.446406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.446283    2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:22:27.858918 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.858883    2579 generic.go:356] "Generic (PLEG): container finished" podID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerID="34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6" exitCode=0
Sep 10 14:22:27.858918 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.858908    2579 generic.go:356] "Generic (PLEG): container finished" podID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerID="f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1" exitCode=0
Sep 10 14:22:27.858918 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.858915    2579 generic.go:356] "Generic (PLEG): container finished" podID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerID="1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29" exitCode=0
Sep 10 14:22:27.858918 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.858921    2579 generic.go:356] "Generic (PLEG): container finished" podID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerID="a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d" exitCode=0
Sep 10 14:22:27.858918 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.858927    2579 generic.go:356] "Generic (PLEG): container finished" podID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerID="65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6" exitCode=0
Sep 10 14:22:27.859208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.858932    2579 generic.go:356] "Generic (PLEG): container finished" podID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerID="5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b" exitCode=0
Sep 10 14:22:27.859208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.858960    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.859208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.858959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerDied","Data":"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"}
Sep 10 14:22:27.859208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.859032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerDied","Data":"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"}
Sep 10 14:22:27.859208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.859062    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerDied","Data":"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"}
Sep 10 14:22:27.859208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.859086    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerDied","Data":"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"}
Sep 10 14:22:27.859208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.859098    2579 scope.go:117] "RemoveContainer" containerID="34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"
Sep 10 14:22:27.859208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.859111    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerDied","Data":"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"}
Sep 10 14:22:27.859208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.859135    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerDied","Data":"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"}
Sep 10 14:22:27.859208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.859159    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507","Type":"ContainerDied","Data":"904cf09ca7de3caedf1e32a1fcbf0b82840c45a929e26e716a1aed5f1c4fc604"}
Sep 10 14:22:27.868020 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.868002    2579 scope.go:117] "RemoveContainer" containerID="f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"
Sep 10 14:22:27.875286 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.875268    2579 scope.go:117] "RemoveContainer" containerID="1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"
Sep 10 14:22:27.883556 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.883508    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:22:27.884406 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.884362    2579 scope.go:117] "RemoveContainer" containerID="a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"
Sep 10 14:22:27.885970 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.885949    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:22:27.892134 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.892115    2579 scope.go:117] "RemoveContainer" containerID="65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"
Sep 10 14:22:27.899254 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.899237    2579 scope.go:117] "RemoveContainer" containerID="5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"
Sep 10 14:22:27.906903 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.906880    2579 scope.go:117] "RemoveContainer" containerID="b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"
Sep 10 14:22:27.912220 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.912132    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" path="/var/lib/kubelet/pods/fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507/volumes"
Sep 10 14:22:27.915702 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.915658    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:22:27.916346 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916324    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy-web"
Sep 10 14:22:27.916433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916351    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy-web"
Sep 10 14:22:27.916433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916368    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="prometheus"
Sep 10 14:22:27.916433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916383    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="prometheus"
Sep 10 14:22:27.916433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916394    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="config-reloader"
Sep 10 14:22:27.916433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916403    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="config-reloader"
Sep 10 14:22:27.916433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916425    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="prom-label-proxy"
Sep 10 14:22:27.916433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916433    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="prom-label-proxy"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916447    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49c43416-4eff-4a7c-b551-17d7c6e9aa00" containerName="registry"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916461    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="49c43416-4eff-4a7c-b551-17d7c6e9aa00" containerName="registry"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916474    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="alertmanager"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916481    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="alertmanager"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916498    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="init-config-reloader"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916505    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="init-config-reloader"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916520    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="config-reloader"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916528    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="config-reloader"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916537    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916545    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916561    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916568    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916576    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy-thanos"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916585    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy-thanos"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916605    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy-web"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916613    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy-web"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916629    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="thanos-sidecar"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916636    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="thanos-sidecar"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916575    2579 scope.go:117] "RemoveContainer" containerID="34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916647    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy-metric"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916756    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy-metric"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916806    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="init-config-reloader"
Sep 10 14:22:27.916813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916817    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="init-config-reloader"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916971    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy-metric"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916988    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="prometheus"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.916998    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="config-reloader"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.917013    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="config-reloader"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.917023    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="49c43416-4eff-4a7c-b551-17d7c6e9aa00" containerName="registry"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.917038    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.917049    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy-web"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.917065    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="thanos-sidecar"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.917074    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy-web"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.917081    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="alertmanager"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.917096    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="prom-label-proxy"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.917106    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe30309a-c7d5-47d6-b7d6-3fd5dfb0b507" containerName="kube-rbac-proxy-thanos"
Sep 10 14:22:27.917774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.917113    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="878d024f-74c8-40ba-8621-f336fa83527a" containerName="kube-rbac-proxy"
Sep 10 14:22:27.920537 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:27.920504    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": container with ID starting with 34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6 not found: ID does not exist" containerID="34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"
Sep 10 14:22:27.920644 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.920549    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"} err="failed to get container status \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": rpc error: code = NotFound desc = could not find container \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": container with ID starting with 34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6 not found: ID does not exist"
Sep 10 14:22:27.920644 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.920576    2579 scope.go:117] "RemoveContainer" containerID="f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"
Sep 10 14:22:27.920986 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:27.920962    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": container with ID starting with f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1 not found: ID does not exist" containerID="f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"
Sep 10 14:22:27.921064 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.920998    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"} err="failed to get container status \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": rpc error: code = NotFound desc = could not find container \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": container with ID starting with f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1 not found: ID does not exist"
Sep 10 14:22:27.921064 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.921021    2579 scope.go:117] "RemoveContainer" containerID="1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"
Sep 10 14:22:27.921334 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:27.921312    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": container with ID starting with 1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29 not found: ID does not exist" containerID="1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"
Sep 10 14:22:27.921395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.921342    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"} err="failed to get container status \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": rpc error: code = NotFound desc = could not find container \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": container with ID starting with 1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29 not found: ID does not exist"
Sep 10 14:22:27.921395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.921372    2579 scope.go:117] "RemoveContainer" containerID="a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"
Sep 10 14:22:27.921653 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:27.921635    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": container with ID starting with a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d not found: ID does not exist" containerID="a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"
Sep 10 14:22:27.921699 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.921661    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"} err="failed to get container status \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": rpc error: code = NotFound desc = could not find container \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": container with ID starting with a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d not found: ID does not exist"
Sep 10 14:22:27.921699 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.921676    2579 scope.go:117] "RemoveContainer" containerID="65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"
Sep 10 14:22:27.921993 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:27.921970    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": container with ID starting with 65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6 not found: ID does not exist" containerID="65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"
Sep 10 14:22:27.922055 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.922001    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"} err="failed to get container status \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": rpc error: code = NotFound desc = could not find container \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": container with ID starting with 65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6 not found: ID does not exist"
Sep 10 14:22:27.922055 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.922020    2579 scope.go:117] "RemoveContainer" containerID="5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"
Sep 10 14:22:27.922313 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:27.922291    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": container with ID starting with 5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b not found: ID does not exist" containerID="5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"
Sep 10 14:22:27.922404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.922314    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"} err="failed to get container status \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": rpc error: code = NotFound desc = could not find container \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": container with ID starting with 5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b not found: ID does not exist"
Sep 10 14:22:27.922404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.922328    2579 scope.go:117] "RemoveContainer" containerID="b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"
Sep 10 14:22:27.922677 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:22:27.922646    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": container with ID starting with b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c not found: ID does not exist" containerID="b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"
Sep 10 14:22:27.922726 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.922696    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"} err="failed to get container status \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": rpc error: code = NotFound desc = could not find container \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": container with ID starting with b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c not found: ID does not exist"
Sep 10 14:22:27.922759 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.922729    2579 scope.go:117] "RemoveContainer" containerID="34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"
Sep 10 14:22:27.923116 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.923087    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"} err="failed to get container status \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": rpc error: code = NotFound desc = could not find container \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": container with ID starting with 34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6 not found: ID does not exist"
Sep 10 14:22:27.923199 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.923121    2579 scope.go:117] "RemoveContainer" containerID="f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"
Sep 10 14:22:27.923292 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.923269    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.923706 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.923481    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"} err="failed to get container status \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": rpc error: code = NotFound desc = could not find container \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": container with ID starting with f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1 not found: ID does not exist"
Sep 10 14:22:27.923706 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.923504    2579 scope.go:117] "RemoveContainer" containerID="1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"
Sep 10 14:22:27.923977 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.923953    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"} err="failed to get container status \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": rpc error: code = NotFound desc = could not find container \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": container with ID starting with 1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29 not found: ID does not exist"
Sep 10 14:22:27.923977 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.923977    2579 scope.go:117] "RemoveContainer" containerID="a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"
Sep 10 14:22:27.924243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.924225    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"} err="failed to get container status \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": rpc error: code = NotFound desc = could not find container \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": container with ID starting with a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d not found: ID does not exist"
Sep 10 14:22:27.924243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.924241    2579 scope.go:117] "RemoveContainer" containerID="65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"
Sep 10 14:22:27.924481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.924461    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"} err="failed to get container status \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": rpc error: code = NotFound desc = could not find container \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": container with ID starting with 65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6 not found: ID does not exist"
Sep 10 14:22:27.924481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.924479    2579 scope.go:117] "RemoveContainer" containerID="5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"
Sep 10 14:22:27.924717 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.924697    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"} err="failed to get container status \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": rpc error: code = NotFound desc = could not find container \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": container with ID starting with 5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b not found: ID does not exist"
Sep 10 14:22:27.924773 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.924719    2579 scope.go:117] "RemoveContainer" containerID="b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"
Sep 10 14:22:27.924991 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.924973    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"} err="failed to get container status \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": rpc error: code = NotFound desc = could not find container \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": container with ID starting with b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c not found: ID does not exist"
Sep 10 14:22:27.924991 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.924990    2579 scope.go:117] "RemoveContainer" containerID="34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"
Sep 10 14:22:27.925227 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.925207    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"} err="failed to get container status \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": rpc error: code = NotFound desc = could not find container \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": container with ID starting with 34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6 not found: ID does not exist"
Sep 10 14:22:27.925227 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.925227    2579 scope.go:117] "RemoveContainer" containerID="f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"
Sep 10 14:22:27.925464 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.925444    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"} err="failed to get container status \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": rpc error: code = NotFound desc = could not find container \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": container with ID starting with f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1 not found: ID does not exist"
Sep 10 14:22:27.925464 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.925463    2579 scope.go:117] "RemoveContainer" containerID="1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"
Sep 10 14:22:27.925714 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.925697    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"} err="failed to get container status \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": rpc error: code = NotFound desc = could not find container \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": container with ID starting with 1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29 not found: ID does not exist"
Sep 10 14:22:27.925714 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.925712    2579 scope.go:117] "RemoveContainer" containerID="a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"
Sep 10 14:22:27.926024 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926002    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"} err="failed to get container status \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": rpc error: code = NotFound desc = could not find container \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": container with ID starting with a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d not found: ID does not exist"
Sep 10 14:22:27.926088 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926024    2579 scope.go:117] "RemoveContainer" containerID="65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"
Sep 10 14:22:27.926134 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926120    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 14:22:27.926194 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926126    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 14:22:27.926243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926200    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 14:22:27.926354 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926324    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"} err="failed to get container status \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": rpc error: code = NotFound desc = could not find container \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": container with ID starting with 65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6 not found: ID does not exist"
Sep 10 14:22:27.926433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926356    2579 scope.go:117] "RemoveContainer" containerID="5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"
Sep 10 14:22:27.926665 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926644    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"} err="failed to get container status \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": rpc error: code = NotFound desc = could not find container \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": container with ID starting with 5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b not found: ID does not exist"
Sep 10 14:22:27.926745 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926665    2579 scope.go:117] "RemoveContainer" containerID="b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"
Sep 10 14:22:27.926745 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926688    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 14:22:27.926939 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926921    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 14:22:27.927008 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.926959    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 14:22:27.927083 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927058    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"} err="failed to get container status \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": rpc error: code = NotFound desc = could not find container \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": container with ID starting with b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c not found: ID does not exist"
Sep 10 14:22:27.927142 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927086    2579 scope.go:117] "RemoveContainer" containerID="34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"
Sep 10 14:22:27.927142 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927084    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cmf5q\""
Sep 10 14:22:27.927142 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927074    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 14:22:27.927288 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927143    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 14:22:27.927288 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927113    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 14:22:27.927288 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927253    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eh42a842s9a31\""
Sep 10 14:22:27.927288 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927266    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 14:22:27.927471 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927359    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 14:22:27.927471 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927384    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"} err="failed to get container status \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": rpc error: code = NotFound desc = could not find container \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": container with ID starting with 34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6 not found: ID does not exist"
Sep 10 14:22:27.927471 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927406    2579 scope.go:117] "RemoveContainer" containerID="f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"
Sep 10 14:22:27.927613 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927572    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 14:22:27.927662 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927630    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"} err="failed to get container status \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": rpc error: code = NotFound desc = could not find container \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": container with ID starting with f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1 not found: ID does not exist"
Sep 10 14:22:27.927662 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927647    2579 scope.go:117] "RemoveContainer" containerID="1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"
Sep 10 14:22:27.927899 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927884    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 14:22:27.927970 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927891    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"} err="failed to get container status \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": rpc error: code = NotFound desc = could not find container \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": container with ID starting with 1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29 not found: ID does not exist"
Sep 10 14:22:27.927970 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.927921    2579 scope.go:117] "RemoveContainer" containerID="a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"
Sep 10 14:22:27.928233 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.928202    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"} err="failed to get container status \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": rpc error: code = NotFound desc = could not find container \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": container with ID starting with a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d not found: ID does not exist"
Sep 10 14:22:27.928233 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.928227    2579 scope.go:117] "RemoveContainer" containerID="65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"
Sep 10 14:22:27.928508 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.928489    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"} err="failed to get container status \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": rpc error: code = NotFound desc = could not find container \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": container with ID starting with 65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6 not found: ID does not exist"
Sep 10 14:22:27.928584 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.928510    2579 scope.go:117] "RemoveContainer" containerID="5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"
Sep 10 14:22:27.928831 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.928771    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"} err="failed to get container status \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": rpc error: code = NotFound desc = could not find container \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": container with ID starting with 5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b not found: ID does not exist"
Sep 10 14:22:27.928831 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.928831    2579 scope.go:117] "RemoveContainer" containerID="b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"
Sep 10 14:22:27.929089 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.929071    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"} err="failed to get container status \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": rpc error: code = NotFound desc = could not find container \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": container with ID starting with b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c not found: ID does not exist"
Sep 10 14:22:27.929089 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.929090    2579 scope.go:117] "RemoveContainer" containerID="34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"
Sep 10 14:22:27.929344 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.929326    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"} err="failed to get container status \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": rpc error: code = NotFound desc = could not find container \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": container with ID starting with 34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6 not found: ID does not exist"
Sep 10 14:22:27.929344 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.929344    2579 scope.go:117] "RemoveContainer" containerID="f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"
Sep 10 14:22:27.929680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.929623    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"} err="failed to get container status \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": rpc error: code = NotFound desc = could not find container \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": container with ID starting with f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1 not found: ID does not exist"
Sep 10 14:22:27.929680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.929652    2579 scope.go:117] "RemoveContainer" containerID="1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"
Sep 10 14:22:27.930027 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.929932    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"} err="failed to get container status \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": rpc error: code = NotFound desc = could not find container \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": container with ID starting with 1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29 not found: ID does not exist"
Sep 10 14:22:27.930027 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.929951    2579 scope.go:117] "RemoveContainer" containerID="a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"
Sep 10 14:22:27.930253 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.930230    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"} err="failed to get container status \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": rpc error: code = NotFound desc = could not find container \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": container with ID starting with a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d not found: ID does not exist"
Sep 10 14:22:27.930301 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.930256    2579 scope.go:117] "RemoveContainer" containerID="65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"
Sep 10 14:22:27.930531 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.930503    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"} err="failed to get container status \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": rpc error: code = NotFound desc = could not find container \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": container with ID starting with 65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6 not found: ID does not exist"
Sep 10 14:22:27.930670 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.930533    2579 scope.go:117] "RemoveContainer" containerID="5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"
Sep 10 14:22:27.931351 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.931110    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 14:22:27.932265 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.931608    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"} err="failed to get container status \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": rpc error: code = NotFound desc = could not find container \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": container with ID starting with 5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b not found: ID does not exist"
Sep 10 14:22:27.932265 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.931632    2579 scope.go:117] "RemoveContainer" containerID="b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"
Sep 10 14:22:27.932265 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.932024    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"} err="failed to get container status \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": rpc error: code = NotFound desc = could not find container \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": container with ID starting with b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c not found: ID does not exist"
Sep 10 14:22:27.932265 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.932048    2579 scope.go:117] "RemoveContainer" containerID="34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"
Sep 10 14:22:27.932491 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.932413    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6"} err="failed to get container status \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": rpc error: code = NotFound desc = could not find container \"34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6\": container with ID starting with 34b3d8c7e76c025d76ba81d5219175710dca3ec82cae050afe968469aeb64df6 not found: ID does not exist"
Sep 10 14:22:27.932491 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.932435    2579 scope.go:117] "RemoveContainer" containerID="f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"
Sep 10 14:22:27.932661 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.932635    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 14:22:27.932891 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.932855    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1"} err="failed to get container status \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": rpc error: code = NotFound desc = could not find container \"f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1\": container with ID starting with f94d82eec3c6c0d761082624c0172aec4bdc7fa3bbc1fcad38530daeee13ebf1 not found: ID does not exist"
Sep 10 14:22:27.932891 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.932890    2579 scope.go:117] "RemoveContainer" containerID="1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"
Sep 10 14:22:27.933192 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.933173    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29"} err="failed to get container status \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": rpc error: code = NotFound desc = could not find container \"1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29\": container with ID starting with 1a8d4830b955bb35b1710ed617463c0e56cf61324b8635d26c531026fd074e29 not found: ID does not exist"
Sep 10 14:22:27.933192 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.933192    2579 scope.go:117] "RemoveContainer" containerID="a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"
Sep 10 14:22:27.933463 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.933441    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d"} err="failed to get container status \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": rpc error: code = NotFound desc = could not find container \"a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d\": container with ID starting with a2bf2c524edc2b635e631510c666751246e1fb44bb06053a55964aa6b2fe1f8d not found: ID does not exist"
Sep 10 14:22:27.933523 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.933464    2579 scope.go:117] "RemoveContainer" containerID="65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"
Sep 10 14:22:27.933704 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.933683    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6"} err="failed to get container status \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": rpc error: code = NotFound desc = could not find container \"65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6\": container with ID starting with 65d03768ac85438fc8ce939d164690b4dd2fdb9f902014efcae44c3350a489c6 not found: ID does not exist"
Sep 10 14:22:27.933805 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.933705    2579 scope.go:117] "RemoveContainer" containerID="5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"
Sep 10 14:22:27.934005 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.933987    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b"} err="failed to get container status \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": rpc error: code = NotFound desc = could not find container \"5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b\": container with ID starting with 5a330037a757b03f1ab67ac635754b2ed8ffcfa9db51fcac41f156c7ca8ae98b not found: ID does not exist"
Sep 10 14:22:27.934080 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.934006    2579 scope.go:117] "RemoveContainer" containerID="b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"
Sep 10 14:22:27.934132 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.934113    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:22:27.934239 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.934222    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c"} err="failed to get container status \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": rpc error: code = NotFound desc = could not find container \"b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c\": container with ID starting with b9f1cb9a00ff6936afcd80d96b5a8c2aa8d9826bbee13610eae4c6814207dd3c not found: ID does not exist"
Sep 10 14:22:27.948102 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948240 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948240 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2xqn\" (UniqueName: \"kubernetes.io/projected/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-kube-api-access-h2xqn\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948321 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948275    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948321 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948408 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948408 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948408 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948408 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948531 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948531 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-config\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948531 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948461    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948531 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948688 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948589    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948688 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948688 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948644    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948688 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948900 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948900 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:27.948900 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:27.948761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.050140 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.050529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.050529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.050529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050279    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.050529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050321    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.050529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-config\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.050529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.050529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050395    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.050529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050618    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2xqn\" (UniqueName: \"kubernetes.io/projected/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-kube-api-access-h2xqn\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.050951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.051047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051092 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.051076    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.051913 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.051521    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.054762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.053721    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.054762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.053773    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.054762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.054271    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-config\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.054762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.054443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.054762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.054747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.055116 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.054966    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.055362 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.055337    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.055511 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.055353    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.056011 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.055941    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.056011 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.055984    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.056649 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.056627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.056895 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.056872    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-config-out\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.056982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.056966    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.057527 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.057505    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.057854 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.057837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-web-config\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.063125 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.063101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2xqn\" (UniqueName: \"kubernetes.io/projected/e6ce5f1d-9a66-4903-8553-5cabfbbd56e1-kube-api-access-h2xqn\") pod \"prometheus-k8s-0\" (UID: \"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.235386 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.235295    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:22:28.519226 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.519194    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 14:22:28.521365 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:22:28.521326    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6ce5f1d_9a66_4903_8553_5cabfbbd56e1.slice/crio-57b450243cfe93c7bcf61af43ca9b6b1737cc3e246d6f41ec19e10183a6816fe WatchSource:0}: Error finding container 57b450243cfe93c7bcf61af43ca9b6b1737cc3e246d6f41ec19e10183a6816fe: Status 404 returned error can't find the container with id 57b450243cfe93c7bcf61af43ca9b6b1737cc3e246d6f41ec19e10183a6816fe
Sep 10 14:22:28.865278 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.865183    2579 generic.go:356] "Generic (PLEG): container finished" podID="e6ce5f1d-9a66-4903-8553-5cabfbbd56e1" containerID="8bbf4b1bd98799dcc6bf46c277716cbf6d7c02ce42e1f16864f2952cac41c53c" exitCode=0
Sep 10 14:22:28.865437 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.865270    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1","Type":"ContainerDied","Data":"8bbf4b1bd98799dcc6bf46c277716cbf6d7c02ce42e1f16864f2952cac41c53c"}
Sep 10 14:22:28.865437 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:28.865341    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1","Type":"ContainerStarted","Data":"57b450243cfe93c7bcf61af43ca9b6b1737cc3e246d6f41ec19e10183a6816fe"}
Sep 10 14:22:29.873934 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:29.873901    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1","Type":"ContainerStarted","Data":"a20a254ea4facd8119a0aa6c938437b38016fb27e87448bd31efae3a300b8f21"}
Sep 10 14:22:29.874300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:29.873967    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1","Type":"ContainerStarted","Data":"bc3545a2ba8eab7c8fb12f3d5586d6b21576e46f4046b102b1b98f29020120df"}
Sep 10 14:22:29.874300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:29.873994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1","Type":"ContainerStarted","Data":"ef1b97ca084260cd3e21cea0da48f56110d393d0b6cd2fdd6676ccfcc1e82d28"}
Sep 10 14:22:29.874300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:29.874023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1","Type":"ContainerStarted","Data":"7bdcfb089b4869a967777c118589e067fed40d46914072fc777634741d1660cd"}
Sep 10 14:22:29.874300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:29.874047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1","Type":"ContainerStarted","Data":"c0dd6a2738226c51af95b8c31381c9f65540a0d6c0f4342eb6fc95e2e62f41a1"}
Sep 10 14:22:29.874300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:29.874069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e6ce5f1d-9a66-4903-8553-5cabfbbd56e1","Type":"ContainerStarted","Data":"d8d86feb2a8f9d03835e0d68a1c5819219e1f1c80eb870d352e0ea1a2f87b240"}
Sep 10 14:22:29.911443 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:29.911390    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.888980337 podStartE2EDuration="2.911371303s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.390966ms" isStatefulPod=false podCreationTimestamp="2026-09-10 14:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:22:29.90111422 +0000 UTC m=+196.493319002" watchObservedRunningTime="2026-09-10 14:22:29.911371303 +0000 UTC m=+196.503576108"
Sep 10 14:22:33.236382 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:22:33.236346    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:23:28.236211 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:23:28.236174    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:23:28.252704 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:23:28.252675    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:23:29.129720 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:23:29.129686    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 14:24:01.078603 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.078565    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c"]
Sep 10 14:24:01.081943 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.081913    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c"
Sep 10 14:24:01.084575 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.084543    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-55z4v\""
Sep 10 14:24:01.084575 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.084545    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 14:24:01.084759 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.084589    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 14:24:01.088522 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.088500    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c"]
Sep 10 14:24:01.223678 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.223640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nggs\" (UniqueName: \"kubernetes.io/projected/ba296418-aa56-4ae0-a224-2678b6233d58-kube-api-access-7nggs\") pod \"openshift-lws-operator-fd8ccff4c-vmk6c\" (UID: \"ba296418-aa56-4ae0-a224-2678b6233d58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c"
Sep 10 14:24:01.223901 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.223802    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba296418-aa56-4ae0-a224-2678b6233d58-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vmk6c\" (UID: \"ba296418-aa56-4ae0-a224-2678b6233d58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c"
Sep 10 14:24:01.325040 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.325001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nggs\" (UniqueName: \"kubernetes.io/projected/ba296418-aa56-4ae0-a224-2678b6233d58-kube-api-access-7nggs\") pod \"openshift-lws-operator-fd8ccff4c-vmk6c\" (UID: \"ba296418-aa56-4ae0-a224-2678b6233d58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c"
Sep 10 14:24:01.325244 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.325078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba296418-aa56-4ae0-a224-2678b6233d58-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vmk6c\" (UID: \"ba296418-aa56-4ae0-a224-2678b6233d58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c"
Sep 10 14:24:01.325437 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.325419    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba296418-aa56-4ae0-a224-2678b6233d58-tmp\") pod \"openshift-lws-operator-fd8ccff4c-vmk6c\" (UID: \"ba296418-aa56-4ae0-a224-2678b6233d58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c"
Sep 10 14:24:01.333362 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.333298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nggs\" (UniqueName: \"kubernetes.io/projected/ba296418-aa56-4ae0-a224-2678b6233d58-kube-api-access-7nggs\") pod \"openshift-lws-operator-fd8ccff4c-vmk6c\" (UID: \"ba296418-aa56-4ae0-a224-2678b6233d58\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c"
Sep 10 14:24:01.404188 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.404154    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c"
Sep 10 14:24:01.673357 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:01.673328    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c"]
Sep 10 14:24:01.676004 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:24:01.675974    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba296418_aa56_4ae0_a224_2678b6233d58.slice/crio-e5e51d691838c3b48661774b1efca70d06720588bd070ac26fb1a9113dfb0255 WatchSource:0}: Error finding container e5e51d691838c3b48661774b1efca70d06720588bd070ac26fb1a9113dfb0255: Status 404 returned error can't find the container with id e5e51d691838c3b48661774b1efca70d06720588bd070ac26fb1a9113dfb0255
Sep 10 14:24:02.249274 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:02.249228    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c" event={"ID":"ba296418-aa56-4ae0-a224-2678b6233d58","Type":"ContainerStarted","Data":"e5e51d691838c3b48661774b1efca70d06720588bd070ac26fb1a9113dfb0255"}
Sep 10 14:24:04.260569 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:04.260526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c" event={"ID":"ba296418-aa56-4ae0-a224-2678b6233d58","Type":"ContainerStarted","Data":"e7560589b8183e871b41217b7416199b2ac36ae71bc86bd852f740246490121c"}
Sep 10 14:24:04.276865 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:04.276810    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-vmk6c" podStartSLOduration=0.854227302 podStartE2EDuration="3.276767559s" totalImagesPullingTime="2.422540257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:04.275839623 +0000 UTC m=+290.868044391" watchObservedRunningTime="2026-09-10 14:24:04.276767559 +0000 UTC m=+290.868972328"
Sep 10 14:24:13.832663 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:13.832632    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:24:13.836424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:13.836395    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:24:13.843711 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:13.843684    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:24:13.847634 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:13.847609    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:24:13.850213 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:13.850189    2579 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 14:24:23.911463 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:23.911426    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"]
Sep 10 14:24:23.918163 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:23.918143    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:23.921743 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:23.921713    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"]
Sep 10 14:24:23.922128 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:23.922065    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 14:24:23.922128 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:23.922092    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 14:24:23.922324 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:23.922094    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-x4xjl\""
Sep 10 14:24:23.922324 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:23.922068    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 14:24:23.998960 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:23.998921    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c98bc03-655b-4ea7-a858-f85f4648e29a-cert\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:23.999166 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:23.998965    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsphl\" (UniqueName: \"kubernetes.io/projected/7c98bc03-655b-4ea7-a858-f85f4648e29a-kube-api-access-hsphl\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:23.999166 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:23.999061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c98bc03-655b-4ea7-a858-f85f4648e29a-metrics-cert\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:23.999166 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:23.999136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7c98bc03-655b-4ea7-a858-f85f4648e29a-manager-config\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:24.099482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.099446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c98bc03-655b-4ea7-a858-f85f4648e29a-metrics-cert\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:24.099657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.099493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7c98bc03-655b-4ea7-a858-f85f4648e29a-manager-config\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:24.099657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.099535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c98bc03-655b-4ea7-a858-f85f4648e29a-cert\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:24.099657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.099554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsphl\" (UniqueName: \"kubernetes.io/projected/7c98bc03-655b-4ea7-a858-f85f4648e29a-kube-api-access-hsphl\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:24.100243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.100218    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7c98bc03-655b-4ea7-a858-f85f4648e29a-manager-config\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:24.102227 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.102199    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7c98bc03-655b-4ea7-a858-f85f4648e29a-cert\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:24.102338 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.102197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7c98bc03-655b-4ea7-a858-f85f4648e29a-metrics-cert\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:24.124655 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.124624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsphl\" (UniqueName: \"kubernetes.io/projected/7c98bc03-655b-4ea7-a858-f85f4648e29a-kube-api-access-hsphl\") pod \"lws-controller-manager-759b87488b-bcnnm\" (UID: \"7c98bc03-655b-4ea7-a858-f85f4648e29a\") " pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:24.173395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.173313    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"]
Sep 10 14:24:24.177483 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.177466    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.181591 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.181570    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 14:24:24.181748 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.181659    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 14:24:24.181939 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.181922    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p5jmf\""
Sep 10 14:24:24.182116 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.182100    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 14:24:24.182175 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.182163    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 14:24:24.193442 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.193412    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"]
Sep 10 14:24:24.200078 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.200050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35846642-5bc2-4163-9215-ffcdb453de8c-manifests\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.200226 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.200089    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35846642-5bc2-4163-9215-ffcdb453de8c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.200226 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.200118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kldr\" (UniqueName: \"kubernetes.io/projected/35846642-5bc2-4163-9215-ffcdb453de8c-kube-api-access-5kldr\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.200315 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.200222    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35846642-5bc2-4163-9215-ffcdb453de8c-tmp\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.200315 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.200262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35846642-5bc2-4163-9215-ffcdb453de8c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.228655 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.228621    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:24.301623 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.301550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35846642-5bc2-4163-9215-ffcdb453de8c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.301623 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.301598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kldr\" (UniqueName: \"kubernetes.io/projected/35846642-5bc2-4163-9215-ffcdb453de8c-kube-api-access-5kldr\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.301901 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.301690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35846642-5bc2-4163-9215-ffcdb453de8c-tmp\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.301901 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.301727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35846642-5bc2-4163-9215-ffcdb453de8c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.301901 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.301771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35846642-5bc2-4163-9215-ffcdb453de8c-manifests\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.302294 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.302156    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/35846642-5bc2-4163-9215-ffcdb453de8c-manifests\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.304173 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.304119    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35846642-5bc2-4163-9215-ffcdb453de8c-tmp\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.304811 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.304768    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/35846642-5bc2-4163-9215-ffcdb453de8c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.305478 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.305231    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35846642-5bc2-4163-9215-ffcdb453de8c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.317536 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.317497    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kldr\" (UniqueName: \"kubernetes.io/projected/35846642-5bc2-4163-9215-ffcdb453de8c-kube-api-access-5kldr\") pod \"opendatahub-operator-controller-manager-5c47c8c9b-s5fd5\" (UID: \"35846642-5bc2-4163-9215-ffcdb453de8c\") " pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.488225 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.488143    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:24.518106 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.518001    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"]
Sep 10 14:24:24.520966 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:24:24.520935    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c98bc03_655b_4ea7_a858_f85f4648e29a.slice/crio-029bd3be6458f8d06af7d543017882095205ea86599101453f493cd4ae25e079 WatchSource:0}: Error finding container 029bd3be6458f8d06af7d543017882095205ea86599101453f493cd4ae25e079: Status 404 returned error can't find the container with id 029bd3be6458f8d06af7d543017882095205ea86599101453f493cd4ae25e079
Sep 10 14:24:24.523471 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.523454    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:24:24.772428 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:24.772396    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"]
Sep 10 14:24:24.776183 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:24:24.776141    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35846642_5bc2_4163_9215_ffcdb453de8c.slice/crio-177c71d62457ba81457eef3fd4124d08fb7933079a43b301944896103b7728c6 WatchSource:0}: Error finding container 177c71d62457ba81457eef3fd4124d08fb7933079a43b301944896103b7728c6: Status 404 returned error can't find the container with id 177c71d62457ba81457eef3fd4124d08fb7933079a43b301944896103b7728c6
Sep 10 14:24:25.347058 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:25.347021    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm" event={"ID":"7c98bc03-655b-4ea7-a858-f85f4648e29a","Type":"ContainerStarted","Data":"029bd3be6458f8d06af7d543017882095205ea86599101453f493cd4ae25e079"}
Sep 10 14:24:25.348338 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:25.348313    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5" event={"ID":"35846642-5bc2-4163-9215-ffcdb453de8c","Type":"ContainerStarted","Data":"177c71d62457ba81457eef3fd4124d08fb7933079a43b301944896103b7728c6"}
Sep 10 14:24:27.361104 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:27.361071    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm" event={"ID":"7c98bc03-655b-4ea7-a858-f85f4648e29a","Type":"ContainerStarted","Data":"557185f231d2b0af0190d40702baa496fcbfa2ddc600d46e257d0d026fe4881b"}
Sep 10 14:24:27.361529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:27.361262    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:27.397276 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:27.397166    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm" podStartSLOduration=2.343568866 podStartE2EDuration="4.39714318s" totalImagesPullingTime="2.053574314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:27.395697555 +0000 UTC m=+313.987902315" watchObservedRunningTime="2026-09-10 14:24:27.39714318 +0000 UTC m=+313.989347951"
Sep 10 14:24:29.372795 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:29.372746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5" event={"ID":"35846642-5bc2-4163-9215-ffcdb453de8c","Type":"ContainerStarted","Data":"df98950d9c1df91430fc29b060637981c67eca5cbe8bd49275a836ca7cb15756"}
Sep 10 14:24:30.378994 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:30.378957    2579 generic.go:356] "Generic (PLEG): container finished" podID="35846642-5bc2-4163-9215-ffcdb453de8c" containerID="df98950d9c1df91430fc29b060637981c67eca5cbe8bd49275a836ca7cb15756" exitCode=0
Sep 10 14:24:30.378994 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:30.378996    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5" event={"ID":"35846642-5bc2-4163-9215-ffcdb453de8c","Type":"ContainerDied","Data":"df98950d9c1df91430fc29b060637981c67eca5cbe8bd49275a836ca7cb15756"}
Sep 10 14:24:31.385813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:31.385753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5" event={"ID":"35846642-5bc2-4163-9215-ffcdb453de8c","Type":"ContainerStarted","Data":"74291185a45560c7835f59f386a56f27e70934cb55b00be0c591f12d721fb535"}
Sep 10 14:24:31.386224 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:31.385881    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:31.412990 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:31.412934    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5" podStartSLOduration=2.286744744 podStartE2EDuration="7.412916575s" totalImagesPullingTime="4.074390309s" totalInitContainerRuntime="1.051781522s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:31.411255986 +0000 UTC m=+318.003460778" watchObservedRunningTime="2026-09-10 14:24:31.412916575 +0000 UTC m=+318.005121344"
Sep 10 14:24:38.369156 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:38.369123    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-759b87488b-bcnnm"
Sep 10 14:24:42.392451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:42.392421    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c47c8c9b-s5fd5"
Sep 10 14:24:50.844794 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.844744    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"]
Sep 10 14:24:50.848135 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.848113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:50.850893 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.850859    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 14:24:50.851071 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.851003    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qgtmn\""
Sep 10 14:24:50.860519 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.860490    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"]
Sep 10 14:24:50.928504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.928471    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:50.928504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.928507    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08989215-8680-441a-8228-d5bf9dc2f219-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:50.928729 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.928563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp5wp\" (UniqueName: \"kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-kube-api-access-vp5wp\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:50.928729 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.928619    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:50.928729 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.928642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:50.928729 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.928682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:50.928729 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.928703    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:50.928933 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.928837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08989215-8680-441a-8228-d5bf9dc2f219-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:50.928933 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:50.928895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.029464 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.029427    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.029464 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.029463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08989215-8680-441a-8228-d5bf9dc2f219-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.029715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.029488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp5wp\" (UniqueName: \"kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-kube-api-access-vp5wp\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.029715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.029517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.029715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.029543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.029715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.029574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.029715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.029600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.030077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.029817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08989215-8680-441a-8228-d5bf9dc2f219-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.030077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.029872    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.030181 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.030079    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.030181 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.030136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.030284 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.030212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.030284 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.030250    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.030358 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.030281    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08989215-8680-441a-8228-d5bf9dc2f219-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.032104 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.032078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.032433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.032409    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08989215-8680-441a-8228-d5bf9dc2f219-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.040035 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.040013    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.040281 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.040264    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp5wp\" (UniqueName: \"kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-kube-api-access-vp5wp\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcflwcm\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.160642 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.160559    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:51.444729 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.441841    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"]
Sep 10 14:24:51.446475 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:24:51.446445    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08989215_8680_441a_8228_d5bf9dc2f219.slice/crio-8fa7dedcabd854ad35c847a662b402f3e7a96d3748b5e38d90c448fa3da1d64d WatchSource:0}: Error finding container 8fa7dedcabd854ad35c847a662b402f3e7a96d3748b5e38d90c448fa3da1d64d: Status 404 returned error can't find the container with id 8fa7dedcabd854ad35c847a662b402f3e7a96d3748b5e38d90c448fa3da1d64d
Sep 10 14:24:51.476572 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:51.476540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm" event={"ID":"08989215-8680-441a-8228-d5bf9dc2f219","Type":"ContainerStarted","Data":"8fa7dedcabd854ad35c847a662b402f3e7a96d3748b5e38d90c448fa3da1d64d"}
Sep 10 14:24:54.301686 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:54.301649    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:24:54.301953 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:54.301726    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:24:54.301953 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:54.301758    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:24:54.494360 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:54.494325    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm" event={"ID":"08989215-8680-441a-8228-d5bf9dc2f219","Type":"ContainerStarted","Data":"11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963"}
Sep 10 14:24:54.516095 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:54.516034    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm" podStartSLOduration=1.66313435 podStartE2EDuration="4.516015049s" totalImagesPullingTime="2.852880699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:24:54.514884319 +0000 UTC m=+341.107089101" watchObservedRunningTime="2026-09-10 14:24:54.516015049 +0000 UTC m=+341.108219875"
Sep 10 14:24:54.942077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:54.942038    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-plks6"]
Sep 10 14:24:54.945559 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:54.945540    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-plks6"
Sep 10 14:24:54.948263 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:54.948240    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 14:24:54.948389 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:54.948331    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-rbvs7\""
Sep 10 14:24:54.953549 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:54.953523    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-plks6"]
Sep 10 14:24:55.068297 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:55.068256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df522869-cf63-447b-a6dc-66419f23e2a6-cert\") pod \"odh-model-controller-7998c67dc4-plks6\" (UID: \"df522869-cf63-447b-a6dc-66419f23e2a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-plks6"
Sep 10 14:24:55.068297 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:55.068298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48hs5\" (UniqueName: \"kubernetes.io/projected/df522869-cf63-447b-a6dc-66419f23e2a6-kube-api-access-48hs5\") pod \"odh-model-controller-7998c67dc4-plks6\" (UID: \"df522869-cf63-447b-a6dc-66419f23e2a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-plks6"
Sep 10 14:24:55.161550 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:55.161515    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:24:55.162952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:55.162925    2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 10 14:24:55.163068 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:55.162973    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm" podUID="08989215-8680-441a-8228-d5bf9dc2f219" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 10 14:24:55.169586 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:55.169565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df522869-cf63-447b-a6dc-66419f23e2a6-cert\") pod \"odh-model-controller-7998c67dc4-plks6\" (UID: \"df522869-cf63-447b-a6dc-66419f23e2a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-plks6"
Sep 10 14:24:55.169653 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:55.169594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48hs5\" (UniqueName: \"kubernetes.io/projected/df522869-cf63-447b-a6dc-66419f23e2a6-kube-api-access-48hs5\") pod \"odh-model-controller-7998c67dc4-plks6\" (UID: \"df522869-cf63-447b-a6dc-66419f23e2a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-plks6"
Sep 10 14:24:55.169720 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:24:55.169701    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 14:24:55.169791 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:24:55.169770    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df522869-cf63-447b-a6dc-66419f23e2a6-cert podName:df522869-cf63-447b-a6dc-66419f23e2a6 nodeName:}" failed. No retries permitted until 2026-09-10 14:24:55.669755203 +0000 UTC m=+342.261959950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/df522869-cf63-447b-a6dc-66419f23e2a6-cert") pod "odh-model-controller-7998c67dc4-plks6" (UID: "df522869-cf63-447b-a6dc-66419f23e2a6") : secret "odh-model-controller-webhook-cert" not found
Sep 10 14:24:55.179981 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:55.179958    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48hs5\" (UniqueName: \"kubernetes.io/projected/df522869-cf63-447b-a6dc-66419f23e2a6-kube-api-access-48hs5\") pod \"odh-model-controller-7998c67dc4-plks6\" (UID: \"df522869-cf63-447b-a6dc-66419f23e2a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-plks6"
Sep 10 14:24:55.674595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:55.674552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df522869-cf63-447b-a6dc-66419f23e2a6-cert\") pod \"odh-model-controller-7998c67dc4-plks6\" (UID: \"df522869-cf63-447b-a6dc-66419f23e2a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-plks6"
Sep 10 14:24:55.677273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:55.677250    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df522869-cf63-447b-a6dc-66419f23e2a6-cert\") pod \"odh-model-controller-7998c67dc4-plks6\" (UID: \"df522869-cf63-447b-a6dc-66419f23e2a6\") " pod="opendatahub/odh-model-controller-7998c67dc4-plks6"
Sep 10 14:24:55.858301 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:55.858264    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-plks6"
Sep 10 14:24:56.110957 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:56.110916    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"]
Sep 10 14:24:56.139195 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:56.139172    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-plks6"]
Sep 10 14:24:56.143716 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:24:56.143684    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf522869_cf63_447b_a6dc_66419f23e2a6.slice/crio-2e3f2110a1757623960c21c43f04586d6fa58e424fb7660004560110fe4c2e5a WatchSource:0}: Error finding container 2e3f2110a1757623960c21c43f04586d6fa58e424fb7660004560110fe4c2e5a: Status 404 returned error can't find the container with id 2e3f2110a1757623960c21c43f04586d6fa58e424fb7660004560110fe4c2e5a
Sep 10 14:24:56.161697 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:56.161663    2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 10 14:24:56.161876 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:56.161732    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm" podUID="08989215-8680-441a-8228-d5bf9dc2f219" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 10 14:24:56.505275 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:56.505240    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-plks6" event={"ID":"df522869-cf63-447b-a6dc-66419f23e2a6","Type":"ContainerStarted","Data":"2e3f2110a1757623960c21c43f04586d6fa58e424fb7660004560110fe4c2e5a"}
Sep 10 14:24:57.161744 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:57.161704    2579 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 10 14:24:57.162236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:57.161775    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm" podUID="08989215-8680-441a-8228-d5bf9dc2f219" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 10 14:24:57.510340 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:24:57.510298    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm" podUID="08989215-8680-441a-8228-d5bf9dc2f219" containerName="istio-proxy" containerID="cri-o://11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963" gracePeriod=30
Sep 10 14:25:00.528587 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:00.528497    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-plks6" event={"ID":"df522869-cf63-447b-a6dc-66419f23e2a6","Type":"ContainerStarted","Data":"b3c99d1005300847016965c901480c9f9be05d58beb0a371ea37c7538e404cd8"}
Sep 10 14:25:00.528587 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:00.528566    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-plks6"
Sep 10 14:25:00.547680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:00.547623    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-plks6" podStartSLOduration=2.43751469 podStartE2EDuration="6.547602487s" totalImagesPullingTime="4.110087797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:25:00.546014412 +0000 UTC m=+347.138219182" watchObservedRunningTime="2026-09-10 14:25:00.547602487 +0000 UTC m=+347.139807257"
Sep 10 14:25:01.739978 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.739946    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"]
Sep 10 14:25:01.742171 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.742153    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.745027 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.745000    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 10 14:25:01.745157 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.745000    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xzlkm\""
Sep 10 14:25:01.745346 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.745326    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 10 14:25:01.745409 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.745359    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 10 14:25:01.763008 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.762968    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"]
Sep 10 14:25:01.830661 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.830621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.830661 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.830661    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.830914 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.830694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/036eb260-51a4-430b-98cf-6dc9435cf7b0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.830914 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.830832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.830914 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.830879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb8hw\" (UniqueName: \"kubernetes.io/projected/036eb260-51a4-430b-98cf-6dc9435cf7b0-kube-api-access-qb8hw\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.831010 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.830950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.831010 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.830994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/036eb260-51a4-430b-98cf-6dc9435cf7b0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.931500 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.931450    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/036eb260-51a4-430b-98cf-6dc9435cf7b0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.931500 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.931516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.931711 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.931534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb8hw\" (UniqueName: \"kubernetes.io/projected/036eb260-51a4-430b-98cf-6dc9435cf7b0-kube-api-access-qb8hw\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.931711 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.931573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.931711 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.931597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/036eb260-51a4-430b-98cf-6dc9435cf7b0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.931884 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.931745    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.931884 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.931825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.932602 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.932572    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.934186 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.934162    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/036eb260-51a4-430b-98cf-6dc9435cf7b0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.934301 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.934227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.934410 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.934393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.934464 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.934442    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/036eb260-51a4-430b-98cf-6dc9435cf7b0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.954508 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.954468    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/036eb260-51a4-430b-98cf-6dc9435cf7b0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:01.954680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:01.954619    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb8hw\" (UniqueName: \"kubernetes.io/projected/036eb260-51a4-430b-98cf-6dc9435cf7b0-kube-api-access-qb8hw\") pod \"istiod-openshift-gateway-5677ccb49b-jz98w\" (UID: \"036eb260-51a4-430b-98cf-6dc9435cf7b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:02.051875 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.051839    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:02.361317 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.361203    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"]
Sep 10 14:25:02.363597 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:25:02.363555    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036eb260_51a4_430b_98cf_6dc9435cf7b0.slice/crio-6fc700ba56e183ba5898d360d25f4cdcb02917483785bcd19ff526e969f17911 WatchSource:0}: Error finding container 6fc700ba56e183ba5898d360d25f4cdcb02917483785bcd19ff526e969f17911: Status 404 returned error can't find the container with id 6fc700ba56e183ba5898d360d25f4cdcb02917483785bcd19ff526e969f17911
Sep 10 14:25:02.539183 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.539149    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w" event={"ID":"036eb260-51a4-430b-98cf-6dc9435cf7b0","Type":"ContainerStarted","Data":"6fc700ba56e183ba5898d360d25f4cdcb02917483785bcd19ff526e969f17911"}
Sep 10 14:25:02.749134 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.749105    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:25:02.841240 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841137    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-credential-socket\") pod \"08989215-8680-441a-8228-d5bf9dc2f219\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") "
Sep 10 14:25:02.841404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841286    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08989215-8680-441a-8228-d5bf9dc2f219-istio-podinfo\") pod \"08989215-8680-441a-8228-d5bf9dc2f219\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") "
Sep 10 14:25:02.841404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-data\") pod \"08989215-8680-441a-8228-d5bf9dc2f219\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") "
Sep 10 14:25:02.841404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841378    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-istio-token\") pod \"08989215-8680-441a-8228-d5bf9dc2f219\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") "
Sep 10 14:25:02.841504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841416    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "08989215-8680-441a-8228-d5bf9dc2f219" (UID: "08989215-8680-441a-8228-d5bf9dc2f219"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:25:02.841504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841432    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp5wp\" (UniqueName: \"kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-kube-api-access-vp5wp\") pod \"08989215-8680-441a-8228-d5bf9dc2f219\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") "
Sep 10 14:25:02.841504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841477    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08989215-8680-441a-8228-d5bf9dc2f219-istiod-ca-cert\") pod \"08989215-8680-441a-8228-d5bf9dc2f219\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") "
Sep 10 14:25:02.841647 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841507    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-certs\") pod \"08989215-8680-441a-8228-d5bf9dc2f219\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") "
Sep 10 14:25:02.841647 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841528    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-envoy\") pod \"08989215-8680-441a-8228-d5bf9dc2f219\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") "
Sep 10 14:25:02.841647 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841550    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-socket\") pod \"08989215-8680-441a-8228-d5bf9dc2f219\" (UID: \"08989215-8680-441a-8228-d5bf9dc2f219\") "
Sep 10 14:25:02.841837 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841681    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-data" (OuterVolumeSpecName: "istio-data") pod "08989215-8680-441a-8228-d5bf9dc2f219" (UID: "08989215-8680-441a-8228-d5bf9dc2f219"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:25:02.841956 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841924    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:25:02.841956 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841949    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:25:02.842073 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841925    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08989215-8680-441a-8228-d5bf9dc2f219-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "08989215-8680-441a-8228-d5bf9dc2f219" (UID: "08989215-8680-441a-8228-d5bf9dc2f219"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:25:02.842073 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.841935    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "08989215-8680-441a-8228-d5bf9dc2f219" (UID: "08989215-8680-441a-8228-d5bf9dc2f219"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:25:02.842178 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.842066    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "08989215-8680-441a-8228-d5bf9dc2f219" (UID: "08989215-8680-441a-8228-d5bf9dc2f219"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:25:02.843909 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.843875    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "08989215-8680-441a-8228-d5bf9dc2f219" (UID: "08989215-8680-441a-8228-d5bf9dc2f219"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:25:02.844023 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.843937    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-istio-token" (OuterVolumeSpecName: "istio-token") pod "08989215-8680-441a-8228-d5bf9dc2f219" (UID: "08989215-8680-441a-8228-d5bf9dc2f219"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:25:02.844023 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.843961    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/08989215-8680-441a-8228-d5bf9dc2f219-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "08989215-8680-441a-8228-d5bf9dc2f219" (UID: "08989215-8680-441a-8228-d5bf9dc2f219"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:25:02.844023 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.843990    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-kube-api-access-vp5wp" (OuterVolumeSpecName: "kube-api-access-vp5wp") pod "08989215-8680-441a-8228-d5bf9dc2f219" (UID: "08989215-8680-441a-8228-d5bf9dc2f219"). InnerVolumeSpecName "kube-api-access-vp5wp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:25:02.942772 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.942744    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:25:02.942772 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.942771    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:25:02.942952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.942803    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08989215-8680-441a-8228-d5bf9dc2f219-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:25:02.942952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.942814    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08989215-8680-441a-8228-d5bf9dc2f219-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:25:02.942952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.942823    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:25:02.942952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.942833    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp5wp\" (UniqueName: \"kubernetes.io/projected/08989215-8680-441a-8228-d5bf9dc2f219-kube-api-access-vp5wp\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:25:02.942952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:02.942841    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08989215-8680-441a-8228-d5bf9dc2f219-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:25:03.546882 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:03.546839    2579 generic.go:356] "Generic (PLEG): container finished" podID="08989215-8680-441a-8228-d5bf9dc2f219" containerID="11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963" exitCode=0
Sep 10 14:25:03.546882 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:03.546878    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"
Sep 10 14:25:03.547133 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:03.546896    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm" event={"ID":"08989215-8680-441a-8228-d5bf9dc2f219","Type":"ContainerDied","Data":"11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963"}
Sep 10 14:25:03.547133 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:03.546977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm" event={"ID":"08989215-8680-441a-8228-d5bf9dc2f219","Type":"ContainerDied","Data":"8fa7dedcabd854ad35c847a662b402f3e7a96d3748b5e38d90c448fa3da1d64d"}
Sep 10 14:25:03.547133 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:03.547011    2579 scope.go:117] "RemoveContainer" containerID="11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963"
Sep 10 14:25:03.559559 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:03.559537    2579 scope.go:117] "RemoveContainer" containerID="11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963"
Sep 10 14:25:03.560156 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:25:03.560127    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963\": container with ID starting with 11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963 not found: ID does not exist" containerID="11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963"
Sep 10 14:25:03.560290 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:03.560170    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963"} err="failed to get container status \"11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963\": rpc error: code = NotFound desc = could not find container \"11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963\": container with ID starting with 11ba706db0e6bafdd3f72cd80825b7143d702cffb27c504f8154968d4a63d963 not found: ID does not exist"
Sep 10 14:25:03.575302 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:03.575211    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"]
Sep 10 14:25:03.579162 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:03.579125    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcflwcm"]
Sep 10 14:25:03.916921 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:03.916833    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08989215-8680-441a-8228-d5bf9dc2f219" path="/var/lib/kubelet/pods/08989215-8680-441a-8228-d5bf9dc2f219/volumes"
Sep 10 14:25:04.726274 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:04.726236    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:25:04.726401 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:04.726316    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:25:05.561481 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:05.561447    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w" event={"ID":"036eb260-51a4-430b-98cf-6dc9435cf7b0","Type":"ContainerStarted","Data":"d213b202557499a26c5522cef288023791f5b2a33f736ad2a73ac0bce73711e4"}
Sep 10 14:25:05.561974 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:05.561641    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:05.563361 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:05.563336    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-jz98w container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:25:05.563486 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:05.563384    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w" podUID="036eb260-51a4-430b-98cf-6dc9435cf7b0" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:25:05.602391 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:05.602337    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w" podStartSLOduration=2.242181418 podStartE2EDuration="4.602319618s" totalImagesPullingTime="2.3601382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:25:05.600277224 +0000 UTC m=+352.192481994" watchObservedRunningTime="2026-09-10 14:25:05.602319618 +0000 UTC m=+352.194524386"
Sep 10 14:25:06.567093 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:06.567069    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-jz98w"
Sep 10 14:25:11.536214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:25:11.536184    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-plks6"
Sep 10 14:26:39.618017 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.617933    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"]
Sep 10 14:26:39.618459 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.618314    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08989215-8680-441a-8228-d5bf9dc2f219" containerName="istio-proxy"
Sep 10 14:26:39.618459 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.618327    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="08989215-8680-441a-8228-d5bf9dc2f219" containerName="istio-proxy"
Sep 10 14:26:39.618459 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.618387    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="08989215-8680-441a-8228-d5bf9dc2f219" containerName="istio-proxy"
Sep 10 14:26:39.621173 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.621157    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:39.624347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.624321    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 14:26:39.624495 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.624393    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 14:26:39.624628 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.624612    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zk7bh\""
Sep 10 14:26:39.649757 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.649728    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"]
Sep 10 14:26:39.780205 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.780166    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"]
Sep 10 14:26:39.780464 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:26:39.780445    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-kqd42], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk" podUID="7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5"
Sep 10 14:26:39.782811 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.782758    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqd42\" (UniqueName: \"kubernetes.io/projected/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-kube-api-access-kqd42\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gfxbk\" (UID: \"7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:39.782869 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.782828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gfxbk\" (UID: \"7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:39.883524 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.883430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqd42\" (UniqueName: \"kubernetes.io/projected/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-kube-api-access-kqd42\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gfxbk\" (UID: \"7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:39.883524 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.883477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gfxbk\" (UID: \"7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:39.883943 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.883924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gfxbk\" (UID: \"7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:39.893188 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.893166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqd42\" (UniqueName: \"kubernetes.io/projected/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-kube-api-access-kqd42\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-gfxbk\" (UID: \"7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:39.987447 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.987416    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:39.994546 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:39.994521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:40.084278 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:40.084241    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-extensions-socket-volume\") pod \"7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5\" (UID: \"7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5\") "
Sep 10 14:26:40.084450 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:40.084401    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqd42\" (UniqueName: \"kubernetes.io/projected/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-kube-api-access-kqd42\") pod \"7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5\" (UID: \"7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5\") "
Sep 10 14:26:40.084493 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:40.084474    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5" (UID: "7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:26:40.084614 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:40.084601    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-extensions-socket-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:26:40.086586 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:40.086556    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-kube-api-access-kqd42" (OuterVolumeSpecName: "kube-api-access-kqd42") pod "7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5" (UID: "7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5"). InnerVolumeSpecName "kube-api-access-kqd42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:26:40.185675 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:40.185586    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqd42\" (UniqueName: \"kubernetes.io/projected/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5-kube-api-access-kqd42\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:26:40.554484 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:40.554445    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"]
Sep 10 14:26:40.563208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:40.563180    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"]
Sep 10 14:26:40.993167 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:40.993086    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:40.995714 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:26:40.995680    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-gfxbk\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:41.001128 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:26:41.001097    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-67c5dcb48c-gfxbk\" is forbidden: User \"system:node:ip-10-0-128-234.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-234.ec2.internal' and this object" podUID="7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-gfxbk"
Sep 10 14:26:41.911470 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:26:41.911432    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5" path="/var/lib/kubelet/pods/7246e2b8-dc9e-4187-aac1-4c4c8eee6aa5/volumes"
Sep 10 14:27:11.475881 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.475849    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"]
Sep 10 14:27:11.479384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.479363    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.482021 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.481974    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lqx8w\""
Sep 10 14:27:11.491556 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.491529    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"]
Sep 10 14:27:11.560045 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.560007    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w29l\" (UniqueName: \"kubernetes.io/projected/925f958d-3adb-4f93-ab09-1d510e1cdad0-kube-api-access-6w29l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.560236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.560053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.560236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.560086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.560236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.560150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.560236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.560202    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.560413 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.560239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.560413 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.560306    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.560413 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.560372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.560413 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.560394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/925f958d-3adb-4f93-ab09-1d510e1cdad0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.661165 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.661121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.661358 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.661179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.661358 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.661220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/925f958d-3adb-4f93-ab09-1d510e1cdad0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.661454 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.661371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w29l\" (UniqueName: \"kubernetes.io/projected/925f958d-3adb-4f93-ab09-1d510e1cdad0-kube-api-access-6w29l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.661454 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.661407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.661454 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.661433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.661607 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.661462    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.661607 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.661527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.661607 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.661585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.661916 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.661867    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.662043 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.661985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.662043 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.662015    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.662150 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.662012    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/925f958d-3adb-4f93-ab09-1d510e1cdad0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.662199 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.662041    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.663704 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.663683    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.664056 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.664037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.670236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.670202    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w29l\" (UniqueName: \"kubernetes.io/projected/925f958d-3adb-4f93-ab09-1d510e1cdad0-kube-api-access-6w29l\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.670355 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.670239    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/925f958d-3adb-4f93-ab09-1d510e1cdad0-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-b42t5\" (UID: \"925f958d-3adb-4f93-ab09-1d510e1cdad0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:11.791363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:11.791322    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:12.068712 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:12.068683    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"]
Sep 10 14:27:12.071428 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:27:12.071403    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925f958d_3adb_4f93_ab09_1d510e1cdad0.slice/crio-c811683012a59afc26bdb8539f675ee8b6627888436ef1a15f46790e8eded0c7 WatchSource:0}: Error finding container c811683012a59afc26bdb8539f675ee8b6627888436ef1a15f46790e8eded0c7: Status 404 returned error can't find the container with id c811683012a59afc26bdb8539f675ee8b6627888436ef1a15f46790e8eded0c7
Sep 10 14:27:12.073700 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:12.073667    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:27:12.073804 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:12.073744    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:27:12.073804 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:12.073791    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:27:12.145347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:12.145311    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5" event={"ID":"925f958d-3adb-4f93-ab09-1d510e1cdad0","Type":"ContainerStarted","Data":"8a96e19acef9178e14477564b15a34125b579847878280f43143165a6fe072e1"}
Sep 10 14:27:12.145521 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:12.145380    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5" event={"ID":"925f958d-3adb-4f93-ab09-1d510e1cdad0","Type":"ContainerStarted","Data":"c811683012a59afc26bdb8539f675ee8b6627888436ef1a15f46790e8eded0c7"}
Sep 10 14:27:12.165809 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:12.165735    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5" podStartSLOduration=1.165716414 podStartE2EDuration="1.165716414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:27:12.164209369 +0000 UTC m=+478.756414140" watchObservedRunningTime="2026-09-10 14:27:12.165716414 +0000 UTC m=+478.757921183"
Sep 10 14:27:12.791511 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:12.791469    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:13.797366 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:13.797336    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:14.155166 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:14.155074    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:14.156241 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:14.156220    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:27:39.961463 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:39.961424    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"]
Sep 10 14:27:39.965155 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:39.965129    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"
Sep 10 14:27:39.968003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:39.967975    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 14:27:39.968160 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:39.968054    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 10 14:27:39.968160 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:39.968113    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 14:27:39.969276 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:39.969241    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-gl4xf\""
Sep 10 14:27:39.972953 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:39.972928    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"]
Sep 10 14:27:40.017390 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:40.017347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqv42\" (UniqueName: \"kubernetes.io/projected/ca9f00d6-438b-4527-b763-5bac44945905-kube-api-access-nqv42\") pod \"postgres-69fb4594cf-z8wzc\" (UID: \"ca9f00d6-438b-4527-b763-5bac44945905\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"
Sep 10 14:27:40.017390 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:40.017398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca9f00d6-438b-4527-b763-5bac44945905-data\") pod \"postgres-69fb4594cf-z8wzc\" (UID: \"ca9f00d6-438b-4527-b763-5bac44945905\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"
Sep 10 14:27:40.118561 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:40.118526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqv42\" (UniqueName: \"kubernetes.io/projected/ca9f00d6-438b-4527-b763-5bac44945905-kube-api-access-nqv42\") pod \"postgres-69fb4594cf-z8wzc\" (UID: \"ca9f00d6-438b-4527-b763-5bac44945905\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"
Sep 10 14:27:40.118732 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:40.118567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca9f00d6-438b-4527-b763-5bac44945905-data\") pod \"postgres-69fb4594cf-z8wzc\" (UID: \"ca9f00d6-438b-4527-b763-5bac44945905\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"
Sep 10 14:27:40.118918 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:40.118902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ca9f00d6-438b-4527-b763-5bac44945905-data\") pod \"postgres-69fb4594cf-z8wzc\" (UID: \"ca9f00d6-438b-4527-b763-5bac44945905\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"
Sep 10 14:27:40.127282 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:40.127260    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqv42\" (UniqueName: \"kubernetes.io/projected/ca9f00d6-438b-4527-b763-5bac44945905-kube-api-access-nqv42\") pod \"postgres-69fb4594cf-z8wzc\" (UID: \"ca9f00d6-438b-4527-b763-5bac44945905\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"
Sep 10 14:27:40.277553 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:40.277525    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"
Sep 10 14:27:40.552746 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:40.552657    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"]
Sep 10 14:27:40.555583 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:27:40.555555    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9f00d6_438b_4527_b763_5bac44945905.slice/crio-a4fe26c61f68b08a870d9ceac3a4668c6c57fb996aaf7500fc0f9b4c42a359b5 WatchSource:0}: Error finding container a4fe26c61f68b08a870d9ceac3a4668c6c57fb996aaf7500fc0f9b4c42a359b5: Status 404 returned error can't find the container with id a4fe26c61f68b08a870d9ceac3a4668c6c57fb996aaf7500fc0f9b4c42a359b5
Sep 10 14:27:41.282602 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:41.282562    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc" event={"ID":"ca9f00d6-438b-4527-b763-5bac44945905","Type":"ContainerStarted","Data":"a4fe26c61f68b08a870d9ceac3a4668c6c57fb996aaf7500fc0f9b4c42a359b5"}
Sep 10 14:27:46.310460 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:46.310429    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc" event={"ID":"ca9f00d6-438b-4527-b763-5bac44945905","Type":"ContainerStarted","Data":"570dbd1b7f4628df8a433fae9f68d3eccebc8393603338f1d813471d6aefd82a"}
Sep 10 14:27:46.310901 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:46.310539    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"
Sep 10 14:27:46.327099 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:46.327047    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc" podStartSLOduration=2.171172617 podStartE2EDuration="7.327028121s" totalImagesPullingTime="5.155855504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:27:46.325525478 +0000 UTC m=+512.917730279" watchObservedRunningTime="2026-09-10 14:27:46.327028121 +0000 UTC m=+512.919232889"
Sep 10 14:27:52.347656 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:27:52.347626    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z8wzc"
Sep 10 14:28:38.589858 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.589816    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"]
Sep 10 14:28:38.593354 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.593333    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"
Sep 10 14:28:38.596665 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.596647    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7fcdv\""
Sep 10 14:28:38.596764 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.596657    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 14:28:38.605804 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.605750    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"]
Sep 10 14:28:38.624934 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.624902    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"]
Sep 10 14:28:38.628300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.628279    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"
Sep 10 14:28:38.639846 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.639816    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"]
Sep 10 14:28:38.659815 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.659736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/192699cd-bd0a-4468-817b-fadd320e305e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-45qrv\" (UID: \"192699cd-bd0a-4468-817b-fadd320e305e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"
Sep 10 14:28:38.660022 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.659838    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cmfh\" (UniqueName: \"kubernetes.io/projected/192699cd-bd0a-4468-817b-fadd320e305e-kube-api-access-8cmfh\") pod \"payload-pre-processing-59fbc47bf8-45qrv\" (UID: \"192699cd-bd0a-4468-817b-fadd320e305e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"
Sep 10 14:28:38.761278 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.761246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/192699cd-bd0a-4468-817b-fadd320e305e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-45qrv\" (UID: \"192699cd-bd0a-4468-817b-fadd320e305e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"
Sep 10 14:28:38.761450 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.761293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cmfh\" (UniqueName: \"kubernetes.io/projected/192699cd-bd0a-4468-817b-fadd320e305e-kube-api-access-8cmfh\") pod \"payload-pre-processing-59fbc47bf8-45qrv\" (UID: \"192699cd-bd0a-4468-817b-fadd320e305e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"
Sep 10 14:28:38.761450 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.761328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/838ce0c1-d8c7-4937-8923-5e52c2e29115-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pnm4r\" (UID: \"838ce0c1-d8c7-4937-8923-5e52c2e29115\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"
Sep 10 14:28:38.761450 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.761362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc44w\" (UniqueName: \"kubernetes.io/projected/838ce0c1-d8c7-4937-8923-5e52c2e29115-kube-api-access-lc44w\") pod \"payload-processing-5b54b7fbb7-pnm4r\" (UID: \"838ce0c1-d8c7-4937-8923-5e52c2e29115\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"
Sep 10 14:28:38.761959 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.761940    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/192699cd-bd0a-4468-817b-fadd320e305e-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-45qrv\" (UID: \"192699cd-bd0a-4468-817b-fadd320e305e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"
Sep 10 14:28:38.772822 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.772771    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cmfh\" (UniqueName: \"kubernetes.io/projected/192699cd-bd0a-4468-817b-fadd320e305e-kube-api-access-8cmfh\") pod \"payload-pre-processing-59fbc47bf8-45qrv\" (UID: \"192699cd-bd0a-4468-817b-fadd320e305e\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"
Sep 10 14:28:38.862684 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.862591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/838ce0c1-d8c7-4937-8923-5e52c2e29115-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pnm4r\" (UID: \"838ce0c1-d8c7-4937-8923-5e52c2e29115\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"
Sep 10 14:28:38.862684 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.862641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc44w\" (UniqueName: \"kubernetes.io/projected/838ce0c1-d8c7-4937-8923-5e52c2e29115-kube-api-access-lc44w\") pod \"payload-processing-5b54b7fbb7-pnm4r\" (UID: \"838ce0c1-d8c7-4937-8923-5e52c2e29115\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"
Sep 10 14:28:38.863388 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.863367    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/838ce0c1-d8c7-4937-8923-5e52c2e29115-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pnm4r\" (UID: \"838ce0c1-d8c7-4937-8923-5e52c2e29115\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"
Sep 10 14:28:38.872752 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.872731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc44w\" (UniqueName: \"kubernetes.io/projected/838ce0c1-d8c7-4937-8923-5e52c2e29115-kube-api-access-lc44w\") pod \"payload-processing-5b54b7fbb7-pnm4r\" (UID: \"838ce0c1-d8c7-4937-8923-5e52c2e29115\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"
Sep 10 14:28:38.903668 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.903628    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"
Sep 10 14:28:38.940106 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:38.940044    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"
Sep 10 14:28:39.176325 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:39.176299    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"]
Sep 10 14:28:39.178322 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:28:39.178292    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192699cd_bd0a_4468_817b_fadd320e305e.slice/crio-a40715aced3414f00723306e28ee8bf7644a3e61b9442c666cded02699481d92 WatchSource:0}: Error finding container a40715aced3414f00723306e28ee8bf7644a3e61b9442c666cded02699481d92: Status 404 returned error can't find the container with id a40715aced3414f00723306e28ee8bf7644a3e61b9442c666cded02699481d92
Sep 10 14:28:39.221632 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:39.221477    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"]
Sep 10 14:28:39.224366 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:28:39.224331    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838ce0c1_d8c7_4937_8923_5e52c2e29115.slice/crio-7e2cc6403b6369ad0c71e02b99134bba5f9c94a755466597cb31aaeea074aca2 WatchSource:0}: Error finding container 7e2cc6403b6369ad0c71e02b99134bba5f9c94a755466597cb31aaeea074aca2: Status 404 returned error can't find the container with id 7e2cc6403b6369ad0c71e02b99134bba5f9c94a755466597cb31aaeea074aca2
Sep 10 14:28:39.581332 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:39.581288    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv" event={"ID":"192699cd-bd0a-4468-817b-fadd320e305e","Type":"ContainerStarted","Data":"a40715aced3414f00723306e28ee8bf7644a3e61b9442c666cded02699481d92"}
Sep 10 14:28:39.589571 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:39.589522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r" event={"ID":"838ce0c1-d8c7-4937-8923-5e52c2e29115","Type":"ContainerStarted","Data":"7e2cc6403b6369ad0c71e02b99134bba5f9c94a755466597cb31aaeea074aca2"}
Sep 10 14:28:42.610754 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:42.610645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r" event={"ID":"838ce0c1-d8c7-4937-8923-5e52c2e29115","Type":"ContainerStarted","Data":"fb6091a21ca31ae2ff02f3818adebd1e6cfffc6950db4c0e770c08f25614e8e8"}
Sep 10 14:28:42.610754 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:42.610722    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"
Sep 10 14:28:42.612344 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:42.612320    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv" event={"ID":"192699cd-bd0a-4468-817b-fadd320e305e","Type":"ContainerStarted","Data":"6b90683474af9d84561a64020af52b7dc65484e014e1aa4271c61c79fe300fca"}
Sep 10 14:28:42.612465 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:42.612451    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"
Sep 10 14:28:42.627208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:42.627151    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r" podStartSLOduration=1.505420896 podStartE2EDuration="4.62713217s" totalImagesPullingTime="3.121711274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:42.625731792 +0000 UTC m=+569.217936565" watchObservedRunningTime="2026-09-10 14:28:42.62713217 +0000 UTC m=+569.219336938"
Sep 10 14:28:42.641483 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:42.641427    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv" podStartSLOduration=1.480786031 podStartE2EDuration="4.641405828s" totalImagesPullingTime="3.160619797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:28:42.640572336 +0000 UTC m=+569.232777105" watchObservedRunningTime="2026-09-10 14:28:42.641405828 +0000 UTC m=+569.233610600"
Sep 10 14:28:48.644613 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:48.644574    2579 generic.go:356] "Generic (PLEG): container finished" podID="925f958d-3adb-4f93-ab09-1d510e1cdad0" containerID="8a96e19acef9178e14477564b15a34125b579847878280f43143165a6fe072e1" exitCode=0
Sep 10 14:28:48.644613 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:48.644617    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5" event={"ID":"925f958d-3adb-4f93-ab09-1d510e1cdad0","Type":"ContainerDied","Data":"8a96e19acef9178e14477564b15a34125b579847878280f43143165a6fe072e1"}
Sep 10 14:28:48.645128 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:48.645045    2579 scope.go:117] "RemoveContainer" containerID="8a96e19acef9178e14477564b15a34125b579847878280f43143165a6fe072e1"
Sep 10 14:28:48.646069 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:48.646040    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:28:48.646141 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:48.646124    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:28:48.646192 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:48.646176    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:28:49.651032 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:49.651000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5" event={"ID":"925f958d-3adb-4f93-ab09-1d510e1cdad0","Type":"ContainerStarted","Data":"248d4083be1dd058a4e6de05c755c68998c2cf924279458235517b21b152669a"}
Sep 10 14:28:49.791934 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:49.791899    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:28:49.792141 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:49.792114    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-b42t5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 10 14:28:49.792198 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:49.792178    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5" podUID="925f958d-3adb-4f93-ab09-1d510e1cdad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 10 14:28:50.792510 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:50.792474    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-b42t5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 10 14:28:50.792937 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:50.792529    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5" podUID="925f958d-3adb-4f93-ab09-1d510e1cdad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 10 14:28:51.792144 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:51.792106    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-b42t5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 10 14:28:51.792327 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:51.792170    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5" podUID="925f958d-3adb-4f93-ab09-1d510e1cdad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 10 14:28:52.791933 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:52.791895    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-b42t5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 10 14:28:52.792324 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:52.791960    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5" podUID="925f958d-3adb-4f93-ab09-1d510e1cdad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 10 14:28:53.620542 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:53.620509    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-45qrv"
Sep 10 14:28:53.620723 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:53.620581    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pnm4r"
Sep 10 14:28:53.792461 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:53.792425    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-b42t5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body=
Sep 10 14:28:53.792832 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:53.792484    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5" podUID="925f958d-3adb-4f93-ab09-1d510e1cdad0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused"
Sep 10 14:28:54.796627 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:54.796587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:28:54.797080 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:54.796999    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:28:54.797725 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:28:54.797704    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-b42t5"
Sep 10 14:29:13.870103 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:13.870073    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:29:13.872731 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:13.872709    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:29:13.876662 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:13.876640    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:29:13.879594 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:13.879573    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:29:42.830521 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.830431    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"]
Sep 10 14:29:42.834674 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.834647    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:42.837550 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.837440    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 14:29:42.837550 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.837545    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 14:29:42.838610 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.838560    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 10 14:29:42.838610 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.838570    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2pwwc\""
Sep 10 14:29:42.844361 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.844341    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"]
Sep 10 14:29:42.942711 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.942670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k9z4\" (UniqueName: \"kubernetes.io/projected/2416c181-4386-49f2-8cef-88f5184fb18b-kube-api-access-5k9z4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:42.942711 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.942716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2416c181-4386-49f2-8cef-88f5184fb18b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:42.943021 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.942741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:42.943021 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.942759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:42.943021 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.942844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:42.943021 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:42.942921    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.044179 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.044129    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2416c181-4386-49f2-8cef-88f5184fb18b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.044381 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.044194    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.044381 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.044224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.044381 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.044267    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.044381 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.044332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.044582 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.044384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k9z4\" (UniqueName: \"kubernetes.io/projected/2416c181-4386-49f2-8cef-88f5184fb18b-kube-api-access-5k9z4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.044706 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.044681    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.044808 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.044712    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.045073 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.044954    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.046768 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.046746    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2416c181-4386-49f2-8cef-88f5184fb18b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.046957 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.046942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2416c181-4386-49f2-8cef-88f5184fb18b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.052756 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.052735    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k9z4\" (UniqueName: \"kubernetes.io/projected/2416c181-4386-49f2-8cef-88f5184fb18b-kube-api-access-5k9z4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk\" (UID: \"2416c181-4386-49f2-8cef-88f5184fb18b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.147224 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.147135    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:43.421623 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.421595    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"]
Sep 10 14:29:43.424219 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:29:43.424191    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2416c181_4386_49f2_8cef_88f5184fb18b.slice/crio-4f3890b47d97e3a441e92c22daedced6988928de5abbdd9a6cb1e908275d4179 WatchSource:0}: Error finding container 4f3890b47d97e3a441e92c22daedced6988928de5abbdd9a6cb1e908275d4179: Status 404 returned error can't find the container with id 4f3890b47d97e3a441e92c22daedced6988928de5abbdd9a6cb1e908275d4179
Sep 10 14:29:43.425530 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.425511    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:29:43.933635 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:43.933593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk" event={"ID":"2416c181-4386-49f2-8cef-88f5184fb18b","Type":"ContainerStarted","Data":"4f3890b47d97e3a441e92c22daedced6988928de5abbdd9a6cb1e908275d4179"}
Sep 10 14:29:44.940347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:44.940311    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk" event={"ID":"2416c181-4386-49f2-8cef-88f5184fb18b","Type":"ContainerStarted","Data":"4ca5e4c6d9056c9b3124a0c0c3d92577d8f085e2fa0f161a192c61035aac29dd"}
Sep 10 14:29:44.958667 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:44.958610    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk" podStartSLOduration=1.884181673 podStartE2EDuration="2.958593495s" totalImagesPullingTime="1.074411822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:29:44.957642135 +0000 UTC m=+631.549846906" watchObservedRunningTime="2026-09-10 14:29:44.958593495 +0000 UTC m=+631.550798263"
Sep 10 14:29:53.147596 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:53.147547    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:53.148095 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:53.147613    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:53.160652 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:53.160619    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:29:54.001075 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:29:54.001046    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk"
Sep 10 14:30:00.137744 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:00.137703    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb"]
Sep 10 14:30:00.141206 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:00.141188    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb"
Sep 10 14:30:00.144903 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:00.144876    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwr7b\""
Sep 10 14:30:00.149404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:00.149375    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb"]
Sep 10 14:30:00.152157 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:00.152124    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb"
Sep 10 14:30:00.426490 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:00.426460    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb"]
Sep 10 14:30:00.428988 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:30:00.428958    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2598a15_13a6_41f4_bfee_663e5d642ac7.slice/crio-925e37bd159f3a3f1877cb6925c922e3a04191e2dbb302859a49e536ed235107 WatchSource:0}: Error finding container 925e37bd159f3a3f1877cb6925c922e3a04191e2dbb302859a49e536ed235107: Status 404 returned error can't find the container with id 925e37bd159f3a3f1877cb6925c922e3a04191e2dbb302859a49e536ed235107
Sep 10 14:30:01.025720 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:01.025681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb" event={"ID":"a2598a15-13a6-41f4-bfee-663e5d642ac7","Type":"ContainerStarted","Data":"925e37bd159f3a3f1877cb6925c922e3a04191e2dbb302859a49e536ed235107"}
Sep 10 14:30:04.042721 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:04.042685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb" event={"ID":"a2598a15-13a6-41f4-bfee-663e5d642ac7","Type":"ContainerStarted","Data":"67d9470be67a0df4a43c3f0ff255b68fc2f58df2ef52a58a62ea413cbc97a90d"}
Sep 10 14:30:04.059835 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:04.059755    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb" podStartSLOduration=1.108233763 podStartE2EDuration="4.05973948s" totalImagesPullingTime="2.951505717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:30:04.059141014 +0000 UTC m=+650.651345776" watchObservedRunningTime="2026-09-10 14:30:04.05973948 +0000 UTC m=+650.651944290"
Sep 10 14:30:05.049724 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:05.049686    2579 generic.go:356] "Generic (PLEG): container finished" podID="a2598a15-13a6-41f4-bfee-663e5d642ac7" containerID="67d9470be67a0df4a43c3f0ff255b68fc2f58df2ef52a58a62ea413cbc97a90d" exitCode=0
Sep 10 14:30:05.050131 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:05.049765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb" event={"ID":"a2598a15-13a6-41f4-bfee-663e5d642ac7","Type":"ContainerDied","Data":"67d9470be67a0df4a43c3f0ff255b68fc2f58df2ef52a58a62ea413cbc97a90d"}
Sep 10 14:30:06.192676 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:06.192649    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb"
Sep 10 14:30:07.060660 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:07.060630    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb"
Sep 10 14:30:07.060660 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:07.060641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817510-n8xkb" event={"ID":"a2598a15-13a6-41f4-bfee-663e5d642ac7","Type":"ContainerDied","Data":"925e37bd159f3a3f1877cb6925c922e3a04191e2dbb302859a49e536ed235107"}
Sep 10 14:30:07.060899 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:30:07.060682    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="925e37bd159f3a3f1877cb6925c922e3a04191e2dbb302859a49e536ed235107"
Sep 10 14:31:25.166476 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.166442    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"]
Sep 10 14:31:25.166972 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.166871    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2598a15-13a6-41f4-bfee-663e5d642ac7" containerName="cleanup"
Sep 10 14:31:25.166972 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.166882    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2598a15-13a6-41f4-bfee-663e5d642ac7" containerName="cleanup"
Sep 10 14:31:25.166972 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.166941    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2598a15-13a6-41f4-bfee-663e5d642ac7" containerName="cleanup"
Sep 10 14:31:25.169085 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.169063    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.172015 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.171986    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-600197-openshift-default-dockercfg-b7c82\""
Sep 10 14:31:25.189985 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.189948    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"]
Sep 10 14:31:25.271087 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.271047    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlzvr\" (UniqueName: \"kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-kube-api-access-dlzvr\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.271303 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.271139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-credential-socket\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.271303 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.271169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-data\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.271303 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.271213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-envoy\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.271303 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.271252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-socket\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.271773 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.271321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-istio-token\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.271773 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.271352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04a09c79-275a-403c-8b17-7500202fa5b8-istiod-ca-cert\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.271773 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.271388    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-certs\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.271773 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.271430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04a09c79-275a-403c-8b17-7500202fa5b8-istio-podinfo\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.372562 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.372529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-credential-socket\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.372562 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.372562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-data\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.372827 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.372594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-envoy\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.372827 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.372617    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-socket\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.372827 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.372656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-istio-token\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.372827 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.372673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04a09c79-275a-403c-8b17-7500202fa5b8-istiod-ca-cert\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.372827 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.372690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-certs\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.372827 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.372710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04a09c79-275a-403c-8b17-7500202fa5b8-istio-podinfo\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.372827 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.372746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlzvr\" (UniqueName: \"kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-kube-api-access-dlzvr\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.373153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.373021    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-data\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.373153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.373066    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-socket\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.373153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.373101    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-credential-socket\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.373395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.373366    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-certs\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.373529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.373481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04a09c79-275a-403c-8b17-7500202fa5b8-istiod-ca-cert\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.375154 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.375131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-envoy\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.375423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.375407    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04a09c79-275a-403c-8b17-7500202fa5b8-istio-podinfo\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.389132 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.389106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-istio-token\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.389430 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.389405    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlzvr\" (UniqueName: \"kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-kube-api-access-dlzvr\") pod \"e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") " pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.480322 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.480249    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:25.771958 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.771928    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"]
Sep 10 14:31:25.773811 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:31:25.773756    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a09c79_275a_403c_8b17_7500202fa5b8.slice/crio-96a42ba1a7a3cb002c754e263eef9cd399936be8283f5e8a036c6253c7856c2e WatchSource:0}: Error finding container 96a42ba1a7a3cb002c754e263eef9cd399936be8283f5e8a036c6253c7856c2e: Status 404 returned error can't find the container with id 96a42ba1a7a3cb002c754e263eef9cd399936be8283f5e8a036c6253c7856c2e
Sep 10 14:31:25.776038 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.776004    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:31:25.776137 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.776071    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:31:25.776137 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:25.776100    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:31:26.458856 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:26.458823    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" event={"ID":"04a09c79-275a-403c-8b17-7500202fa5b8","Type":"ContainerStarted","Data":"a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26"}
Sep 10 14:31:26.459329 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:26.458881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" event={"ID":"04a09c79-275a-403c-8b17-7500202fa5b8","Type":"ContainerStarted","Data":"96a42ba1a7a3cb002c754e263eef9cd399936be8283f5e8a036c6253c7856c2e"}
Sep 10 14:31:26.480538 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:26.480504    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:26.485733 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:26.485707    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:26.526469 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:26.526420    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" podStartSLOduration=1.526403659 podStartE2EDuration="1.526403659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:31:26.526029127 +0000 UTC m=+733.118233896" watchObservedRunningTime="2026-09-10 14:31:26.526403659 +0000 UTC m=+733.118608446"
Sep 10 14:31:27.464091 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:27.464056    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:27.465298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:27.465279    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:30.326927 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.326892    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"]
Sep 10 14:31:30.329684 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.329656    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:31:30.332543 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.332522    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-600197\""
Sep 10 14:31:30.332653 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.332579    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-600197-dockercfg-zlx6q\""
Sep 10 14:31:30.357643 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.357608    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"]
Sep 10 14:31:30.386751 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.386708    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"]
Sep 10 14:31:30.390061 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.390032    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:31:30.405014 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.404982    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"]
Sep 10 14:31:30.520648 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.520615    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgqcm\" (UniqueName: \"kubernetes.io/projected/ee1a32d1-7b5b-4a14-a78a-819f62349a66-kube-api-access-dgqcm\") pod \"payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9\" (UID: \"ee1a32d1-7b5b-4a14-a78a-819f62349a66\") " pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:31:30.520847 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.520658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d151a93-e49e-4b3d-a416-987d1eb24af8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd\" (UID: \"0d151a93-e49e-4b3d-a416-987d1eb24af8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:31:30.520847 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.520704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd8lr\" (UniqueName: \"kubernetes.io/projected/0d151a93-e49e-4b3d-a416-987d1eb24af8-kube-api-access-zd8lr\") pod \"payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd\" (UID: \"0d151a93-e49e-4b3d-a416-987d1eb24af8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:31:30.520847 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.520772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee1a32d1-7b5b-4a14-a78a-819f62349a66-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9\" (UID: \"ee1a32d1-7b5b-4a14-a78a-819f62349a66\") " pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:31:30.621347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.621268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee1a32d1-7b5b-4a14-a78a-819f62349a66-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9\" (UID: \"ee1a32d1-7b5b-4a14-a78a-819f62349a66\") " pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:31:30.621687 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.621379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgqcm\" (UniqueName: \"kubernetes.io/projected/ee1a32d1-7b5b-4a14-a78a-819f62349a66-kube-api-access-dgqcm\") pod \"payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9\" (UID: \"ee1a32d1-7b5b-4a14-a78a-819f62349a66\") " pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:31:30.621687 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.621420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d151a93-e49e-4b3d-a416-987d1eb24af8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd\" (UID: \"0d151a93-e49e-4b3d-a416-987d1eb24af8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:31:30.621687 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.621456    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd8lr\" (UniqueName: \"kubernetes.io/projected/0d151a93-e49e-4b3d-a416-987d1eb24af8-kube-api-access-zd8lr\") pod \"payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd\" (UID: \"0d151a93-e49e-4b3d-a416-987d1eb24af8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:31:30.622198 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.622173    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee1a32d1-7b5b-4a14-a78a-819f62349a66-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9\" (UID: \"ee1a32d1-7b5b-4a14-a78a-819f62349a66\") " pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:31:30.622372 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.622352    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d151a93-e49e-4b3d-a416-987d1eb24af8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd\" (UID: \"0d151a93-e49e-4b3d-a416-987d1eb24af8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:31:30.630930 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.630906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd8lr\" (UniqueName: \"kubernetes.io/projected/0d151a93-e49e-4b3d-a416-987d1eb24af8-kube-api-access-zd8lr\") pod \"payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd\" (UID: \"0d151a93-e49e-4b3d-a416-987d1eb24af8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:31:30.631027 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.630988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgqcm\" (UniqueName: \"kubernetes.io/projected/ee1a32d1-7b5b-4a14-a78a-819f62349a66-kube-api-access-dgqcm\") pod \"payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9\" (UID: \"ee1a32d1-7b5b-4a14-a78a-819f62349a66\") " pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:31:30.640848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.640813    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:31:30.705413 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.705317    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:31:30.917535 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:30.917509    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"]
Sep 10 14:31:30.920277 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:31:30.920240    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1a32d1_7b5b_4a14_a78a_819f62349a66.slice/crio-9c3cb87194dc940f245c92dddeb166013cf207871eb882c7d2c1d8bf0aa54b63 WatchSource:0}: Error finding container 9c3cb87194dc940f245c92dddeb166013cf207871eb882c7d2c1d8bf0aa54b63: Status 404 returned error can't find the container with id 9c3cb87194dc940f245c92dddeb166013cf207871eb882c7d2c1d8bf0aa54b63
Sep 10 14:31:31.002022 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:31.001999    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"]
Sep 10 14:31:31.005178 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:31:31.005139    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d151a93_e49e_4b3d_a416_987d1eb24af8.slice/crio-cd176a309ad1029942bc63567fed07bb137cf9f2ef5a1a242541ebcbb70c04f1 WatchSource:0}: Error finding container cd176a309ad1029942bc63567fed07bb137cf9f2ef5a1a242541ebcbb70c04f1: Status 404 returned error can't find the container with id cd176a309ad1029942bc63567fed07bb137cf9f2ef5a1a242541ebcbb70c04f1
Sep 10 14:31:31.489212 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:31.489173    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd" event={"ID":"0d151a93-e49e-4b3d-a416-987d1eb24af8","Type":"ContainerStarted","Data":"5edfd40b34a03a162355f9048df062e3514d80a77a37ad1f5513e00b4750c5f4"}
Sep 10 14:31:31.489674 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:31.489348    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:31:31.489674 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:31.489377    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd" event={"ID":"0d151a93-e49e-4b3d-a416-987d1eb24af8","Type":"ContainerStarted","Data":"cd176a309ad1029942bc63567fed07bb137cf9f2ef5a1a242541ebcbb70c04f1"}
Sep 10 14:31:31.490933 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:31.490905    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9" event={"ID":"ee1a32d1-7b5b-4a14-a78a-819f62349a66","Type":"ContainerStarted","Data":"a86772596bc768cbc13b7ba1a7efff7a04e8f56bef3be3f86467f31074fad03f"}
Sep 10 14:31:31.491045 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:31.490954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9" event={"ID":"ee1a32d1-7b5b-4a14-a78a-819f62349a66","Type":"ContainerStarted","Data":"9c3cb87194dc940f245c92dddeb166013cf207871eb882c7d2c1d8bf0aa54b63"}
Sep 10 14:31:31.491045 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:31.491000    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:31:31.511415 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:31.511367    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd" podStartSLOduration=1.5113514559999999 podStartE2EDuration="1.511351456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:31:31.51011705 +0000 UTC m=+738.102321820" watchObservedRunningTime="2026-09-10 14:31:31.511351456 +0000 UTC m=+738.103556224"
Sep 10 14:31:31.528611 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:31.528562    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9" podStartSLOduration=1.52854554 podStartE2EDuration="1.52854554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:31:31.527446389 +0000 UTC m=+738.119651160" watchObservedRunningTime="2026-09-10 14:31:31.52854554 +0000 UTC m=+738.120750336"
Sep 10 14:31:38.461447 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.461402    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"]
Sep 10 14:31:38.470248 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.469641    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:31:38.475397 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.475357    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"]
Sep 10 14:31:38.477632 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.477413    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ad4f3b47\""
Sep 10 14:31:38.478524 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.478497    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:31:38.482149 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.482093    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"]
Sep 10 14:31:38.484803 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.484622    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ad4f3b47-dockercfg-qq7zd\""
Sep 10 14:31:38.494471 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.494443    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"]
Sep 10 14:31:38.495995 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.495967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4edfc231-83a4-4d3e-b603-e6b4392a52ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt\" (UID: \"4edfc231-83a4-4d3e-b603-e6b4392a52ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:31:38.496157 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.496085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d06966-39c9-4518-af18-b3b5fd778620-plugins-config-volume\") pod \"payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn\" (UID: \"04d06966-39c9-4518-af18-b3b5fd778620\") " pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:31:38.496233 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.496176    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnrpq\" (UniqueName: \"kubernetes.io/projected/4edfc231-83a4-4d3e-b603-e6b4392a52ec-kube-api-access-cnrpq\") pod \"payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt\" (UID: \"4edfc231-83a4-4d3e-b603-e6b4392a52ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:31:38.496233 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.496210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h22hj\" (UniqueName: \"kubernetes.io/projected/04d06966-39c9-4518-af18-b3b5fd778620-kube-api-access-h22hj\") pod \"payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn\" (UID: \"04d06966-39c9-4518-af18-b3b5fd778620\") " pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:31:38.597003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.596970    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d06966-39c9-4518-af18-b3b5fd778620-plugins-config-volume\") pod \"payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn\" (UID: \"04d06966-39c9-4518-af18-b3b5fd778620\") " pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:31:38.597200 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.597024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnrpq\" (UniqueName: \"kubernetes.io/projected/4edfc231-83a4-4d3e-b603-e6b4392a52ec-kube-api-access-cnrpq\") pod \"payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt\" (UID: \"4edfc231-83a4-4d3e-b603-e6b4392a52ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:31:38.597200 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.597048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h22hj\" (UniqueName: \"kubernetes.io/projected/04d06966-39c9-4518-af18-b3b5fd778620-kube-api-access-h22hj\") pod \"payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn\" (UID: \"04d06966-39c9-4518-af18-b3b5fd778620\") " pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:31:38.597200 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.597078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4edfc231-83a4-4d3e-b603-e6b4392a52ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt\" (UID: \"4edfc231-83a4-4d3e-b603-e6b4392a52ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:31:38.597979 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.597948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d06966-39c9-4518-af18-b3b5fd778620-plugins-config-volume\") pod \"payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn\" (UID: \"04d06966-39c9-4518-af18-b3b5fd778620\") " pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:31:38.598093 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.598029    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4edfc231-83a4-4d3e-b603-e6b4392a52ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt\" (UID: \"4edfc231-83a4-4d3e-b603-e6b4392a52ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:31:38.606398 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.606365    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h22hj\" (UniqueName: \"kubernetes.io/projected/04d06966-39c9-4518-af18-b3b5fd778620-kube-api-access-h22hj\") pod \"payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn\" (UID: \"04d06966-39c9-4518-af18-b3b5fd778620\") " pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:31:38.606554 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.606414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnrpq\" (UniqueName: \"kubernetes.io/projected/4edfc231-83a4-4d3e-b603-e6b4392a52ec-kube-api-access-cnrpq\") pod \"payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt\" (UID: \"4edfc231-83a4-4d3e-b603-e6b4392a52ec\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:31:38.794033 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.793977    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:31:38.801302 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:38.801276    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:31:39.101824 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:39.101773    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"]
Sep 10 14:31:39.103914 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:31:39.103887    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4edfc231_83a4_4d3e_b603_e6b4392a52ec.slice/crio-f1a8534a2d05abcd6cc019520490bf01559e21229b319ed715b2180fbe35836f WatchSource:0}: Error finding container f1a8534a2d05abcd6cc019520490bf01559e21229b319ed715b2180fbe35836f: Status 404 returned error can't find the container with id f1a8534a2d05abcd6cc019520490bf01559e21229b319ed715b2180fbe35836f
Sep 10 14:31:39.125640 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:39.125576    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"]
Sep 10 14:31:39.135952 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:31:39.135927    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04d06966_39c9_4518_af18_b3b5fd778620.slice/crio-b8b4e67eaf222c067df8ec0e167cceb9d5294de76f899805795c5b16836bfde6 WatchSource:0}: Error finding container b8b4e67eaf222c067df8ec0e167cceb9d5294de76f899805795c5b16836bfde6: Status 404 returned error can't find the container with id b8b4e67eaf222c067df8ec0e167cceb9d5294de76f899805795c5b16836bfde6
Sep 10 14:31:39.542212 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:39.542169    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn" event={"ID":"04d06966-39c9-4518-af18-b3b5fd778620","Type":"ContainerStarted","Data":"bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34"}
Sep 10 14:31:39.542691 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:39.542237    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:31:39.542691 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:39.542260    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn" event={"ID":"04d06966-39c9-4518-af18-b3b5fd778620","Type":"ContainerStarted","Data":"b8b4e67eaf222c067df8ec0e167cceb9d5294de76f899805795c5b16836bfde6"}
Sep 10 14:31:39.543887 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:39.543863    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt" event={"ID":"4edfc231-83a4-4d3e-b603-e6b4392a52ec","Type":"ContainerStarted","Data":"a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d"}
Sep 10 14:31:39.543996 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:39.543909    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt" event={"ID":"4edfc231-83a4-4d3e-b603-e6b4392a52ec","Type":"ContainerStarted","Data":"f1a8534a2d05abcd6cc019520490bf01559e21229b319ed715b2180fbe35836f"}
Sep 10 14:31:39.543996 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:39.543929    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:31:39.596256 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:39.596202    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt" podStartSLOduration=1.596185491 podStartE2EDuration="1.596185491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:31:39.59434041 +0000 UTC m=+746.186545195" watchObservedRunningTime="2026-09-10 14:31:39.596185491 +0000 UTC m=+746.188390259"
Sep 10 14:31:39.596499 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:39.596287    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn" podStartSLOduration=1.596281275 podStartE2EDuration="1.596281275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:31:39.567631083 +0000 UTC m=+746.159835854" watchObservedRunningTime="2026-09-10 14:31:39.596281275 +0000 UTC m=+746.188486101"
Sep 10 14:31:40.206425 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.206389    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"]
Sep 10 14:31:40.209128 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.209110    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:31:40.211926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.211899    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-d24d4c\""
Sep 10 14:31:40.212041 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.211952    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-d24d4c-dockercfg-9xz7p\""
Sep 10 14:31:40.226992 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.226957    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"]
Sep 10 14:31:40.313208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.313171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-684dl\" (UniqueName: \"kubernetes.io/projected/831b1cd6-a9ad-41ce-9bee-b720661a53d8-kube-api-access-684dl\") pod \"payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw\" (UID: \"831b1cd6-a9ad-41ce-9bee-b720661a53d8\") " pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:31:40.313409 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.313242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/831b1cd6-a9ad-41ce-9bee-b720661a53d8-plugins-config-volume\") pod \"payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw\" (UID: \"831b1cd6-a9ad-41ce-9bee-b720661a53d8\") " pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:31:40.414439 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.414397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-684dl\" (UniqueName: \"kubernetes.io/projected/831b1cd6-a9ad-41ce-9bee-b720661a53d8-kube-api-access-684dl\") pod \"payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw\" (UID: \"831b1cd6-a9ad-41ce-9bee-b720661a53d8\") " pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:31:40.414627 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.414463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/831b1cd6-a9ad-41ce-9bee-b720661a53d8-plugins-config-volume\") pod \"payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw\" (UID: \"831b1cd6-a9ad-41ce-9bee-b720661a53d8\") " pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:31:40.415218 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.415198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/831b1cd6-a9ad-41ce-9bee-b720661a53d8-plugins-config-volume\") pod \"payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw\" (UID: \"831b1cd6-a9ad-41ce-9bee-b720661a53d8\") " pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:31:40.426399 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.426362    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-684dl\" (UniqueName: \"kubernetes.io/projected/831b1cd6-a9ad-41ce-9bee-b720661a53d8-kube-api-access-684dl\") pod \"payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw\" (UID: \"831b1cd6-a9ad-41ce-9bee-b720661a53d8\") " pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:31:40.520393 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.520354    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:31:40.834942 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:40.834912    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"]
Sep 10 14:31:40.836201 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:31:40.836169    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831b1cd6_a9ad_41ce_9bee_b720661a53d8.slice/crio-8cf79de16accbdd2c29dcde615477d86c02b538ee1ffd09d1d93abd03e3c4ca2 WatchSource:0}: Error finding container 8cf79de16accbdd2c29dcde615477d86c02b538ee1ffd09d1d93abd03e3c4ca2: Status 404 returned error can't find the container with id 8cf79de16accbdd2c29dcde615477d86c02b538ee1ffd09d1d93abd03e3c4ca2
Sep 10 14:31:41.583435 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:41.583384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw" event={"ID":"831b1cd6-a9ad-41ce-9bee-b720661a53d8","Type":"ContainerStarted","Data":"1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f"}
Sep 10 14:31:41.583658 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:41.583481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw" event={"ID":"831b1cd6-a9ad-41ce-9bee-b720661a53d8","Type":"ContainerStarted","Data":"8cf79de16accbdd2c29dcde615477d86c02b538ee1ffd09d1d93abd03e3c4ca2"}
Sep 10 14:31:41.584679 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:41.584646    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:31:41.602672 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:41.602608    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw" podStartSLOduration=1.6025685219999999 podStartE2EDuration="1.602568522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:31:41.602199612 +0000 UTC m=+748.194404378" watchObservedRunningTime="2026-09-10 14:31:41.602568522 +0000 UTC m=+748.194773284"
Sep 10 14:31:42.499719 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:42.499680    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:31:42.500190 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:42.499764    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:31:46.615689 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:46.615653    2579 generic.go:356] "Generic (PLEG): container finished" podID="04a09c79-275a-403c-8b17-7500202fa5b8" containerID="a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26" exitCode=0
Sep 10 14:31:46.616147 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:46.615726    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" event={"ID":"04a09c79-275a-403c-8b17-7500202fa5b8","Type":"ContainerDied","Data":"a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26"}
Sep 10 14:31:46.616211 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:46.616195    2579 scope.go:117] "RemoveContainer" containerID="a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26"
Sep 10 14:31:46.617350 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:46.617324    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:31:46.617426 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:46.617389    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:31:46.617426 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:46.617418    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:31:47.623378 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:47.623339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" event={"ID":"04a09c79-275a-403c-8b17-7500202fa5b8","Type":"ContainerStarted","Data":"3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e"}
Sep 10 14:31:48.481288 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:48.481249    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:48.481497 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:48.481427    2579 patch_prober.go:28] interesting pod/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Sep 10 14:31:48.481497 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:48.481476    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Sep 10 14:31:49.480986 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:49.480952    2579 patch_prober.go:28] interesting pod/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Sep 10 14:31:49.481432 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:49.481009    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Sep 10 14:31:50.480950 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:50.480912    2579 patch_prober.go:28] interesting pod/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Sep 10 14:31:50.481135 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:50.480971    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Sep 10 14:31:50.552762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:50.552728    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:31:50.552977 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:50.552847    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:31:51.481446 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:51.481402    2579 patch_prober.go:28] interesting pod/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Sep 10 14:31:51.481983 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:51.481477    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Sep 10 14:31:52.481205 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:52.481164    2579 patch_prober.go:28] interesting pod/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body=
Sep 10 14:31:52.481405 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:52.481245    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused"
Sep 10 14:31:53.485275 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:53.485242    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:53.485642 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:53.485516    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:53.486425 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:53.486406    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:31:53.600005 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:53.599967    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:31:59.303181 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.303138    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"]
Sep 10 14:31:59.306310 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.306287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:31:59.309384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.309357    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-8ee208\""
Sep 10 14:31:59.309515 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.309369    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-8ee208-dockercfg-49vv5\""
Sep 10 14:31:59.318730 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.318698    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"]
Sep 10 14:31:59.347843 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.347808    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"]
Sep 10 14:31:59.350247 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.350227    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:31:59.362733 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.362689    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"]
Sep 10 14:31:59.400016 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.399607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9lg2\" (UniqueName: \"kubernetes.io/projected/85f2fa43-e19c-4728-a7b7-026d3db0a648-kube-api-access-l9lg2\") pod \"payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn\" (UID: \"85f2fa43-e19c-4728-a7b7-026d3db0a648\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:31:59.400016 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.399939    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e4543cd-3d26-4d40-af64-ba4feb988830-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs\" (UID: \"5e4543cd-3d26-4d40-af64-ba4feb988830\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:31:59.401470 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.400138    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f2fa43-e19c-4728-a7b7-026d3db0a648-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn\" (UID: \"85f2fa43-e19c-4728-a7b7-026d3db0a648\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:31:59.401470 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.400213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94npd\" (UniqueName: \"kubernetes.io/projected/5e4543cd-3d26-4d40-af64-ba4feb988830-kube-api-access-94npd\") pod \"payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs\" (UID: \"5e4543cd-3d26-4d40-af64-ba4feb988830\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:31:59.501123 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.501078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e4543cd-3d26-4d40-af64-ba4feb988830-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs\" (UID: \"5e4543cd-3d26-4d40-af64-ba4feb988830\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:31:59.501328 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.501144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f2fa43-e19c-4728-a7b7-026d3db0a648-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn\" (UID: \"85f2fa43-e19c-4728-a7b7-026d3db0a648\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:31:59.501328 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.501204    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94npd\" (UniqueName: \"kubernetes.io/projected/5e4543cd-3d26-4d40-af64-ba4feb988830-kube-api-access-94npd\") pod \"payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs\" (UID: \"5e4543cd-3d26-4d40-af64-ba4feb988830\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:31:59.501328 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.501248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9lg2\" (UniqueName: \"kubernetes.io/projected/85f2fa43-e19c-4728-a7b7-026d3db0a648-kube-api-access-l9lg2\") pod \"payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn\" (UID: \"85f2fa43-e19c-4728-a7b7-026d3db0a648\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:31:59.501975 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.501951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e4543cd-3d26-4d40-af64-ba4feb988830-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs\" (UID: \"5e4543cd-3d26-4d40-af64-ba4feb988830\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:31:59.502072 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.501983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f2fa43-e19c-4728-a7b7-026d3db0a648-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn\" (UID: \"85f2fa43-e19c-4728-a7b7-026d3db0a648\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:31:59.510354 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.510317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94npd\" (UniqueName: \"kubernetes.io/projected/5e4543cd-3d26-4d40-af64-ba4feb988830-kube-api-access-94npd\") pod \"payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs\" (UID: \"5e4543cd-3d26-4d40-af64-ba4feb988830\") " pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:31:59.510506 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.510376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9lg2\" (UniqueName: \"kubernetes.io/projected/85f2fa43-e19c-4728-a7b7-026d3db0a648-kube-api-access-l9lg2\") pod \"payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn\" (UID: \"85f2fa43-e19c-4728-a7b7-026d3db0a648\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:31:59.617924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.617835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:31:59.663139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.663100    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:31:59.898183 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.898157    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"]
Sep 10 14:31:59.900072 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:31:59.900046    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f2fa43_e19c_4728_a7b7_026d3db0a648.slice/crio-a5d7962a70c273300928e8a387f83e2f8c2ce314dedb505f415e467432ccafd2 WatchSource:0}: Error finding container a5d7962a70c273300928e8a387f83e2f8c2ce314dedb505f415e467432ccafd2: Status 404 returned error can't find the container with id a5d7962a70c273300928e8a387f83e2f8c2ce314dedb505f415e467432ccafd2
Sep 10 14:31:59.955285 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:31:59.955264    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"]
Sep 10 14:31:59.958936 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:31:59.958909    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4543cd_3d26_4d40_af64_ba4feb988830.slice/crio-f18dfedae5264d845a5ef59dab046796b3e11e44ee2f4cfc390ffd8fc9e865a2 WatchSource:0}: Error finding container f18dfedae5264d845a5ef59dab046796b3e11e44ee2f4cfc390ffd8fc9e865a2: Status 404 returned error can't find the container with id f18dfedae5264d845a5ef59dab046796b3e11e44ee2f4cfc390ffd8fc9e865a2
Sep 10 14:32:00.708539 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:00.708494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn" event={"ID":"85f2fa43-e19c-4728-a7b7-026d3db0a648","Type":"ContainerStarted","Data":"7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618"}
Sep 10 14:32:00.709038 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:00.708555    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn" event={"ID":"85f2fa43-e19c-4728-a7b7-026d3db0a648","Type":"ContainerStarted","Data":"a5d7962a70c273300928e8a387f83e2f8c2ce314dedb505f415e467432ccafd2"}
Sep 10 14:32:00.709038 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:00.708582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:32:00.710433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:00.710408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs" event={"ID":"5e4543cd-3d26-4d40-af64-ba4feb988830","Type":"ContainerStarted","Data":"465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518"}
Sep 10 14:32:00.710559 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:00.710448    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs" event={"ID":"5e4543cd-3d26-4d40-af64-ba4feb988830","Type":"ContainerStarted","Data":"f18dfedae5264d845a5ef59dab046796b3e11e44ee2f4cfc390ffd8fc9e865a2"}
Sep 10 14:32:00.710559 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:00.710512    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:32:00.727879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:00.727830    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn" podStartSLOduration=1.7278145729999999 podStartE2EDuration="1.727814573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:00.725885399 +0000 UTC m=+767.318090170" watchObservedRunningTime="2026-09-10 14:32:00.727814573 +0000 UTC m=+767.320019339"
Sep 10 14:32:00.746800 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:00.746734    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs" podStartSLOduration=1.746717015 podStartE2EDuration="1.746717015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:31:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:00.744125612 +0000 UTC m=+767.336330382" watchObservedRunningTime="2026-09-10 14:32:00.746717015 +0000 UTC m=+767.338921783"
Sep 10 14:32:11.718487 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:11.718454    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:32:11.719005 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:11.718538    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:32:18.438208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.438157    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"]
Sep 10 14:32:18.438682 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.438428    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn" podUID="04d06966-39c9-4518-af18-b3b5fd778620" containerName="payload-processing" containerID="cri-o://bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34" gracePeriod=30
Sep 10 14:32:18.441322 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.441291    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"]
Sep 10 14:32:18.441557 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.441525    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt" podUID="4edfc231-83a4-4d3e-b603-e6b4392a52ec" containerName="payload-pre-processing" containerID="cri-o://a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d" gracePeriod=30
Sep 10 14:32:18.747411 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.747373    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:32:18.752318 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.752287    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:32:18.801582 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.801547    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h22hj\" (UniqueName: \"kubernetes.io/projected/04d06966-39c9-4518-af18-b3b5fd778620-kube-api-access-h22hj\") pod \"04d06966-39c9-4518-af18-b3b5fd778620\" (UID: \"04d06966-39c9-4518-af18-b3b5fd778620\") "
Sep 10 14:32:18.801811 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.801595    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d06966-39c9-4518-af18-b3b5fd778620-plugins-config-volume\") pod \"04d06966-39c9-4518-af18-b3b5fd778620\" (UID: \"04d06966-39c9-4518-af18-b3b5fd778620\") "
Sep 10 14:32:18.801811 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.801668    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnrpq\" (UniqueName: \"kubernetes.io/projected/4edfc231-83a4-4d3e-b603-e6b4392a52ec-kube-api-access-cnrpq\") pod \"4edfc231-83a4-4d3e-b603-e6b4392a52ec\" (UID: \"4edfc231-83a4-4d3e-b603-e6b4392a52ec\") "
Sep 10 14:32:18.801811 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.801708    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4edfc231-83a4-4d3e-b603-e6b4392a52ec-plugins-config-volume\") pod \"4edfc231-83a4-4d3e-b603-e6b4392a52ec\" (UID: \"4edfc231-83a4-4d3e-b603-e6b4392a52ec\") "
Sep 10 14:32:18.802069 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.802044    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04d06966-39c9-4518-af18-b3b5fd778620-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "04d06966-39c9-4518-af18-b3b5fd778620" (UID: "04d06966-39c9-4518-af18-b3b5fd778620"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:32:18.802159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.802139    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4edfc231-83a4-4d3e-b603-e6b4392a52ec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4edfc231-83a4-4d3e-b603-e6b4392a52ec" (UID: "4edfc231-83a4-4d3e-b603-e6b4392a52ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:32:18.804475 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.804447    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04d06966-39c9-4518-af18-b3b5fd778620-kube-api-access-h22hj" (OuterVolumeSpecName: "kube-api-access-h22hj") pod "04d06966-39c9-4518-af18-b3b5fd778620" (UID: "04d06966-39c9-4518-af18-b3b5fd778620"). InnerVolumeSpecName "kube-api-access-h22hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:32:18.804566 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.804470    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4edfc231-83a4-4d3e-b603-e6b4392a52ec-kube-api-access-cnrpq" (OuterVolumeSpecName: "kube-api-access-cnrpq") pod "4edfc231-83a4-4d3e-b603-e6b4392a52ec" (UID: "4edfc231-83a4-4d3e-b603-e6b4392a52ec"). InnerVolumeSpecName "kube-api-access-cnrpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:32:18.819960 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.819926    2579 generic.go:356] "Generic (PLEG): container finished" podID="04d06966-39c9-4518-af18-b3b5fd778620" containerID="bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34" exitCode=0
Sep 10 14:32:18.820120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.819967    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"
Sep 10 14:32:18.820120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.820005    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn" event={"ID":"04d06966-39c9-4518-af18-b3b5fd778620","Type":"ContainerDied","Data":"bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34"}
Sep 10 14:32:18.820120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.820092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn" event={"ID":"04d06966-39c9-4518-af18-b3b5fd778620","Type":"ContainerDied","Data":"b8b4e67eaf222c067df8ec0e167cceb9d5294de76f899805795c5b16836bfde6"}
Sep 10 14:32:18.820294 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.820123    2579 scope.go:117] "RemoveContainer" containerID="bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34"
Sep 10 14:32:18.821620 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.821597    2579 generic.go:356] "Generic (PLEG): container finished" podID="4edfc231-83a4-4d3e-b603-e6b4392a52ec" containerID="a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d" exitCode=0
Sep 10 14:32:18.821728 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.821650    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt" event={"ID":"4edfc231-83a4-4d3e-b603-e6b4392a52ec","Type":"ContainerDied","Data":"a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d"}
Sep 10 14:32:18.821728 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.821712    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt" event={"ID":"4edfc231-83a4-4d3e-b603-e6b4392a52ec","Type":"ContainerDied","Data":"f1a8534a2d05abcd6cc019520490bf01559e21229b319ed715b2180fbe35836f"}
Sep 10 14:32:18.821886 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.821657    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"
Sep 10 14:32:18.829890 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.829867    2579 scope.go:117] "RemoveContainer" containerID="bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34"
Sep 10 14:32:18.830252 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:32:18.830226    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34\": container with ID starting with bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34 not found: ID does not exist" containerID="bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34"
Sep 10 14:32:18.830339 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.830264    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34"} err="failed to get container status \"bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34\": rpc error: code = NotFound desc = could not find container \"bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34\": container with ID starting with bb81c9baf024d34381d2c810961fdfaa344c2ed7a82470a4b0ddddb6bb55fe34 not found: ID does not exist"
Sep 10 14:32:18.830339 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.830284    2579 scope.go:117] "RemoveContainer" containerID="a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d"
Sep 10 14:32:18.838664 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.838645    2579 scope.go:117] "RemoveContainer" containerID="a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d"
Sep 10 14:32:18.838959 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:32:18.838940    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d\": container with ID starting with a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d not found: ID does not exist" containerID="a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d"
Sep 10 14:32:18.839013 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.838967    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d"} err="failed to get container status \"a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d\": rpc error: code = NotFound desc = could not find container \"a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d\": container with ID starting with a4aac618640f968bd64f36ce11395c8892af0c64b54835a2d2dc7c59296ce57d not found: ID does not exist"
Sep 10 14:32:18.848529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.848499    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"]
Sep 10 14:32:18.852495 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.852467    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ad4f3b47-6cbd778fcd-gktnt"]
Sep 10 14:32:18.868925 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.868890    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"]
Sep 10 14:32:18.871695 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.871667    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ad4f3b47-9cdfc69df-q56rn"]
Sep 10 14:32:18.902462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.902423    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h22hj\" (UniqueName: \"kubernetes.io/projected/04d06966-39c9-4518-af18-b3b5fd778620-kube-api-access-h22hj\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:18.902462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.902454    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/04d06966-39c9-4518-af18-b3b5fd778620-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:18.902462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.902465    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnrpq\" (UniqueName: \"kubernetes.io/projected/4edfc231-83a4-4d3e-b603-e6b4392a52ec-kube-api-access-cnrpq\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:18.902680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:18.902473    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4edfc231-83a4-4d3e-b603-e6b4392a52ec-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:19.756900 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.756859    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"]
Sep 10 14:32:19.757562 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.757523    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4edfc231-83a4-4d3e-b603-e6b4392a52ec" containerName="payload-pre-processing"
Sep 10 14:32:19.757562 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.757550    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4edfc231-83a4-4d3e-b603-e6b4392a52ec" containerName="payload-pre-processing"
Sep 10 14:32:19.757969 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.757576    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04d06966-39c9-4518-af18-b3b5fd778620" containerName="payload-processing"
Sep 10 14:32:19.757969 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.757586    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="04d06966-39c9-4518-af18-b3b5fd778620" containerName="payload-processing"
Sep 10 14:32:19.757969 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.757689    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4edfc231-83a4-4d3e-b603-e6b4392a52ec" containerName="payload-pre-processing"
Sep 10 14:32:19.757969 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.757701    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="04d06966-39c9-4518-af18-b3b5fd778620" containerName="payload-processing"
Sep 10 14:32:19.760868 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.760848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.764053 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.764031    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d320da1d-gw-openshift-default-dockercfg-l9skz\""
Sep 10 14:32:19.780530 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.780503    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"]
Sep 10 14:32:19.809438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.809405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff280111-4468-453e-8490-c8839d93c42a-istio-podinfo\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.809677 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.809446    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff280111-4468-453e-8490-c8839d93c42a-istiod-ca-cert\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.809677 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.809533    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6kl4\" (UniqueName: \"kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-kube-api-access-t6kl4\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.809677 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.809562    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-certs\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.809677 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.809634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-istio-token\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.809677 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.809665    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-socket\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.809931 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.809737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-data\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.809931 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.809805    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-envoy\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.809931 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.809835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-credential-socket\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.911046 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-socket\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.911250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-data\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.911250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-envoy\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.911250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-credential-socket\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.911250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff280111-4468-453e-8490-c8839d93c42a-istio-podinfo\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.911250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff280111-4468-453e-8490-c8839d93c42a-istiod-ca-cert\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.911523 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6kl4\" (UniqueName: \"kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-kube-api-access-t6kl4\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.911523 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-certs\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.911523 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-istio-token\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.911523 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-data\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.911916 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911807    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-credential-socket\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.912045 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.911913    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-certs\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.912114 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.912058    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-socket\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.912307 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.912280    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff280111-4468-453e-8490-c8839d93c42a-istiod-ca-cert\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.914630 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.914598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-envoy\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.914949 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.914930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff280111-4468-453e-8490-c8839d93c42a-istio-podinfo\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.915380 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.915353    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04d06966-39c9-4518-af18-b3b5fd778620" path="/var/lib/kubelet/pods/04d06966-39c9-4518-af18-b3b5fd778620/volumes"
Sep 10 14:32:19.915872 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.915850    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4edfc231-83a4-4d3e-b603-e6b4392a52ec" path="/var/lib/kubelet/pods/4edfc231-83a4-4d3e-b603-e6b4392a52ec/volumes"
Sep 10 14:32:19.932825 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.932733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-istio-token\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:19.933623 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:19.933595    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6kl4\" (UniqueName: \"kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-kube-api-access-t6kl4\") pod \"e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") " pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:20.071966 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:20.071884    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:20.348715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:20.348689    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"]
Sep 10 14:32:20.350456 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:32:20.350425    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff280111_4468_453e_8490_c8839d93c42a.slice/crio-9d67a97bb05509828880bc74438c9db9c37a938d1a6711f165e4b812ed1cfbd2 WatchSource:0}: Error finding container 9d67a97bb05509828880bc74438c9db9c37a938d1a6711f165e4b812ed1cfbd2: Status 404 returned error can't find the container with id 9d67a97bb05509828880bc74438c9db9c37a938d1a6711f165e4b812ed1cfbd2
Sep 10 14:32:20.352664 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:20.352625    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:32:20.352754 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:20.352690    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:32:20.352754 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:20.352717    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:32:20.835458 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:20.835425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" event={"ID":"ff280111-4468-453e-8490-c8839d93c42a","Type":"ContainerStarted","Data":"ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573"}
Sep 10 14:32:20.835845 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:20.835481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" event={"ID":"ff280111-4468-453e-8490-c8839d93c42a","Type":"ContainerStarted","Data":"9d67a97bb05509828880bc74438c9db9c37a938d1a6711f165e4b812ed1cfbd2"}
Sep 10 14:32:20.857431 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:20.857371    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" podStartSLOduration=1.857353468 podStartE2EDuration="1.857353468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:20.854623017 +0000 UTC m=+787.446827787" watchObservedRunningTime="2026-09-10 14:32:20.857353468 +0000 UTC m=+787.449558237"
Sep 10 14:32:21.072842 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:21.072806    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:21.078283 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:21.078257    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:21.841051 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:21.841015    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:21.842101 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:21.842083    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:23.239924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.239894    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"]
Sep 10 14:32:23.242806 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.242770    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:23.245508 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.245485    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d320da1d\""
Sep 10 14:32:23.272932 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.272882    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"]
Sep 10 14:32:23.277904 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.277872    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"]
Sep 10 14:32:23.278066 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.277980    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:23.281527 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.281502    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d320da1d-dockercfg-fpmpt\""
Sep 10 14:32:23.285186 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.285158    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"]
Sep 10 14:32:23.344960 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.344913    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5l9t\" (UniqueName: \"kubernetes.io/projected/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-kube-api-access-z5l9t\") pod \"payload-processing-e2e-migrate-d320da1d-54c956c678-h7997\" (UID: \"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8\") " pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:23.345309 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.345284    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvql8\" (UniqueName: \"kubernetes.io/projected/81382093-9f75-46c8-8521-34400e6d7531-kube-api-access-hvql8\") pod \"payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd\" (UID: \"81382093-9f75-46c8-8521-34400e6d7531\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:23.345520 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.345504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81382093-9f75-46c8-8521-34400e6d7531-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd\" (UID: \"81382093-9f75-46c8-8521-34400e6d7531\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:23.345731 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.345708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d320da1d-54c956c678-h7997\" (UID: \"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8\") " pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:23.447327 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.447294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5l9t\" (UniqueName: \"kubernetes.io/projected/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-kube-api-access-z5l9t\") pod \"payload-processing-e2e-migrate-d320da1d-54c956c678-h7997\" (UID: \"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8\") " pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:23.447500 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.447358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvql8\" (UniqueName: \"kubernetes.io/projected/81382093-9f75-46c8-8521-34400e6d7531-kube-api-access-hvql8\") pod \"payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd\" (UID: \"81382093-9f75-46c8-8521-34400e6d7531\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:23.447500 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.447416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81382093-9f75-46c8-8521-34400e6d7531-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd\" (UID: \"81382093-9f75-46c8-8521-34400e6d7531\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:23.447613 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.447521    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d320da1d-54c956c678-h7997\" (UID: \"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8\") " pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:23.448176 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.448158    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81382093-9f75-46c8-8521-34400e6d7531-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd\" (UID: \"81382093-9f75-46c8-8521-34400e6d7531\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:23.448221 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.448182    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d320da1d-54c956c678-h7997\" (UID: \"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8\") " pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:23.456836 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.456811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5l9t\" (UniqueName: \"kubernetes.io/projected/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-kube-api-access-z5l9t\") pod \"payload-processing-e2e-migrate-d320da1d-54c956c678-h7997\" (UID: \"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8\") " pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:23.457256 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.457227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvql8\" (UniqueName: \"kubernetes.io/projected/81382093-9f75-46c8-8521-34400e6d7531-kube-api-access-hvql8\") pod \"payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd\" (UID: \"81382093-9f75-46c8-8521-34400e6d7531\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:23.566662 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.566625    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:23.591042 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.591008    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:23.845108 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.845081    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"]
Sep 10 14:32:23.847652 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:32:23.847623    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81382093_9f75_46c8_8521_34400e6d7531.slice/crio-02afb9217cb440a877909c67113a3cd2df9f65f1456aa2c7f32c750a47d1e845 WatchSource:0}: Error finding container 02afb9217cb440a877909c67113a3cd2df9f65f1456aa2c7f32c750a47d1e845: Status 404 returned error can't find the container with id 02afb9217cb440a877909c67113a3cd2df9f65f1456aa2c7f32c750a47d1e845
Sep 10 14:32:23.878301 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:23.878276    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"]
Sep 10 14:32:23.886031 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:32:23.885991    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34f4375e_a8d7_4f3b_9389_b4196c9ee0f8.slice/crio-1d0c00ce85c604cc486b878054299263c31b2dff255dfe804e927e58b43e1d05 WatchSource:0}: Error finding container 1d0c00ce85c604cc486b878054299263c31b2dff255dfe804e927e58b43e1d05: Status 404 returned error can't find the container with id 1d0c00ce85c604cc486b878054299263c31b2dff255dfe804e927e58b43e1d05
Sep 10 14:32:24.860382 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:24.860346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997" event={"ID":"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8","Type":"ContainerStarted","Data":"617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958"}
Sep 10 14:32:24.860857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:24.860430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997" event={"ID":"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8","Type":"ContainerStarted","Data":"1d0c00ce85c604cc486b878054299263c31b2dff255dfe804e927e58b43e1d05"}
Sep 10 14:32:24.860857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:24.860484    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:24.862298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:24.862271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd" event={"ID":"81382093-9f75-46c8-8521-34400e6d7531","Type":"ContainerStarted","Data":"91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c"}
Sep 10 14:32:24.862408 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:24.862323    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd" event={"ID":"81382093-9f75-46c8-8521-34400e6d7531","Type":"ContainerStarted","Data":"02afb9217cb440a877909c67113a3cd2df9f65f1456aa2c7f32c750a47d1e845"}
Sep 10 14:32:24.862408 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:24.862380    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:24.878163 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:24.878108    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997" podStartSLOduration=1.878093987 podStartE2EDuration="1.878093987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:24.876013164 +0000 UTC m=+791.468217950" watchObservedRunningTime="2026-09-10 14:32:24.878093987 +0000 UTC m=+791.470298756"
Sep 10 14:32:24.892537 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:24.892475    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd" podStartSLOduration=1.892451876 podStartE2EDuration="1.892451876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:32:24.891123728 +0000 UTC m=+791.483328512" watchObservedRunningTime="2026-09-10 14:32:24.892451876 +0000 UTC m=+791.484656646"
Sep 10 14:32:35.873460 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:35.873372    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:35.874925 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:35.874902    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:43.969313 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:43.969223    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff280111-4468-453e-8490-c8839d93c42a" containerID="ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573" exitCode=0
Sep 10 14:32:43.969313 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:43.969298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" event={"ID":"ff280111-4468-453e-8490-c8839d93c42a","Type":"ContainerDied","Data":"ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573"}
Sep 10 14:32:43.969730 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:43.969716    2579 scope.go:117] "RemoveContainer" containerID="ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573"
Sep 10 14:32:43.970916 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:43.970886    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:32:43.970976 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:43.970963    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:32:43.971016 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:43.970997    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:32:44.981995 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:44.981949    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" event={"ID":"ff280111-4468-453e-8490-c8839d93c42a","Type":"ContainerStarted","Data":"c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd"}
Sep 10 14:32:45.072432 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:45.072385    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:45.072645 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:45.072442    2579 patch_prober.go:28] interesting pod/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 10 14:32:45.072645 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:45.072504    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 10 14:32:46.072659 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:46.072612    2579 patch_prober.go:28] interesting pod/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 10 14:32:46.073190 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:46.072696    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 10 14:32:47.072579 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:47.072541    2579 patch_prober.go:28] interesting pod/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 10 14:32:47.072942 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:47.072910    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 10 14:32:48.073111 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:48.073069    2579 patch_prober.go:28] interesting pod/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 10 14:32:48.073736 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:48.073702    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 10 14:32:49.072669 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:49.072617    2579 patch_prober.go:28] interesting pod/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 10 14:32:49.072923 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:49.072692    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 10 14:32:50.072923 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:50.072880    2579 patch_prober.go:28] interesting pod/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 10 14:32:50.073513 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:50.073474    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 10 14:32:51.077360 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:51.077326    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:51.077819 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:51.077605    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:51.078503 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:51.078482    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:53.987421 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:53.987384    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"]
Sep 10 14:32:53.987862 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:53.987605    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997" podUID="34f4375e-a8d7-4f3b-9389-b4196c9ee0f8" containerName="payload-processing" containerID="cri-o://617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958" gracePeriod=30
Sep 10 14:32:53.999166 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:53.999130    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"]
Sep 10 14:32:53.999565 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:53.999534    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd" podUID="81382093-9f75-46c8-8521-34400e6d7531" containerName="payload-pre-processing" containerID="cri-o://91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c" gracePeriod=30
Sep 10 14:32:54.264508 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.264481    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:54.311660 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.311623    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:54.322618 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.322585    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"]
Sep 10 14:32:54.322854 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.322770    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy" containerID="cri-o://c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd" gracePeriod=30
Sep 10 14:32:54.366433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.366401    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81382093-9f75-46c8-8521-34400e6d7531-plugins-config-volume\") pod \"81382093-9f75-46c8-8521-34400e6d7531\" (UID: \"81382093-9f75-46c8-8521-34400e6d7531\") "
Sep 10 14:32:54.366812 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.366468    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-plugins-config-volume\") pod \"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8\" (UID: \"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8\") "
Sep 10 14:32:54.366812 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.366512    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5l9t\" (UniqueName: \"kubernetes.io/projected/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-kube-api-access-z5l9t\") pod \"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8\" (UID: \"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8\") "
Sep 10 14:32:54.366812 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.366637    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvql8\" (UniqueName: \"kubernetes.io/projected/81382093-9f75-46c8-8521-34400e6d7531-kube-api-access-hvql8\") pod \"81382093-9f75-46c8-8521-34400e6d7531\" (UID: \"81382093-9f75-46c8-8521-34400e6d7531\") "
Sep 10 14:32:54.367039 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.366908    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "34f4375e-a8d7-4f3b-9389-b4196c9ee0f8" (UID: "34f4375e-a8d7-4f3b-9389-b4196c9ee0f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:32:54.367039 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.366915    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81382093-9f75-46c8-8521-34400e6d7531-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "81382093-9f75-46c8-8521-34400e6d7531" (UID: "81382093-9f75-46c8-8521-34400e6d7531"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:32:54.367119 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.367045    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81382093-9f75-46c8-8521-34400e6d7531-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:54.367119 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.367064    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:54.369074 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.369039    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81382093-9f75-46c8-8521-34400e6d7531-kube-api-access-hvql8" (OuterVolumeSpecName: "kube-api-access-hvql8") pod "81382093-9f75-46c8-8521-34400e6d7531" (UID: "81382093-9f75-46c8-8521-34400e6d7531"). InnerVolumeSpecName "kube-api-access-hvql8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:32:54.369182 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.369103    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-kube-api-access-z5l9t" (OuterVolumeSpecName: "kube-api-access-z5l9t") pod "34f4375e-a8d7-4f3b-9389-b4196c9ee0f8" (UID: "34f4375e-a8d7-4f3b-9389-b4196c9ee0f8"). InnerVolumeSpecName "kube-api-access-z5l9t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:32:54.469414 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.469384    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5l9t\" (UniqueName: \"kubernetes.io/projected/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8-kube-api-access-z5l9t\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:54.469414 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:54.469412    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvql8\" (UniqueName: \"kubernetes.io/projected/81382093-9f75-46c8-8521-34400e6d7531-kube-api-access-hvql8\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:55.042250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.042214    2579 generic.go:356] "Generic (PLEG): container finished" podID="34f4375e-a8d7-4f3b-9389-b4196c9ee0f8" containerID="617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958" exitCode=0
Sep 10 14:32:55.042717 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.042287    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"
Sep 10 14:32:55.042717 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.042348    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997" event={"ID":"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8","Type":"ContainerDied","Data":"617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958"}
Sep 10 14:32:55.042717 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.042422    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997" event={"ID":"34f4375e-a8d7-4f3b-9389-b4196c9ee0f8","Type":"ContainerDied","Data":"1d0c00ce85c604cc486b878054299263c31b2dff255dfe804e927e58b43e1d05"}
Sep 10 14:32:55.042717 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.042459    2579 scope.go:117] "RemoveContainer" containerID="617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958"
Sep 10 14:32:55.047116 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.047064    2579 generic.go:356] "Generic (PLEG): container finished" podID="81382093-9f75-46c8-8521-34400e6d7531" containerID="91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c" exitCode=0
Sep 10 14:32:55.047385 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.047360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd" event={"ID":"81382093-9f75-46c8-8521-34400e6d7531","Type":"ContainerDied","Data":"91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c"}
Sep 10 14:32:55.047646 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.047517    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"
Sep 10 14:32:55.047752 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.047629    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd" event={"ID":"81382093-9f75-46c8-8521-34400e6d7531","Type":"ContainerDied","Data":"02afb9217cb440a877909c67113a3cd2df9f65f1456aa2c7f32c750a47d1e845"}
Sep 10 14:32:55.056073 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.056018    2579 scope.go:117] "RemoveContainer" containerID="617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958"
Sep 10 14:32:55.056584 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:32:55.056554    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958\": container with ID starting with 617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958 not found: ID does not exist" containerID="617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958"
Sep 10 14:32:55.056713 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.056599    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958"} err="failed to get container status \"617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958\": rpc error: code = NotFound desc = could not find container \"617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958\": container with ID starting with 617a512822c91e9cce36e3f9cb941d4d587418d25d1b959e249b3df62f61a958 not found: ID does not exist"
Sep 10 14:32:55.056713 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.056625    2579 scope.go:117] "RemoveContainer" containerID="91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c"
Sep 10 14:32:55.066922 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.066901    2579 scope.go:117] "RemoveContainer" containerID="91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c"
Sep 10 14:32:55.067321 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:32:55.067299    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c\": container with ID starting with 91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c not found: ID does not exist" containerID="91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c"
Sep 10 14:32:55.067374 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.067330    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c"} err="failed to get container status \"91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c\": rpc error: code = NotFound desc = could not find container \"91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c\": container with ID starting with 91191a0544ec84f022f584bfe515e1f350713a84dca0ddd1570f75b0dbae940c not found: ID does not exist"
Sep 10 14:32:55.078438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.078406    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"]
Sep 10 14:32:55.081831 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.081802    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d320da1d-54c956c678-h7997"]
Sep 10 14:32:55.097927 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.097895    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"]
Sep 10 14:32:55.108537 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.108494    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-d320da1d-bc558d6-xmhxd"]
Sep 10 14:32:55.912040 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.912009    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34f4375e-a8d7-4f3b-9389-b4196c9ee0f8" path="/var/lib/kubelet/pods/34f4375e-a8d7-4f3b-9389-b4196c9ee0f8/volumes"
Sep 10 14:32:55.912382 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:55.912370    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81382093-9f75-46c8-8521-34400e6d7531" path="/var/lib/kubelet/pods/81382093-9f75-46c8-8521-34400e6d7531/volumes"
Sep 10 14:32:59.554872 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.554837    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"]
Sep 10 14:32:59.555311 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.555296    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81382093-9f75-46c8-8521-34400e6d7531" containerName="payload-pre-processing"
Sep 10 14:32:59.555355 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.555312    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="81382093-9f75-46c8-8521-34400e6d7531" containerName="payload-pre-processing"
Sep 10 14:32:59.555355 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.555334    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34f4375e-a8d7-4f3b-9389-b4196c9ee0f8" containerName="payload-processing"
Sep 10 14:32:59.555355 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.555341    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="34f4375e-a8d7-4f3b-9389-b4196c9ee0f8" containerName="payload-processing"
Sep 10 14:32:59.555451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.555411    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="34f4375e-a8d7-4f3b-9389-b4196c9ee0f8" containerName="payload-processing"
Sep 10 14:32:59.555451 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.555419    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="81382093-9f75-46c8-8521-34400e6d7531" containerName="payload-pre-processing"
Sep 10 14:32:59.557579 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.557563    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:32:59.560686 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.560667    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-49ac64b7\""
Sep 10 14:32:59.560686 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.560691    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-49ac64b7-dockercfg-7pkfc\""
Sep 10 14:32:59.574861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.574837    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"]
Sep 10 14:32:59.594396 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.594322    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"]
Sep 10 14:32:59.597562 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.597540    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:32:59.597881 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.597861    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:32:59.611462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.609637    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"]
Sep 10 14:32:59.619558 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.619528    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/773a0f24-e228-497a-828a-06d00244c7c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj\" (UID: \"773a0f24-e228-497a-828a-06d00244c7c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:32:59.619714 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.619585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v29zh\" (UniqueName: \"kubernetes.io/projected/773a0f24-e228-497a-828a-06d00244c7c2-kube-api-access-v29zh\") pod \"payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj\" (UID: \"773a0f24-e228-497a-828a-06d00244c7c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:32:59.720036 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720003    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff280111-4468-453e-8490-c8839d93c42a-istiod-ca-cert\") pod \"ff280111-4468-453e-8490-c8839d93c42a\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") "
Sep 10 14:32:59.720233 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720064    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-credential-socket\") pod \"ff280111-4468-453e-8490-c8839d93c42a\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") "
Sep 10 14:32:59.720233 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720105    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6kl4\" (UniqueName: \"kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-kube-api-access-t6kl4\") pod \"ff280111-4468-453e-8490-c8839d93c42a\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") "
Sep 10 14:32:59.720233 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720136    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff280111-4468-453e-8490-c8839d93c42a-istio-podinfo\") pod \"ff280111-4468-453e-8490-c8839d93c42a\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") "
Sep 10 14:32:59.720233 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720195    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-socket\") pod \"ff280111-4468-453e-8490-c8839d93c42a\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") "
Sep 10 14:32:59.720233 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720219    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-envoy\") pod \"ff280111-4468-453e-8490-c8839d93c42a\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") "
Sep 10 14:32:59.720561 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720274    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-istio-token\") pod \"ff280111-4468-453e-8490-c8839d93c42a\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") "
Sep 10 14:32:59.720561 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720336    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-data\") pod \"ff280111-4468-453e-8490-c8839d93c42a\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") "
Sep 10 14:32:59.720561 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720383    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-certs\") pod \"ff280111-4468-453e-8490-c8839d93c42a\" (UID: \"ff280111-4468-453e-8490-c8839d93c42a\") "
Sep 10 14:32:59.720561 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720380    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff280111-4468-453e-8490-c8839d93c42a" (UID: "ff280111-4468-453e-8490-c8839d93c42a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:32:59.720561 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720434    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff280111-4468-453e-8490-c8839d93c42a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff280111-4468-453e-8490-c8839d93c42a" (UID: "ff280111-4468-453e-8490-c8839d93c42a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:32:59.720561 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19792d79-f0e0-4ed8-9334-d44c25345c3b-plugins-config-volume\") pod \"payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp\" (UID: \"19792d79-f0e0-4ed8-9334-d44c25345c3b\") " pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:32:59.720908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/773a0f24-e228-497a-828a-06d00244c7c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj\" (UID: \"773a0f24-e228-497a-828a-06d00244c7c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:32:59.720908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v29zh\" (UniqueName: \"kubernetes.io/projected/773a0f24-e228-497a-828a-06d00244c7c2-kube-api-access-v29zh\") pod \"payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj\" (UID: \"773a0f24-e228-497a-828a-06d00244c7c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:32:59.720908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720722    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff280111-4468-453e-8490-c8839d93c42a" (UID: "ff280111-4468-453e-8490-c8839d93c42a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:32:59.720908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkwsh\" (UniqueName: \"kubernetes.io/projected/19792d79-f0e0-4ed8-9334-d44c25345c3b-kube-api-access-kkwsh\") pod \"payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp\" (UID: \"19792d79-f0e0-4ed8-9334-d44c25345c3b\") " pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:32:59.720908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720833    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff280111-4468-453e-8490-c8839d93c42a" (UID: "ff280111-4468-453e-8490-c8839d93c42a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:32:59.720908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720844    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff280111-4468-453e-8490-c8839d93c42a-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:59.720908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720846    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff280111-4468-453e-8490-c8839d93c42a" (UID: "ff280111-4468-453e-8490-c8839d93c42a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:32:59.720908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.720859    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:59.721213 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.721047    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:59.721889 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.721843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/773a0f24-e228-497a-828a-06d00244c7c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj\" (UID: \"773a0f24-e228-497a-828a-06d00244c7c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:32:59.722960 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.722928    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff280111-4468-453e-8490-c8839d93c42a" (UID: "ff280111-4468-453e-8490-c8839d93c42a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:32:59.723071 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.722964    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff280111-4468-453e-8490-c8839d93c42a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff280111-4468-453e-8490-c8839d93c42a" (UID: "ff280111-4468-453e-8490-c8839d93c42a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:32:59.723071 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.722970    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-kube-api-access-t6kl4" (OuterVolumeSpecName: "kube-api-access-t6kl4") pod "ff280111-4468-453e-8490-c8839d93c42a" (UID: "ff280111-4468-453e-8490-c8839d93c42a"). InnerVolumeSpecName "kube-api-access-t6kl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:32:59.723621 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.723599    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff280111-4468-453e-8490-c8839d93c42a" (UID: "ff280111-4468-453e-8490-c8839d93c42a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:32:59.728607 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.728585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v29zh\" (UniqueName: \"kubernetes.io/projected/773a0f24-e228-497a-828a-06d00244c7c2-kube-api-access-v29zh\") pod \"payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj\" (UID: \"773a0f24-e228-497a-828a-06d00244c7c2\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:32:59.822251 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.822213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19792d79-f0e0-4ed8-9334-d44c25345c3b-plugins-config-volume\") pod \"payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp\" (UID: \"19792d79-f0e0-4ed8-9334-d44c25345c3b\") " pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:32:59.822438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.822310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkwsh\" (UniqueName: \"kubernetes.io/projected/19792d79-f0e0-4ed8-9334-d44c25345c3b-kube-api-access-kkwsh\") pod \"payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp\" (UID: \"19792d79-f0e0-4ed8-9334-d44c25345c3b\") " pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:32:59.822438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.822361    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:59.822438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.822376    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:59.822438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.822391    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6kl4\" (UniqueName: \"kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-kube-api-access-t6kl4\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:59.822438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.822404    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff280111-4468-453e-8490-c8839d93c42a-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:59.822438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.822416    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff280111-4468-453e-8490-c8839d93c42a-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:59.822438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.822429    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff280111-4468-453e-8490-c8839d93c42a-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:32:59.823026 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.823004    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19792d79-f0e0-4ed8-9334-d44c25345c3b-plugins-config-volume\") pod \"payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp\" (UID: \"19792d79-f0e0-4ed8-9334-d44c25345c3b\") " pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:32:59.832352 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.832330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkwsh\" (UniqueName: \"kubernetes.io/projected/19792d79-f0e0-4ed8-9334-d44c25345c3b-kube-api-access-kkwsh\") pod \"payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp\" (UID: \"19792d79-f0e0-4ed8-9334-d44c25345c3b\") " pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:32:59.869318 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.869224    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:32:59.917708 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:32:59.917671    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:33:00.078986 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.078954    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff280111-4468-453e-8490-c8839d93c42a" containerID="c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd" exitCode=0
Sep 10 14:33:00.079163 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.079006    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" event={"ID":"ff280111-4468-453e-8490-c8839d93c42a","Type":"ContainerDied","Data":"c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd"}
Sep 10 14:33:00.079163 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.079028    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"
Sep 10 14:33:00.079163 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.079049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh" event={"ID":"ff280111-4468-453e-8490-c8839d93c42a","Type":"ContainerDied","Data":"9d67a97bb05509828880bc74438c9db9c37a938d1a6711f165e4b812ed1cfbd2"}
Sep 10 14:33:00.079163 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.079072    2579 scope.go:117] "RemoveContainer" containerID="c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd"
Sep 10 14:33:00.088704 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.088683    2579 scope.go:117] "RemoveContainer" containerID="ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573"
Sep 10 14:33:00.099398 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.099376    2579 scope.go:117] "RemoveContainer" containerID="c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd"
Sep 10 14:33:00.099727 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:33:00.099704    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd\": container with ID starting with c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd not found: ID does not exist" containerID="c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd"
Sep 10 14:33:00.099842 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.099739    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd"} err="failed to get container status \"c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd\": rpc error: code = NotFound desc = could not find container \"c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd\": container with ID starting with c053cfb10e8f204a1bf834b4cc8e654ca95c1241c83569f0f2eb6a1bf69929bd not found: ID does not exist"
Sep 10 14:33:00.099842 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.099754    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"]
Sep 10 14:33:00.099842 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.099766    2579 scope.go:117] "RemoveContainer" containerID="ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573"
Sep 10 14:33:00.100142 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:33:00.100125    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573\": container with ID starting with ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573 not found: ID does not exist" containerID="ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573"
Sep 10 14:33:00.100179 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.100150    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573"} err="failed to get container status \"ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573\": rpc error: code = NotFound desc = could not find container \"ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573\": container with ID starting with ff3628fe972c64d1e77f391ae92743fca4384f28f78d42d3c9f48eed3be6b573 not found: ID does not exist"
Sep 10 14:33:00.101952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.101930    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d320da1d-gw-openshift-default-5c46bfb85b-cbnnh"]
Sep 10 14:33:00.145646 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.145600    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"]
Sep 10 14:33:00.147767 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:33:00.147741    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod773a0f24_e228_497a_828a_06d00244c7c2.slice/crio-9aff12770d6932076fcc7ff99478f5fa231f359cc3867dedf3bbd2e729f364ab WatchSource:0}: Error finding container 9aff12770d6932076fcc7ff99478f5fa231f359cc3867dedf3bbd2e729f364ab: Status 404 returned error can't find the container with id 9aff12770d6932076fcc7ff99478f5fa231f359cc3867dedf3bbd2e729f364ab
Sep 10 14:33:00.199749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:00.199716    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"]
Sep 10 14:33:00.203919 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:33:00.203896    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19792d79_f0e0_4ed8_9334_d44c25345c3b.slice/crio-154a01421e08604e807e524c6cc8049eaaae98ee1a90bc1a1c00dce35c54f85f WatchSource:0}: Error finding container 154a01421e08604e807e524c6cc8049eaaae98ee1a90bc1a1c00dce35c54f85f: Status 404 returned error can't find the container with id 154a01421e08604e807e524c6cc8049eaaae98ee1a90bc1a1c00dce35c54f85f
Sep 10 14:33:01.088774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:01.088736    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj" event={"ID":"773a0f24-e228-497a-828a-06d00244c7c2","Type":"ContainerStarted","Data":"2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46"}
Sep 10 14:33:01.089262 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:01.088936    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:33:01.089262 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:01.088983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj" event={"ID":"773a0f24-e228-497a-828a-06d00244c7c2","Type":"ContainerStarted","Data":"9aff12770d6932076fcc7ff99478f5fa231f359cc3867dedf3bbd2e729f364ab"}
Sep 10 14:33:01.090453 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:01.090427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp" event={"ID":"19792d79-f0e0-4ed8-9334-d44c25345c3b","Type":"ContainerStarted","Data":"28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab"}
Sep 10 14:33:01.090547 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:01.090473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp" event={"ID":"19792d79-f0e0-4ed8-9334-d44c25345c3b","Type":"ContainerStarted","Data":"154a01421e08604e807e524c6cc8049eaaae98ee1a90bc1a1c00dce35c54f85f"}
Sep 10 14:33:01.090547 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:01.090523    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:33:01.106106 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:01.106049    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj" podStartSLOduration=2.106032522 podStartE2EDuration="2.106032522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:33:01.104943666 +0000 UTC m=+827.697148437" watchObservedRunningTime="2026-09-10 14:33:01.106032522 +0000 UTC m=+827.698237291"
Sep 10 14:33:01.123276 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:01.123219    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp" podStartSLOduration=2.123200799 podStartE2EDuration="2.123200799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:33:01.12051842 +0000 UTC m=+827.712723189" watchObservedRunningTime="2026-09-10 14:33:01.123200799 +0000 UTC m=+827.715405570"
Sep 10 14:33:01.912277 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:01.912242    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff280111-4468-453e-8490-c8839d93c42a" path="/var/lib/kubelet/pods/ff280111-4468-453e-8490-c8839d93c42a/volumes"
Sep 10 14:33:12.099755 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:12.099723    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:33:12.100373 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:12.099926    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:33:29.483199 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.483163    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"]
Sep 10 14:33:29.483687 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.483392    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp" podUID="19792d79-f0e0-4ed8-9334-d44c25345c3b" containerName="payload-processing" containerID="cri-o://28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab" gracePeriod=30
Sep 10 14:33:29.489599 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.489543    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"]
Sep 10 14:33:29.490147 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.489979    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj" podUID="773a0f24-e228-497a-828a-06d00244c7c2" containerName="payload-pre-processing" containerID="cri-o://2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46" gracePeriod=30
Sep 10 14:33:29.789214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.789186    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:33:29.803309 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.803285    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:33:29.812371 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.811937    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkwsh\" (UniqueName: \"kubernetes.io/projected/19792d79-f0e0-4ed8-9334-d44c25345c3b-kube-api-access-kkwsh\") pod \"19792d79-f0e0-4ed8-9334-d44c25345c3b\" (UID: \"19792d79-f0e0-4ed8-9334-d44c25345c3b\") "
Sep 10 14:33:29.812371 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.812055    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19792d79-f0e0-4ed8-9334-d44c25345c3b-plugins-config-volume\") pod \"19792d79-f0e0-4ed8-9334-d44c25345c3b\" (UID: \"19792d79-f0e0-4ed8-9334-d44c25345c3b\") "
Sep 10 14:33:29.812371 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.812471    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19792d79-f0e0-4ed8-9334-d44c25345c3b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "19792d79-f0e0-4ed8-9334-d44c25345c3b" (UID: "19792d79-f0e0-4ed8-9334-d44c25345c3b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:33:29.815962 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.815934    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19792d79-f0e0-4ed8-9334-d44c25345c3b-kube-api-access-kkwsh" (OuterVolumeSpecName: "kube-api-access-kkwsh") pod "19792d79-f0e0-4ed8-9334-d44c25345c3b" (UID: "19792d79-f0e0-4ed8-9334-d44c25345c3b"). InnerVolumeSpecName "kube-api-access-kkwsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:33:29.913109 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.913077    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v29zh\" (UniqueName: \"kubernetes.io/projected/773a0f24-e228-497a-828a-06d00244c7c2-kube-api-access-v29zh\") pod \"773a0f24-e228-497a-828a-06d00244c7c2\" (UID: \"773a0f24-e228-497a-828a-06d00244c7c2\") "
Sep 10 14:33:29.913328 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.913186    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/773a0f24-e228-497a-828a-06d00244c7c2-plugins-config-volume\") pod \"773a0f24-e228-497a-828a-06d00244c7c2\" (UID: \"773a0f24-e228-497a-828a-06d00244c7c2\") "
Sep 10 14:33:29.913413 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.913396    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkwsh\" (UniqueName: \"kubernetes.io/projected/19792d79-f0e0-4ed8-9334-d44c25345c3b-kube-api-access-kkwsh\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:33:29.913413 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.913408    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19792d79-f0e0-4ed8-9334-d44c25345c3b-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:33:29.913575 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.913549    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/773a0f24-e228-497a-828a-06d00244c7c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "773a0f24-e228-497a-828a-06d00244c7c2" (UID: "773a0f24-e228-497a-828a-06d00244c7c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:33:29.915592 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:29.915553    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773a0f24-e228-497a-828a-06d00244c7c2-kube-api-access-v29zh" (OuterVolumeSpecName: "kube-api-access-v29zh") pod "773a0f24-e228-497a-828a-06d00244c7c2" (UID: "773a0f24-e228-497a-828a-06d00244c7c2"). InnerVolumeSpecName "kube-api-access-v29zh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:33:30.014395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.014355    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v29zh\" (UniqueName: \"kubernetes.io/projected/773a0f24-e228-497a-828a-06d00244c7c2-kube-api-access-v29zh\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:33:30.014395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.014390    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/773a0f24-e228-497a-828a-06d00244c7c2-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:33:30.259369 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.259332    2579 generic.go:356] "Generic (PLEG): container finished" podID="19792d79-f0e0-4ed8-9334-d44c25345c3b" containerID="28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab" exitCode=0
Sep 10 14:33:30.259585 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.259382    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"
Sep 10 14:33:30.259585 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.259427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp" event={"ID":"19792d79-f0e0-4ed8-9334-d44c25345c3b","Type":"ContainerDied","Data":"28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab"}
Sep 10 14:33:30.259585 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.259494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp" event={"ID":"19792d79-f0e0-4ed8-9334-d44c25345c3b","Type":"ContainerDied","Data":"154a01421e08604e807e524c6cc8049eaaae98ee1a90bc1a1c00dce35c54f85f"}
Sep 10 14:33:30.259585 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.259526    2579 scope.go:117] "RemoveContainer" containerID="28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab"
Sep 10 14:33:30.261853 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.261827    2579 generic.go:356] "Generic (PLEG): container finished" podID="773a0f24-e228-497a-828a-06d00244c7c2" containerID="2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46" exitCode=0
Sep 10 14:33:30.261853 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.261876    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj" event={"ID":"773a0f24-e228-497a-828a-06d00244c7c2","Type":"ContainerDied","Data":"2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46"}
Sep 10 14:33:30.261853 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.261932    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"
Sep 10 14:33:30.261853 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.261937    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj" event={"ID":"773a0f24-e228-497a-828a-06d00244c7c2","Type":"ContainerDied","Data":"9aff12770d6932076fcc7ff99478f5fa231f359cc3867dedf3bbd2e729f364ab"}
Sep 10 14:33:30.272474 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.272446    2579 scope.go:117] "RemoveContainer" containerID="28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab"
Sep 10 14:33:30.272889 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:33:30.272860    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab\": container with ID starting with 28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab not found: ID does not exist" containerID="28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab"
Sep 10 14:33:30.273013 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.272903    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab"} err="failed to get container status \"28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab\": rpc error: code = NotFound desc = could not find container \"28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab\": container with ID starting with 28cc3cb891b163dc60af48c2a1c7e37d998d3e584ad617010cec024110ee57ab not found: ID does not exist"
Sep 10 14:33:30.273013 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.272930    2579 scope.go:117] "RemoveContainer" containerID="2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46"
Sep 10 14:33:30.284277 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.284249    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"]
Sep 10 14:33:30.285826 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.285687    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-49ac64b7-669c84c4f9-pt5kp"]
Sep 10 14:33:30.286081 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.286062    2579 scope.go:117] "RemoveContainer" containerID="2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46"
Sep 10 14:33:30.289532 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:33:30.289502    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46\": container with ID starting with 2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46 not found: ID does not exist" containerID="2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46"
Sep 10 14:33:30.289661 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.289540    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46"} err="failed to get container status \"2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46\": rpc error: code = NotFound desc = could not find container \"2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46\": container with ID starting with 2df7a20b88ebfa5dcfde45dc1b3eeefe553b9381fb35b2314870e91be8db2e46 not found: ID does not exist"
Sep 10 14:33:30.294841 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.294755    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"]
Sep 10 14:33:30.299155 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:30.299127    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-49ac64b7-7f946fdb8b-dnzmj"]
Sep 10 14:33:31.514578 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.514535    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"]
Sep 10 14:33:31.515280 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.515255    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773a0f24-e228-497a-828a-06d00244c7c2" containerName="payload-pre-processing"
Sep 10 14:33:31.515462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.515283    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="773a0f24-e228-497a-828a-06d00244c7c2" containerName="payload-pre-processing"
Sep 10 14:33:31.515462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.515304    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy"
Sep 10 14:33:31.515462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.515313    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy"
Sep 10 14:33:31.515462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.515333    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy"
Sep 10 14:33:31.515462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.515342    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy"
Sep 10 14:33:31.515462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.515359    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19792d79-f0e0-4ed8-9334-d44c25345c3b" containerName="payload-processing"
Sep 10 14:33:31.515462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.515368    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="19792d79-f0e0-4ed8-9334-d44c25345c3b" containerName="payload-processing"
Sep 10 14:33:31.516066 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.515480    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy"
Sep 10 14:33:31.516066 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.515499    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="773a0f24-e228-497a-828a-06d00244c7c2" containerName="payload-pre-processing"
Sep 10 14:33:31.516066 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.515507    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="19792d79-f0e0-4ed8-9334-d44c25345c3b" containerName="payload-processing"
Sep 10 14:33:31.520579 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.520557    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.524814 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.524773    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0245a1e4-openshift-default-dockercfg-qjd6j\""
Sep 10 14:33:31.531705 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.531677    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"]
Sep 10 14:33:31.627937 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.627894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-socket\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.628122 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.627956    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istiod-ca-cert\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.628122 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.628019    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-certs\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.628220 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.628129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-token\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.628283 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.628221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbp69\" (UniqueName: \"kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-kube-api-access-gbp69\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.628340 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.628298    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-envoy\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.628388 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.628360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-data\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.628442 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.628422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-podinfo\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.628504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.628475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-credential-socket\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.729714 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.729679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istiod-ca-cert\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.729714 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.729725    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-certs\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730017 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.729812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-token\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730017 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.729849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbp69\" (UniqueName: \"kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-kube-api-access-gbp69\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730017 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.729873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-envoy\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730017 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.729911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-data\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730017 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.729938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-podinfo\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730017 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.729966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-credential-socket\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730270 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.730034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-socket\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730369 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.730343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-certs\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730483 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.730434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-data\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730527 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.730476    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-credential-socket\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730527 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.730490    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istiod-ca-cert\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.730527 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.730507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-socket\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.732484 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.732462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-envoy\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.732588 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.732564    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-podinfo\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.738561 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.738537    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-token\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.738935 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.738913    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbp69\" (UniqueName: \"kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-kube-api-access-gbp69\") pod \"e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") " pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.832176 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.832082    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:31.914246 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.914211    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19792d79-f0e0-4ed8-9334-d44c25345c3b" path="/var/lib/kubelet/pods/19792d79-f0e0-4ed8-9334-d44c25345c3b/volumes"
Sep 10 14:33:31.914575 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:31.914561    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773a0f24-e228-497a-828a-06d00244c7c2" path="/var/lib/kubelet/pods/773a0f24-e228-497a-828a-06d00244c7c2/volumes"
Sep 10 14:33:32.123910 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:32.123885    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"]
Sep 10 14:33:32.126458 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:33:32.126434    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e3d06f8_04c0_4f4a_a34c_5729fe6b4cb8.slice/crio-7a93d0699b3d31a095ffd1aec5f91a9f13770ca3d36fd359b2f5ca85fa9baa00 WatchSource:0}: Error finding container 7a93d0699b3d31a095ffd1aec5f91a9f13770ca3d36fd359b2f5ca85fa9baa00: Status 404 returned error can't find the container with id 7a93d0699b3d31a095ffd1aec5f91a9f13770ca3d36fd359b2f5ca85fa9baa00
Sep 10 14:33:32.128601 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:32.128571    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:33:32.128661 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:32.128639    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:33:32.128699 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:32.128667    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:33:32.277728 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:32.277681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" event={"ID":"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8","Type":"ContainerStarted","Data":"051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42"}
Sep 10 14:33:32.277948 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:32.277756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" event={"ID":"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8","Type":"ContainerStarted","Data":"7a93d0699b3d31a095ffd1aec5f91a9f13770ca3d36fd359b2f5ca85fa9baa00"}
Sep 10 14:33:32.297555 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:32.297439    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" podStartSLOduration=1.297417252 podStartE2EDuration="1.297417252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:33:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:33:32.296335646 +0000 UTC m=+858.888540435" watchObservedRunningTime="2026-09-10 14:33:32.297417252 +0000 UTC m=+858.889622019"
Sep 10 14:33:32.833048 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:32.833009    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:33.837879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:33.837851    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:34.290860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:34.290824    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:34.291987 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:34.291967    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:35.509125 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.509086    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"]
Sep 10 14:33:35.509678 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.509662    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff280111-4468-453e-8490-c8839d93c42a" containerName="istio-proxy"
Sep 10 14:33:35.512959 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.512943    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:33:35.515469 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.515450    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0245a1e4\""
Sep 10 14:33:35.524411 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.524386    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"]
Sep 10 14:33:35.557644 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.557599    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"]
Sep 10 14:33:35.561307 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.561285    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:33:35.563995 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.563971    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0245a1e4-dockercfg-b69sw\""
Sep 10 14:33:35.568148 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.568124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c216ec76-73f5-45fc-a1e5-6839b775ed82-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7\" (UID: \"c216ec76-73f5-45fc-a1e5-6839b775ed82\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:33:35.568246 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.568203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c25zd\" (UniqueName: \"kubernetes.io/projected/c216ec76-73f5-45fc-a1e5-6839b775ed82-kube-api-access-c25zd\") pod \"payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7\" (UID: \"c216ec76-73f5-45fc-a1e5-6839b775ed82\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:33:35.576925 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.576890    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"]
Sep 10 14:33:35.669372 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.669338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-plugins-config-volume\") pod \"payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z\" (UID: \"6c95c42a-f337-4fe5-9b35-b6e69c8288c6\") " pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:33:35.669551 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.669387    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c216ec76-73f5-45fc-a1e5-6839b775ed82-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7\" (UID: \"c216ec76-73f5-45fc-a1e5-6839b775ed82\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:33:35.669551 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.669480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c25zd\" (UniqueName: \"kubernetes.io/projected/c216ec76-73f5-45fc-a1e5-6839b775ed82-kube-api-access-c25zd\") pod \"payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7\" (UID: \"c216ec76-73f5-45fc-a1e5-6839b775ed82\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:33:35.669551 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.669542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj94f\" (UniqueName: \"kubernetes.io/projected/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-kube-api-access-sj94f\") pod \"payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z\" (UID: \"6c95c42a-f337-4fe5-9b35-b6e69c8288c6\") " pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:33:35.670161 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.670143    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c216ec76-73f5-45fc-a1e5-6839b775ed82-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7\" (UID: \"c216ec76-73f5-45fc-a1e5-6839b775ed82\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:33:35.677685 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.677655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c25zd\" (UniqueName: \"kubernetes.io/projected/c216ec76-73f5-45fc-a1e5-6839b775ed82-kube-api-access-c25zd\") pod \"payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7\" (UID: \"c216ec76-73f5-45fc-a1e5-6839b775ed82\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:33:35.771209 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.771117    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj94f\" (UniqueName: \"kubernetes.io/projected/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-kube-api-access-sj94f\") pod \"payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z\" (UID: \"6c95c42a-f337-4fe5-9b35-b6e69c8288c6\") " pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:33:35.771209 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.771203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-plugins-config-volume\") pod \"payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z\" (UID: \"6c95c42a-f337-4fe5-9b35-b6e69c8288c6\") " pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:33:35.772005 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.771934    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-plugins-config-volume\") pod \"payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z\" (UID: \"6c95c42a-f337-4fe5-9b35-b6e69c8288c6\") " pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:33:35.780130 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.780098    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj94f\" (UniqueName: \"kubernetes.io/projected/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-kube-api-access-sj94f\") pod \"payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z\" (UID: \"6c95c42a-f337-4fe5-9b35-b6e69c8288c6\") " pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:33:35.826976 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.826937    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:33:35.871848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:35.871815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:33:36.100623 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:36.100595    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"]
Sep 10 14:33:36.103241 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:33:36.103214    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc216ec76_73f5_45fc_a1e5_6839b775ed82.slice/crio-18e8be2f8b0630c77423b6cbb50742468299a477b430613140e2793f7dfac989 WatchSource:0}: Error finding container 18e8be2f8b0630c77423b6cbb50742468299a477b430613140e2793f7dfac989: Status 404 returned error can't find the container with id 18e8be2f8b0630c77423b6cbb50742468299a477b430613140e2793f7dfac989
Sep 10 14:33:36.163007 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:36.162983    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"]
Sep 10 14:33:36.168849 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:33:36.168825    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c95c42a_f337_4fe5_9b35_b6e69c8288c6.slice/crio-e4f7aa2027e66ddaf402654a0191a6b23c97dc0fb1e3482e9ccdcb613ca23034 WatchSource:0}: Error finding container e4f7aa2027e66ddaf402654a0191a6b23c97dc0fb1e3482e9ccdcb613ca23034: Status 404 returned error can't find the container with id e4f7aa2027e66ddaf402654a0191a6b23c97dc0fb1e3482e9ccdcb613ca23034
Sep 10 14:33:36.304859 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:36.304820    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z" event={"ID":"6c95c42a-f337-4fe5-9b35-b6e69c8288c6","Type":"ContainerStarted","Data":"e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb"}
Sep 10 14:33:36.305056 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:36.304890    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:33:36.305056 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:36.304916    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z" event={"ID":"6c95c42a-f337-4fe5-9b35-b6e69c8288c6","Type":"ContainerStarted","Data":"e4f7aa2027e66ddaf402654a0191a6b23c97dc0fb1e3482e9ccdcb613ca23034"}
Sep 10 14:33:36.306658 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:36.306633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7" event={"ID":"c216ec76-73f5-45fc-a1e5-6839b775ed82","Type":"ContainerStarted","Data":"69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565"}
Sep 10 14:33:36.306819 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:36.306673    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7" event={"ID":"c216ec76-73f5-45fc-a1e5-6839b775ed82","Type":"ContainerStarted","Data":"18e8be2f8b0630c77423b6cbb50742468299a477b430613140e2793f7dfac989"}
Sep 10 14:33:36.306819 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:36.306801    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:33:36.345374 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:36.345321    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z" podStartSLOduration=1.345304536 podStartE2EDuration="1.345304536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:33:36.323030879 +0000 UTC m=+862.915235650" watchObservedRunningTime="2026-09-10 14:33:36.345304536 +0000 UTC m=+862.937509305"
Sep 10 14:33:36.345562 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:36.345525    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7" podStartSLOduration=1.345519479 podStartE2EDuration="1.345519479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:33:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:33:36.343852264 +0000 UTC m=+862.936057035" watchObservedRunningTime="2026-09-10 14:33:36.345519479 +0000 UTC m=+862.937724294"
Sep 10 14:33:47.315452 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:47.315418    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:33:47.315952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:47.315486    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:33:56.431836 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:56.431686    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerID="051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42" exitCode=0
Sep 10 14:33:56.431836 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:56.431800    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" event={"ID":"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8","Type":"ContainerDied","Data":"051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42"}
Sep 10 14:33:56.433091 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:56.433067    2579 scope.go:117] "RemoveContainer" containerID="051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42"
Sep 10 14:33:56.434418 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:56.434387    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:33:56.434528 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:56.434476    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:33:56.434592 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:56.434527    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:33:57.439700 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:57.439667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" event={"ID":"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8","Type":"ContainerStarted","Data":"ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18"}
Sep 10 14:33:57.832459 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:57.832414    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:33:57.832715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:57.832695    2579 patch_prober.go:28] interesting pod/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:33:57.832764 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:57.832742    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 10 14:33:58.542773 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:58.542731    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"]
Sep 10 14:33:58.545487 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:58.545468    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"
Sep 10 14:33:58.548317 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:58.548288    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwr7b\""
Sep 10 14:33:58.561874 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:58.561838    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"]
Sep 10 14:33:58.706017 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:58.705979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/440138ea-c717-41c1-ae53-b8ad2c8fd886-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2\" (UID: \"440138ea-c717-41c1-ae53-b8ad2c8fd886\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"
Sep 10 14:33:58.807668 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:58.807582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/440138ea-c717-41c1-ae53-b8ad2c8fd886-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2\" (UID: \"440138ea-c717-41c1-ae53-b8ad2c8fd886\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"
Sep 10 14:33:58.808219 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:58.808198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/440138ea-c717-41c1-ae53-b8ad2c8fd886-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2\" (UID: \"440138ea-c717-41c1-ae53-b8ad2c8fd886\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"
Sep 10 14:33:58.833130 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:58.833092    2579 patch_prober.go:28] interesting pod/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:33:58.833299 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:58.833154    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 10 14:33:58.895635 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:58.895593    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"
Sep 10 14:33:59.201208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:59.201116    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"]
Sep 10 14:33:59.212342 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:33:59.212310    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod440138ea_c717_41c1_ae53_b8ad2c8fd886.slice/crio-25d149fbc3346a9ba5a8a1b62c2fcb6125d887904f3e1dd5dbeb6b75f5b19d2e WatchSource:0}: Error finding container 25d149fbc3346a9ba5a8a1b62c2fcb6125d887904f3e1dd5dbeb6b75f5b19d2e: Status 404 returned error can't find the container with id 25d149fbc3346a9ba5a8a1b62c2fcb6125d887904f3e1dd5dbeb6b75f5b19d2e
Sep 10 14:33:59.451900 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:59.451807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2" event={"ID":"440138ea-c717-41c1-ae53-b8ad2c8fd886","Type":"ContainerStarted","Data":"25d149fbc3346a9ba5a8a1b62c2fcb6125d887904f3e1dd5dbeb6b75f5b19d2e"}
Sep 10 14:33:59.832589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:59.832557    2579 patch_prober.go:28] interesting pod/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:33:59.832982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:33:59.832610    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 10 14:34:00.463601 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:00.463497    2579 generic.go:356] "Generic (PLEG): container finished" podID="440138ea-c717-41c1-ae53-b8ad2c8fd886" containerID="ab0233a4f4ec198aedf8e5704d2b325b25026964b4ef9e87b99ebf339bf2a1d4" exitCode=0
Sep 10 14:34:00.463809 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:00.463605    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2" event={"ID":"440138ea-c717-41c1-ae53-b8ad2c8fd886","Type":"ContainerDied","Data":"ab0233a4f4ec198aedf8e5704d2b325b25026964b4ef9e87b99ebf339bf2a1d4"}
Sep 10 14:34:00.833526 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:00.833488    2579 patch_prober.go:28] interesting pod/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:34:00.833948 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:00.833549    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 10 14:34:01.641727 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:01.641701    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"
Sep 10 14:34:01.740449 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:01.740361    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/440138ea-c717-41c1-ae53-b8ad2c8fd886-maas-api-service-ca\") pod \"440138ea-c717-41c1-ae53-b8ad2c8fd886\" (UID: \"440138ea-c717-41c1-ae53-b8ad2c8fd886\") "
Sep 10 14:34:01.740644 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:01.740622    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/440138ea-c717-41c1-ae53-b8ad2c8fd886-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "440138ea-c717-41c1-ae53-b8ad2c8fd886" (UID: "440138ea-c717-41c1-ae53-b8ad2c8fd886"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:34:01.740745 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:01.740732    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/440138ea-c717-41c1-ae53-b8ad2c8fd886-maas-api-service-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:01.833394 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:01.833354    2579 patch_prober.go:28] interesting pod/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 10 14:34:01.833576 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:01.833409    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 10 14:34:02.482558 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:02.482529    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"
Sep 10 14:34:02.482793 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:02.482517    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2" event={"ID":"440138ea-c717-41c1-ae53-b8ad2c8fd886","Type":"ContainerDied","Data":"25d149fbc3346a9ba5a8a1b62c2fcb6125d887904f3e1dd5dbeb6b75f5b19d2e"}
Sep 10 14:34:02.482793 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:02.482693    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25d149fbc3346a9ba5a8a1b62c2fcb6125d887904f3e1dd5dbeb6b75f5b19d2e"
Sep 10 14:34:02.892120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:02.892069    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:34:02.892658 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:02.892633    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:34:02.895115 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:02.895083    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:34:05.706448 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:05.706093    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"]
Sep 10 14:34:05.707189 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:05.707153    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7" podUID="c216ec76-73f5-45fc-a1e5-6839b775ed82" containerName="payload-pre-processing" containerID="cri-o://69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565" gracePeriod=30
Sep 10 14:34:05.710021 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:05.709996    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"]
Sep 10 14:34:05.710264 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:05.710220    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z" podUID="6c95c42a-f337-4fe5-9b35-b6e69c8288c6" containerName="payload-processing" containerID="cri-o://e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb" gracePeriod=30
Sep 10 14:34:05.886367 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:05.885888    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"]
Sep 10 14:34:05.889772 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:05.889742    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0245a1e4-fchw2"]
Sep 10 14:34:05.912999 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:05.912970    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="440138ea-c717-41c1-ae53-b8ad2c8fd886" path="/var/lib/kubelet/pods/440138ea-c717-41c1-ae53-b8ad2c8fd886/volumes"
Sep 10 14:34:06.021006 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.020976    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"]
Sep 10 14:34:06.021269 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.021207    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy" containerID="cri-o://ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18" gracePeriod=30
Sep 10 14:34:06.029076 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.029047    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:34:06.032430 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.032408    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:34:06.081498 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.081466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj94f\" (UniqueName: \"kubernetes.io/projected/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-kube-api-access-sj94f\") pod \"6c95c42a-f337-4fe5-9b35-b6e69c8288c6\" (UID: \"6c95c42a-f337-4fe5-9b35-b6e69c8288c6\") "
Sep 10 14:34:06.081655 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.081598    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c25zd\" (UniqueName: \"kubernetes.io/projected/c216ec76-73f5-45fc-a1e5-6839b775ed82-kube-api-access-c25zd\") pod \"c216ec76-73f5-45fc-a1e5-6839b775ed82\" (UID: \"c216ec76-73f5-45fc-a1e5-6839b775ed82\") "
Sep 10 14:34:06.081655 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.081634    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c216ec76-73f5-45fc-a1e5-6839b775ed82-plugins-config-volume\") pod \"c216ec76-73f5-45fc-a1e5-6839b775ed82\" (UID: \"c216ec76-73f5-45fc-a1e5-6839b775ed82\") "
Sep 10 14:34:06.081739 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.081721    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-plugins-config-volume\") pod \"6c95c42a-f337-4fe5-9b35-b6e69c8288c6\" (UID: \"6c95c42a-f337-4fe5-9b35-b6e69c8288c6\") "
Sep 10 14:34:06.082073 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.082038    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c216ec76-73f5-45fc-a1e5-6839b775ed82-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c216ec76-73f5-45fc-a1e5-6839b775ed82" (UID: "c216ec76-73f5-45fc-a1e5-6839b775ed82"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:34:06.082353 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.082141    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6c95c42a-f337-4fe5-9b35-b6e69c8288c6" (UID: "6c95c42a-f337-4fe5-9b35-b6e69c8288c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:34:06.083693 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.083671    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-kube-api-access-sj94f" (OuterVolumeSpecName: "kube-api-access-sj94f") pod "6c95c42a-f337-4fe5-9b35-b6e69c8288c6" (UID: "6c95c42a-f337-4fe5-9b35-b6e69c8288c6"). InnerVolumeSpecName "kube-api-access-sj94f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:34:06.083813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.083761    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c216ec76-73f5-45fc-a1e5-6839b775ed82-kube-api-access-c25zd" (OuterVolumeSpecName: "kube-api-access-c25zd") pod "c216ec76-73f5-45fc-a1e5-6839b775ed82" (UID: "c216ec76-73f5-45fc-a1e5-6839b775ed82"). InnerVolumeSpecName "kube-api-access-c25zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:34:06.183004 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.182957    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:06.183004 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.182998    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj94f\" (UniqueName: \"kubernetes.io/projected/6c95c42a-f337-4fe5-9b35-b6e69c8288c6-kube-api-access-sj94f\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:06.183004 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.183008    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c25zd\" (UniqueName: \"kubernetes.io/projected/c216ec76-73f5-45fc-a1e5-6839b775ed82-kube-api-access-c25zd\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:06.183004 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.183017    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c216ec76-73f5-45fc-a1e5-6839b775ed82-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:06.507468 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.507432    2579 generic.go:356] "Generic (PLEG): container finished" podID="6c95c42a-f337-4fe5-9b35-b6e69c8288c6" containerID="e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb" exitCode=0
Sep 10 14:34:06.507650 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.507478    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"
Sep 10 14:34:06.507650 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.507523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z" event={"ID":"6c95c42a-f337-4fe5-9b35-b6e69c8288c6","Type":"ContainerDied","Data":"e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb"}
Sep 10 14:34:06.507650 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.507576    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z" event={"ID":"6c95c42a-f337-4fe5-9b35-b6e69c8288c6","Type":"ContainerDied","Data":"e4f7aa2027e66ddaf402654a0191a6b23c97dc0fb1e3482e9ccdcb613ca23034"}
Sep 10 14:34:06.507650 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.507598    2579 scope.go:117] "RemoveContainer" containerID="e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb"
Sep 10 14:34:06.508840 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.508817    2579 generic.go:356] "Generic (PLEG): container finished" podID="c216ec76-73f5-45fc-a1e5-6839b775ed82" containerID="69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565" exitCode=0
Sep 10 14:34:06.508956 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.508852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7" event={"ID":"c216ec76-73f5-45fc-a1e5-6839b775ed82","Type":"ContainerDied","Data":"69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565"}
Sep 10 14:34:06.508956 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.508876    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"
Sep 10 14:34:06.508956 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.508906    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7" event={"ID":"c216ec76-73f5-45fc-a1e5-6839b775ed82","Type":"ContainerDied","Data":"18e8be2f8b0630c77423b6cbb50742468299a477b430613140e2793f7dfac989"}
Sep 10 14:34:06.516616 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.516596    2579 scope.go:117] "RemoveContainer" containerID="e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb"
Sep 10 14:34:06.516958 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:34:06.516939    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb\": container with ID starting with e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb not found: ID does not exist" containerID="e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb"
Sep 10 14:34:06.517029 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.516968    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb"} err="failed to get container status \"e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb\": rpc error: code = NotFound desc = could not find container \"e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb\": container with ID starting with e547df2c2cc1f890fd12f37c228772edd9c93bb607e3e287a763656f1e11e2cb not found: ID does not exist"
Sep 10 14:34:06.517029 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.516985    2579 scope.go:117] "RemoveContainer" containerID="69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565"
Sep 10 14:34:06.525942 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.525924    2579 scope.go:117] "RemoveContainer" containerID="69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565"
Sep 10 14:34:06.526250 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:34:06.526231    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565\": container with ID starting with 69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565 not found: ID does not exist" containerID="69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565"
Sep 10 14:34:06.526317 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.526259    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565"} err="failed to get container status \"69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565\": rpc error: code = NotFound desc = could not find container \"69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565\": container with ID starting with 69b0f91190bb63e4dc28d7dbcf24fb2ee2638db89a9be9a0094be6f407a44565 not found: ID does not exist"
Sep 10 14:34:06.534081 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.534055    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"]
Sep 10 14:34:06.541803 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.541092    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0245a1e4-77fd4944f-vgz8z"]
Sep 10 14:34:06.553470 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.553437    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"]
Sep 10 14:34:06.557123 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:06.557097    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0245a1e4-d777f6486-822l7"]
Sep 10 14:34:07.912415 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:07.912379    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c95c42a-f337-4fe5-9b35-b6e69c8288c6" path="/var/lib/kubelet/pods/6c95c42a-f337-4fe5-9b35-b6e69c8288c6/volumes"
Sep 10 14:34:07.912797 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:07.912745    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c216ec76-73f5-45fc-a1e5-6839b775ed82" path="/var/lib/kubelet/pods/c216ec76-73f5-45fc-a1e5-6839b775ed82/volumes"
Sep 10 14:34:08.471398 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:08.471361    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"]
Sep 10 14:34:08.471704 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:08.471660    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw" podUID="831b1cd6-a9ad-41ce-9bee-b720661a53d8" containerName="payload-processing" containerID="cri-o://1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f" gracePeriod=30
Sep 10 14:34:08.750404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:08.750377    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:34:08.805460 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:08.805430    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/831b1cd6-a9ad-41ce-9bee-b720661a53d8-plugins-config-volume\") pod \"831b1cd6-a9ad-41ce-9bee-b720661a53d8\" (UID: \"831b1cd6-a9ad-41ce-9bee-b720661a53d8\") "
Sep 10 14:34:08.805625 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:08.805490    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-684dl\" (UniqueName: \"kubernetes.io/projected/831b1cd6-a9ad-41ce-9bee-b720661a53d8-kube-api-access-684dl\") pod \"831b1cd6-a9ad-41ce-9bee-b720661a53d8\" (UID: \"831b1cd6-a9ad-41ce-9bee-b720661a53d8\") "
Sep 10 14:34:08.805849 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:08.805825    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/831b1cd6-a9ad-41ce-9bee-b720661a53d8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "831b1cd6-a9ad-41ce-9bee-b720661a53d8" (UID: "831b1cd6-a9ad-41ce-9bee-b720661a53d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:34:08.807721 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:08.807697    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/831b1cd6-a9ad-41ce-9bee-b720661a53d8-kube-api-access-684dl" (OuterVolumeSpecName: "kube-api-access-684dl") pod "831b1cd6-a9ad-41ce-9bee-b720661a53d8" (UID: "831b1cd6-a9ad-41ce-9bee-b720661a53d8"). InnerVolumeSpecName "kube-api-access-684dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:34:08.906828 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:08.906762    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/831b1cd6-a9ad-41ce-9bee-b720661a53d8-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:08.906828 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:08.906820    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-684dl\" (UniqueName: \"kubernetes.io/projected/831b1cd6-a9ad-41ce-9bee-b720661a53d8-kube-api-access-684dl\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:09.531763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:09.531723    2579 generic.go:356] "Generic (PLEG): container finished" podID="831b1cd6-a9ad-41ce-9bee-b720661a53d8" containerID="1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f" exitCode=0
Sep 10 14:34:09.532207 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:09.531772    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"
Sep 10 14:34:09.532207 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:09.531807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw" event={"ID":"831b1cd6-a9ad-41ce-9bee-b720661a53d8","Type":"ContainerDied","Data":"1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f"}
Sep 10 14:34:09.532207 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:09.531867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw" event={"ID":"831b1cd6-a9ad-41ce-9bee-b720661a53d8","Type":"ContainerDied","Data":"8cf79de16accbdd2c29dcde615477d86c02b538ee1ffd09d1d93abd03e3c4ca2"}
Sep 10 14:34:09.532207 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:09.531888    2579 scope.go:117] "RemoveContainer" containerID="1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f"
Sep 10 14:34:09.541856 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:09.541773    2579 scope.go:117] "RemoveContainer" containerID="1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f"
Sep 10 14:34:09.542119 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:34:09.542099    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f\": container with ID starting with 1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f not found: ID does not exist" containerID="1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f"
Sep 10 14:34:09.542169 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:09.542129    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f"} err="failed to get container status \"1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f\": rpc error: code = NotFound desc = could not find container \"1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f\": container with ID starting with 1c0c2d16b113c748af66bea35957dab1b2e52e7863926828a56b4b2bcfb77f9f not found: ID does not exist"
Sep 10 14:34:09.554152 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:09.554127    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"]
Sep 10 14:34:09.557825 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:09.557800    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-d24d4c-65b655c8c-cllhw"]
Sep 10 14:34:09.912814 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:09.912717    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="831b1cd6-a9ad-41ce-9bee-b720661a53d8" path="/var/lib/kubelet/pods/831b1cd6-a9ad-41ce-9bee-b720661a53d8/volumes"
Sep 10 14:34:11.309165 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.309138    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:34:11.330840 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.330807    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-credential-socket\") pod \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") "
Sep 10 14:34:11.330840 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.330844    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-data\") pod \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") "
Sep 10 14:34:11.331066 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.330868    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbp69\" (UniqueName: \"kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-kube-api-access-gbp69\") pod \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") "
Sep 10 14:34:11.331066 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.330900    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-socket\") pod \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") "
Sep 10 14:34:11.331066 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.331010    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-certs\") pod \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") "
Sep 10 14:34:11.331232 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.331154    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-token\") pod \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") "
Sep 10 14:34:11.331232 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.331179    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-data" (OuterVolumeSpecName: "istio-data") pod "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" (UID: "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:34:11.331232 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.331196    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" (UID: "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:34:11.331232 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.331209    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-podinfo\") pod \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") "
Sep 10 14:34:11.331572 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.331259    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-envoy\") pod \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") "
Sep 10 14:34:11.331572 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.331314    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istiod-ca-cert\") pod \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\" (UID: \"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8\") "
Sep 10 14:34:11.331696 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.331662    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" (UID: "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:34:11.331747 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.331707    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" (UID: "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:34:11.331836 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.331764    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:11.331836 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.331822    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:11.332124 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.332049    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" (UID: "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:34:11.334163 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.334126    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-token" (OuterVolumeSpecName: "istio-token") pod "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" (UID: "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:34:11.335760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.334637    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-kube-api-access-gbp69" (OuterVolumeSpecName: "kube-api-access-gbp69") pod "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" (UID: "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8"). InnerVolumeSpecName "kube-api-access-gbp69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:34:11.335760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.334742    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" (UID: "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:34:11.335760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.334925    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" (UID: "9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:34:11.432589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.432547    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:11.432589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.432583    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:11.432589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.432593    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:11.432860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.432601    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:11.432860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.432611    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:11.432860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.432619    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:11.432860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.432627    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbp69\" (UniqueName: \"kubernetes.io/projected/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8-kube-api-access-gbp69\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:34:11.545934 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.545834    2579 generic.go:356] "Generic (PLEG): container finished" podID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerID="ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18" exitCode=0
Sep 10 14:34:11.545934 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.545896    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"
Sep 10 14:34:11.545934 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.545897    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" event={"ID":"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8","Type":"ContainerDied","Data":"ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18"}
Sep 10 14:34:11.546177 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.545995    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5" event={"ID":"9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8","Type":"ContainerDied","Data":"7a93d0699b3d31a095ffd1aec5f91a9f13770ca3d36fd359b2f5ca85fa9baa00"}
Sep 10 14:34:11.546177 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.546026    2579 scope.go:117] "RemoveContainer" containerID="ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18"
Sep 10 14:34:11.556312 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.556281    2579 scope.go:117] "RemoveContainer" containerID="051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42"
Sep 10 14:34:11.565008 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.564981    2579 scope.go:117] "RemoveContainer" containerID="ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18"
Sep 10 14:34:11.565319 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:34:11.565300    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18\": container with ID starting with ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18 not found: ID does not exist" containerID="ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18"
Sep 10 14:34:11.565382 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.565327    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18"} err="failed to get container status \"ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18\": rpc error: code = NotFound desc = could not find container \"ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18\": container with ID starting with ed24819458e56b842a5f4891043d3a7942fb8a4559067dcd1be22332bea7ba18 not found: ID does not exist"
Sep 10 14:34:11.565382 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.565346    2579 scope.go:117] "RemoveContainer" containerID="051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42"
Sep 10 14:34:11.565593 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:34:11.565574    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42\": container with ID starting with 051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42 not found: ID does not exist" containerID="051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42"
Sep 10 14:34:11.565639 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.565599    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42"} err="failed to get container status \"051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42\": rpc error: code = NotFound desc = could not find container \"051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42\": container with ID starting with 051fde49a82e6aa4ff06c714d7ce74e6e67ebb05e759778b93f8d7bd77b82a42 not found: ID does not exist"
Sep 10 14:34:11.568959 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.568933    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"]
Sep 10 14:34:11.575209 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.575180    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0245a1e4-openshift-default-f8f5c8844-gngc5"]
Sep 10 14:34:11.912851 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:11.912745    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" path="/var/lib/kubelet/pods/9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8/volumes"
Sep 10 14:34:13.905365 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:13.905331    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:34:13.905930 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:13.905909    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:34:13.912685 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:13.912665    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:34:13.913640 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:13.913619    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:34:16.083091 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083037    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"]
Sep 10 14:34:16.083713 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083690    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="440138ea-c717-41c1-ae53-b8ad2c8fd886" containerName="revoke-keys"
Sep 10 14:34:16.083766 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083718    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="440138ea-c717-41c1-ae53-b8ad2c8fd886" containerName="revoke-keys"
Sep 10 14:34:16.083766 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083748    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy"
Sep 10 14:34:16.083766 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083756    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy"
Sep 10 14:34:16.083924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083766    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c216ec76-73f5-45fc-a1e5-6839b775ed82" containerName="payload-pre-processing"
Sep 10 14:34:16.083924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083775    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c216ec76-73f5-45fc-a1e5-6839b775ed82" containerName="payload-pre-processing"
Sep 10 14:34:16.083924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083803    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy"
Sep 10 14:34:16.083924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083811    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy"
Sep 10 14:34:16.083924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083830    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="831b1cd6-a9ad-41ce-9bee-b720661a53d8" containerName="payload-processing"
Sep 10 14:34:16.083924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083838    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="831b1cd6-a9ad-41ce-9bee-b720661a53d8" containerName="payload-processing"
Sep 10 14:34:16.083924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083848    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c95c42a-f337-4fe5-9b35-b6e69c8288c6" containerName="payload-processing"
Sep 10 14:34:16.083924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083856    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c95c42a-f337-4fe5-9b35-b6e69c8288c6" containerName="payload-processing"
Sep 10 14:34:16.084187 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083953    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy"
Sep 10 14:34:16.084187 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083964    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="831b1cd6-a9ad-41ce-9bee-b720661a53d8" containerName="payload-processing"
Sep 10 14:34:16.084187 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083973    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="440138ea-c717-41c1-ae53-b8ad2c8fd886" containerName="revoke-keys"
Sep 10 14:34:16.084187 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083984    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c216ec76-73f5-45fc-a1e5-6839b775ed82" containerName="payload-pre-processing"
Sep 10 14:34:16.084187 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.083991    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c95c42a-f337-4fe5-9b35-b6e69c8288c6" containerName="payload-processing"
Sep 10 14:34:16.089320 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.089284    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.092192 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.092168    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-345a2c-openshift-default-dockercfg-rdgvp\""
Sep 10 14:34:16.099209 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.099181    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"]
Sep 10 14:34:16.175707 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.175668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-envoy\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.175923 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.175741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-data\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.175923 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.175820    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-token\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.175923 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.175863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-podinfo\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.175923 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.175901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df835c40-57f0-4293-ac8c-4de1a8a63aab-istiod-ca-cert\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.176188 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.176003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-certs\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.176188 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.176049    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-credential-socket\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.176188 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.176108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7hjh\" (UniqueName: \"kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-kube-api-access-k7hjh\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.176188 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.176136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-socket\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.276721 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.276678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-data\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.276721 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.276720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-token\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.277024 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.276739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-podinfo\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.277024 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.276755    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df835c40-57f0-4293-ac8c-4de1a8a63aab-istiod-ca-cert\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.277024 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.276815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-certs\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.277190 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.276957    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-credential-socket\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.277190 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.277133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7hjh\" (UniqueName: \"kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-kube-api-access-k7hjh\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.277190 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.277187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-socket\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.277356 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.277293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-envoy\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.277568 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.277540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-data\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.277863 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.277609    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-credential-socket\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.277863 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.277772    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-socket\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.278026 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.278003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-certs\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.278093 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.278034    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df835c40-57f0-4293-ac8c-4de1a8a63aab-istiod-ca-cert\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.280220 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.280027    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-podinfo\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.280333 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.280261    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-envoy\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.286454 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.286424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-token\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.286742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.286724    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7hjh\" (UniqueName: \"kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-kube-api-access-k7hjh\") pod \"e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") " pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.401496 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.401393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:16.680464 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.680434    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"]
Sep 10 14:34:16.682424 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:34:16.682394    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf835c40_57f0_4293_ac8c_4de1a8a63aab.slice/crio-19199957b90a2736eb85ba42906323ea8e79b09a0cc9099c5ae158db7d753d84 WatchSource:0}: Error finding container 19199957b90a2736eb85ba42906323ea8e79b09a0cc9099c5ae158db7d753d84: Status 404 returned error can't find the container with id 19199957b90a2736eb85ba42906323ea8e79b09a0cc9099c5ae158db7d753d84
Sep 10 14:34:16.684649 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.684614    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:34:16.684730 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.684683    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:34:16.684730 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:16.684711    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:34:17.584375 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:17.584338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" event={"ID":"df835c40-57f0-4293-ac8c-4de1a8a63aab","Type":"ContainerStarted","Data":"c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4"}
Sep 10 14:34:17.584909 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:17.584389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" event={"ID":"df835c40-57f0-4293-ac8c-4de1a8a63aab","Type":"ContainerStarted","Data":"19199957b90a2736eb85ba42906323ea8e79b09a0cc9099c5ae158db7d753d84"}
Sep 10 14:34:17.606731 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:17.606668    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" podStartSLOduration=1.606649416 podStartE2EDuration="1.606649416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:34:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:34:17.604444505 +0000 UTC m=+904.196649275" watchObservedRunningTime="2026-09-10 14:34:17.606649416 +0000 UTC m=+904.198854185"
Sep 10 14:34:18.402276 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:18.402240    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:18.407815 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:18.407757    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:18.590032 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:18.589999    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:18.591245 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:18.591224    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:21.611053 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.611016    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"]
Sep 10 14:34:21.611550 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.611533    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e3d06f8-04c0-4f4a-a34c-5729fe6b4cb8" containerName="istio-proxy"
Sep 10 14:34:21.615883 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.615846    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:34:21.619056 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.619026    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-345a2c\""
Sep 10 14:34:21.619056 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.619047    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-345a2c-dockercfg-89fdx\""
Sep 10 14:34:21.635635 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.635601    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"]
Sep 10 14:34:21.729249 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.729207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b82b2636-a411-4fd0-a34a-01384c4f58b6-plugins-config-volume\") pod \"payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb\" (UID: \"b82b2636-a411-4fd0-a34a-01384c4f58b6\") " pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:34:21.729440 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.729296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47qzv\" (UniqueName: \"kubernetes.io/projected/b82b2636-a411-4fd0-a34a-01384c4f58b6-kube-api-access-47qzv\") pod \"payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb\" (UID: \"b82b2636-a411-4fd0-a34a-01384c4f58b6\") " pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:34:21.829865 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.829820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b82b2636-a411-4fd0-a34a-01384c4f58b6-plugins-config-volume\") pod \"payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb\" (UID: \"b82b2636-a411-4fd0-a34a-01384c4f58b6\") " pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:34:21.830039 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.829907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47qzv\" (UniqueName: \"kubernetes.io/projected/b82b2636-a411-4fd0-a34a-01384c4f58b6-kube-api-access-47qzv\") pod \"payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb\" (UID: \"b82b2636-a411-4fd0-a34a-01384c4f58b6\") " pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:34:21.830517 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.830495    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b82b2636-a411-4fd0-a34a-01384c4f58b6-plugins-config-volume\") pod \"payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb\" (UID: \"b82b2636-a411-4fd0-a34a-01384c4f58b6\") " pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:34:21.839090 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.839056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47qzv\" (UniqueName: \"kubernetes.io/projected/b82b2636-a411-4fd0-a34a-01384c4f58b6-kube-api-access-47qzv\") pod \"payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb\" (UID: \"b82b2636-a411-4fd0-a34a-01384c4f58b6\") " pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:34:21.930010 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:21.929918    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:34:22.211679 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:22.211646    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"]
Sep 10 14:34:22.213711 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:34:22.213667    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82b2636_a411_4fd0_a34a_01384c4f58b6.slice/crio-89671de171083d86e6ebf4ebe489a80412d47c183d8c126ef93ede86a81b8da4 WatchSource:0}: Error finding container 89671de171083d86e6ebf4ebe489a80412d47c183d8c126ef93ede86a81b8da4: Status 404 returned error can't find the container with id 89671de171083d86e6ebf4ebe489a80412d47c183d8c126ef93ede86a81b8da4
Sep 10 14:34:22.612546 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:22.612510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb" event={"ID":"b82b2636-a411-4fd0-a34a-01384c4f58b6","Type":"ContainerStarted","Data":"e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45"}
Sep 10 14:34:22.612987 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:22.612575    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:34:22.612987 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:22.612595    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb" event={"ID":"b82b2636-a411-4fd0-a34a-01384c4f58b6","Type":"ContainerStarted","Data":"89671de171083d86e6ebf4ebe489a80412d47c183d8c126ef93ede86a81b8da4"}
Sep 10 14:34:22.631527 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:22.631469    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb" podStartSLOduration=1.631450176 podStartE2EDuration="1.631450176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:34:22.629862987 +0000 UTC m=+909.222067757" watchObservedRunningTime="2026-09-10 14:34:22.631450176 +0000 UTC m=+909.223654944"
Sep 10 14:34:33.620641 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:33.620609    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:34:39.724723 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:39.724686    2579 generic.go:356] "Generic (PLEG): container finished" podID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerID="c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4" exitCode=0
Sep 10 14:34:39.725216 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:39.724759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" event={"ID":"df835c40-57f0-4293-ac8c-4de1a8a63aab","Type":"ContainerDied","Data":"c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4"}
Sep 10 14:34:39.725216 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:39.725201    2579 scope.go:117] "RemoveContainer" containerID="c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4"
Sep 10 14:34:39.726275 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:39.726245    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:34:39.726372 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:39.726327    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:34:39.726432 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:39.726408    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:34:40.732513 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:40.732477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" event={"ID":"df835c40-57f0-4293-ac8c-4de1a8a63aab","Type":"ContainerStarted","Data":"ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1"}
Sep 10 14:34:41.401772 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:41.401726    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:41.402062 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:41.402035    2579 patch_prober.go:28] interesting pod/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 14:34:41.402153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:41.402100    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 14:34:42.402320 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:42.402280    2579 patch_prober.go:28] interesting pod/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 14:34:42.402732 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:42.402367    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 14:34:43.402751 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:43.402710    2579 patch_prober.go:28] interesting pod/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 14:34:43.403200 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:43.402815    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 14:34:44.402213 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:44.402176    2579 patch_prober.go:28] interesting pod/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 14:34:44.402403 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:44.402230    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 14:34:45.402102 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:45.402054    2579 patch_prober.go:28] interesting pod/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 10 14:34:45.402594 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:45.402123    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 10 14:34:46.405995 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:46.405964    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:46.406424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:46.406234    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:34:46.406862 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:34:46.406845    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:35:35.346699 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:35.346608    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"]
Sep 10 14:35:35.347304 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:35.346870    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb" podUID="b82b2636-a411-4fd0-a34a-01384c4f58b6" containerName="payload-processing" containerID="cri-o://e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45" gracePeriod=30
Sep 10 14:35:35.619251 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:35.619179    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:35:35.702567 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:35.702529    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b82b2636-a411-4fd0-a34a-01384c4f58b6-plugins-config-volume\") pod \"b82b2636-a411-4fd0-a34a-01384c4f58b6\" (UID: \"b82b2636-a411-4fd0-a34a-01384c4f58b6\") "
Sep 10 14:35:35.702741 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:35.702681    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47qzv\" (UniqueName: \"kubernetes.io/projected/b82b2636-a411-4fd0-a34a-01384c4f58b6-kube-api-access-47qzv\") pod \"b82b2636-a411-4fd0-a34a-01384c4f58b6\" (UID: \"b82b2636-a411-4fd0-a34a-01384c4f58b6\") "
Sep 10 14:35:35.703035 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:35.703011    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b82b2636-a411-4fd0-a34a-01384c4f58b6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b82b2636-a411-4fd0-a34a-01384c4f58b6" (UID: "b82b2636-a411-4fd0-a34a-01384c4f58b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:35:35.704976 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:35.704953    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82b2636-a411-4fd0-a34a-01384c4f58b6-kube-api-access-47qzv" (OuterVolumeSpecName: "kube-api-access-47qzv") pod "b82b2636-a411-4fd0-a34a-01384c4f58b6" (UID: "b82b2636-a411-4fd0-a34a-01384c4f58b6"). InnerVolumeSpecName "kube-api-access-47qzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:35:35.803943 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:35.803907    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47qzv\" (UniqueName: \"kubernetes.io/projected/b82b2636-a411-4fd0-a34a-01384c4f58b6-kube-api-access-47qzv\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:35:35.803943 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:35.803937    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b82b2636-a411-4fd0-a34a-01384c4f58b6-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:35:36.038207 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:36.038173    2579 generic.go:356] "Generic (PLEG): container finished" podID="b82b2636-a411-4fd0-a34a-01384c4f58b6" containerID="e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45" exitCode=0
Sep 10 14:35:36.038376 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:36.038215    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"
Sep 10 14:35:36.038376 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:36.038248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb" event={"ID":"b82b2636-a411-4fd0-a34a-01384c4f58b6","Type":"ContainerDied","Data":"e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45"}
Sep 10 14:35:36.038376 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:36.038299    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb" event={"ID":"b82b2636-a411-4fd0-a34a-01384c4f58b6","Type":"ContainerDied","Data":"89671de171083d86e6ebf4ebe489a80412d47c183d8c126ef93ede86a81b8da4"}
Sep 10 14:35:36.038376 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:36.038322    2579 scope.go:117] "RemoveContainer" containerID="e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45"
Sep 10 14:35:36.048763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:36.048740    2579 scope.go:117] "RemoveContainer" containerID="e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45"
Sep 10 14:35:36.049127 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:35:36.049100    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45\": container with ID starting with e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45 not found: ID does not exist" containerID="e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45"
Sep 10 14:35:36.049192 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:36.049130    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45"} err="failed to get container status \"e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45\": rpc error: code = NotFound desc = could not find container \"e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45\": container with ID starting with e3324e08e86ac279edb92c2c9ecb36901d7e1f50b7a7bc18fda07f7c10a96c45 not found: ID does not exist"
Sep 10 14:35:36.064569 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:36.064534    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"]
Sep 10 14:35:36.067397 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:36.067370    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-345a2c-7868b8974f-gvqgb"]
Sep 10 14:35:37.913396 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:37.913360    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b82b2636-a411-4fd0-a34a-01384c4f58b6" path="/var/lib/kubelet/pods/b82b2636-a411-4fd0-a34a-01384c4f58b6/volumes"
Sep 10 14:35:48.124018 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.123984    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"]
Sep 10 14:35:48.124424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.124400    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82b2636-a411-4fd0-a34a-01384c4f58b6" containerName="payload-processing"
Sep 10 14:35:48.124424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.124413    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82b2636-a411-4fd0-a34a-01384c4f58b6" containerName="payload-processing"
Sep 10 14:35:48.124511 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.124486    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82b2636-a411-4fd0-a34a-01384c4f58b6" containerName="payload-processing"
Sep 10 14:35:48.126613 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.126592    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:35:48.129818 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.129564    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-e25a5e89\""
Sep 10 14:35:48.130682 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.130658    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-e25a5e89-dockercfg-jqxsl\""
Sep 10 14:35:48.143866 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.143709    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"]
Sep 10 14:35:48.170242 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.170210    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"]
Sep 10 14:35:48.170446 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.170423    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy" containerID="cri-o://ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1" gracePeriod=30
Sep 10 14:35:48.226458 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.226417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-plugins-config-volume\") pod \"payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll\" (UID: \"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47\") " pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:35:48.226658 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.226513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx4qx\" (UniqueName: \"kubernetes.io/projected/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-kube-api-access-mx4qx\") pod \"payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll\" (UID: \"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47\") " pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:35:48.327302 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.327268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx4qx\" (UniqueName: \"kubernetes.io/projected/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-kube-api-access-mx4qx\") pod \"payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll\" (UID: \"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47\") " pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:35:48.327479 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.327354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-plugins-config-volume\") pod \"payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll\" (UID: \"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47\") " pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:35:48.328078 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.328060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-plugins-config-volume\") pod \"payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll\" (UID: \"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47\") " pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:35:48.336761 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.336737    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx4qx\" (UniqueName: \"kubernetes.io/projected/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-kube-api-access-mx4qx\") pod \"payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll\" (UID: \"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47\") " pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:35:48.440417 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.440304    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:35:48.714555 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:48.714467    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"]
Sep 10 14:35:48.717989 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:35:48.717960    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode066ab1d_f7fc_46a2_a8a0_4bbdc5b06d47.slice/crio-1c68239e96c5e48394ecf1c267fc0001833a9da7a659bf890951f922b104d10f WatchSource:0}: Error finding container 1c68239e96c5e48394ecf1c267fc0001833a9da7a659bf890951f922b104d10f: Status 404 returned error can't find the container with id 1c68239e96c5e48394ecf1c267fc0001833a9da7a659bf890951f922b104d10f
Sep 10 14:35:49.120303 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:49.120256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll" event={"ID":"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47","Type":"ContainerStarted","Data":"b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56"}
Sep 10 14:35:49.120511 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:49.120312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll" event={"ID":"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47","Type":"ContainerStarted","Data":"1c68239e96c5e48394ecf1c267fc0001833a9da7a659bf890951f922b104d10f"}
Sep 10 14:35:49.120511 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:49.120394    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:35:49.140420 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:49.140363    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll" podStartSLOduration=1.140345226 podStartE2EDuration="1.140345226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:35:49.138498239 +0000 UTC m=+995.730703033" watchObservedRunningTime="2026-09-10 14:35:49.140345226 +0000 UTC m=+995.732550020"
Sep 10 14:35:53.423969 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.423943    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:35:53.480000 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.479906    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-data\") pod \"df835c40-57f0-4293-ac8c-4de1a8a63aab\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") "
Sep 10 14:35:53.480000 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.479976    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-token\") pod \"df835c40-57f0-4293-ac8c-4de1a8a63aab\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") "
Sep 10 14:35:53.480243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480038    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df835c40-57f0-4293-ac8c-4de1a8a63aab-istiod-ca-cert\") pod \"df835c40-57f0-4293-ac8c-4de1a8a63aab\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") "
Sep 10 14:35:53.480243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-credential-socket\") pod \"df835c40-57f0-4293-ac8c-4de1a8a63aab\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") "
Sep 10 14:35:53.480243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480092    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-podinfo\") pod \"df835c40-57f0-4293-ac8c-4de1a8a63aab\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") "
Sep 10 14:35:53.480243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480130    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7hjh\" (UniqueName: \"kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-kube-api-access-k7hjh\") pod \"df835c40-57f0-4293-ac8c-4de1a8a63aab\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") "
Sep 10 14:35:53.480243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480168    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-certs\") pod \"df835c40-57f0-4293-ac8c-4de1a8a63aab\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") "
Sep 10 14:35:53.480243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480195    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-socket\") pod \"df835c40-57f0-4293-ac8c-4de1a8a63aab\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") "
Sep 10 14:35:53.480243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480233    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-envoy\") pod \"df835c40-57f0-4293-ac8c-4de1a8a63aab\" (UID: \"df835c40-57f0-4293-ac8c-4de1a8a63aab\") "
Sep 10 14:35:53.480608 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480533    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "df835c40-57f0-4293-ac8c-4de1a8a63aab" (UID: "df835c40-57f0-4293-ac8c-4de1a8a63aab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:35:53.480608 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480578    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-data" (OuterVolumeSpecName: "istio-data") pod "df835c40-57f0-4293-ac8c-4de1a8a63aab" (UID: "df835c40-57f0-4293-ac8c-4de1a8a63aab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:35:53.480735 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480632    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "df835c40-57f0-4293-ac8c-4de1a8a63aab" (UID: "df835c40-57f0-4293-ac8c-4de1a8a63aab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:35:53.480735 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480558    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df835c40-57f0-4293-ac8c-4de1a8a63aab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "df835c40-57f0-4293-ac8c-4de1a8a63aab" (UID: "df835c40-57f0-4293-ac8c-4de1a8a63aab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:35:53.480735 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.480709    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "df835c40-57f0-4293-ac8c-4de1a8a63aab" (UID: "df835c40-57f0-4293-ac8c-4de1a8a63aab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:35:53.482884 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.482852    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "df835c40-57f0-4293-ac8c-4de1a8a63aab" (UID: "df835c40-57f0-4293-ac8c-4de1a8a63aab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:35:53.483018 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.482943    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "df835c40-57f0-4293-ac8c-4de1a8a63aab" (UID: "df835c40-57f0-4293-ac8c-4de1a8a63aab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:35:53.483018 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.482947    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-token" (OuterVolumeSpecName: "istio-token") pod "df835c40-57f0-4293-ac8c-4de1a8a63aab" (UID: "df835c40-57f0-4293-ac8c-4de1a8a63aab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:35:53.483145 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.483073    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-kube-api-access-k7hjh" (OuterVolumeSpecName: "kube-api-access-k7hjh") pod "df835c40-57f0-4293-ac8c-4de1a8a63aab" (UID: "df835c40-57f0-4293-ac8c-4de1a8a63aab"). InnerVolumeSpecName "kube-api-access-k7hjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:35:53.581917 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.581872    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:35:53.581917 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.581907    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df835c40-57f0-4293-ac8c-4de1a8a63aab-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:35:53.581917 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.581920    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:35:53.582185 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.581934    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:35:53.582185 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.581946    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7hjh\" (UniqueName: \"kubernetes.io/projected/df835c40-57f0-4293-ac8c-4de1a8a63aab-kube-api-access-k7hjh\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:35:53.582185 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.581957    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:35:53.582185 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.581968    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:35:53.582185 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.581978    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:35:53.582185 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:53.581988    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df835c40-57f0-4293-ac8c-4de1a8a63aab-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:35:54.148648 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.148610    2579 generic.go:356] "Generic (PLEG): container finished" podID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerID="ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1" exitCode=0
Sep 10 14:35:54.148833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.148679    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"
Sep 10 14:35:54.148833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.148704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" event={"ID":"df835c40-57f0-4293-ac8c-4de1a8a63aab","Type":"ContainerDied","Data":"ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1"}
Sep 10 14:35:54.148833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.148794    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m" event={"ID":"df835c40-57f0-4293-ac8c-4de1a8a63aab","Type":"ContainerDied","Data":"19199957b90a2736eb85ba42906323ea8e79b09a0cc9099c5ae158db7d753d84"}
Sep 10 14:35:54.148833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.148808    2579 scope.go:117] "RemoveContainer" containerID="ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1"
Sep 10 14:35:54.159427 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.159395    2579 scope.go:117] "RemoveContainer" containerID="c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4"
Sep 10 14:35:54.169507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.169481    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"]
Sep 10 14:35:54.170746 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.170720    2579 scope.go:117] "RemoveContainer" containerID="ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1"
Sep 10 14:35:54.171082 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:35:54.171065    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1\": container with ID starting with ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1 not found: ID does not exist" containerID="ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1"
Sep 10 14:35:54.171139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.171090    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1"} err="failed to get container status \"ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1\": rpc error: code = NotFound desc = could not find container \"ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1\": container with ID starting with ad4d0e76ae0edc1f636aafe14ca7c66e6ae5f4fb616c3056c6693e1436d511a1 not found: ID does not exist"
Sep 10 14:35:54.171139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.171108    2579 scope.go:117] "RemoveContainer" containerID="c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4"
Sep 10 14:35:54.171405 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:35:54.171388    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4\": container with ID starting with c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4 not found: ID does not exist" containerID="c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4"
Sep 10 14:35:54.171442 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.171412    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4"} err="failed to get container status \"c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4\": rpc error: code = NotFound desc = could not find container \"c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4\": container with ID starting with c5c3d3bb3f2de4904db4a9e9e4933c8a4177bea0fbc43c6a00be00ca935959f4 not found: ID does not exist"
Sep 10 14:35:54.175877 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:54.175850    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-345a2c-openshift-default-5b9cf7878d-gv78m"]
Sep 10 14:35:55.913049 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:35:55.913013    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" path="/var/lib/kubelet/pods/df835c40-57f0-4293-ac8c-4de1a8a63aab/volumes"
Sep 10 14:36:00.127282 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:00.127253    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:36:18.481248 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.481203    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"]
Sep 10 14:36:18.481657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.481628    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy"
Sep 10 14:36:18.481657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.481641    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy"
Sep 10 14:36:18.481657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.481652    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy"
Sep 10 14:36:18.481657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.481657    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy"
Sep 10 14:36:18.481836 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.481723    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy"
Sep 10 14:36:18.484232 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.484214    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"
Sep 10 14:36:18.488417 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.488392    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwr7b\""
Sep 10 14:36:18.498885 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.498851    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"]
Sep 10 14:36:18.619596 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.619546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49570f81-c33c-4d82-b343-125946a2e11b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf\" (UID: \"49570f81-c33c-4d82-b343-125946a2e11b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"
Sep 10 14:36:18.720541 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.720494    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49570f81-c33c-4d82-b343-125946a2e11b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf\" (UID: \"49570f81-c33c-4d82-b343-125946a2e11b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"
Sep 10 14:36:18.721175 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.721154    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49570f81-c33c-4d82-b343-125946a2e11b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf\" (UID: \"49570f81-c33c-4d82-b343-125946a2e11b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"
Sep 10 14:36:18.794420 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:18.794370    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"
Sep 10 14:36:19.067197 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:19.067169    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"]
Sep 10 14:36:19.070340 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:36:19.070308    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49570f81_c33c_4d82_b343_125946a2e11b.slice/crio-2b0964dafe0a16d66f9c9a617913e5277a9c23c5028be513e8dffe4835cf45e0 WatchSource:0}: Error finding container 2b0964dafe0a16d66f9c9a617913e5277a9c23c5028be513e8dffe4835cf45e0: Status 404 returned error can't find the container with id 2b0964dafe0a16d66f9c9a617913e5277a9c23c5028be513e8dffe4835cf45e0
Sep 10 14:36:19.287125 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:19.287094    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf" event={"ID":"49570f81-c33c-4d82-b343-125946a2e11b","Type":"ContainerStarted","Data":"2b0964dafe0a16d66f9c9a617913e5277a9c23c5028be513e8dffe4835cf45e0"}
Sep 10 14:36:20.293758 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:20.293721    2579 generic.go:356] "Generic (PLEG): container finished" podID="49570f81-c33c-4d82-b343-125946a2e11b" containerID="65acc4ccbb6c553df9532ac5df4bde8a2901c25260446840899d90c2eb7c1569" exitCode=0
Sep 10 14:36:20.294153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:20.293811    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf" event={"ID":"49570f81-c33c-4d82-b343-125946a2e11b","Type":"ContainerDied","Data":"65acc4ccbb6c553df9532ac5df4bde8a2901c25260446840899d90c2eb7c1569"}
Sep 10 14:36:21.450449 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:21.450415    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"
Sep 10 14:36:21.550006 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:21.549917    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49570f81-c33c-4d82-b343-125946a2e11b-maas-api-service-ca\") pod \"49570f81-c33c-4d82-b343-125946a2e11b\" (UID: \"49570f81-c33c-4d82-b343-125946a2e11b\") "
Sep 10 14:36:21.550280 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:21.550255    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49570f81-c33c-4d82-b343-125946a2e11b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "49570f81-c33c-4d82-b343-125946a2e11b" (UID: "49570f81-c33c-4d82-b343-125946a2e11b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:36:21.651026 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:21.650978    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49570f81-c33c-4d82-b343-125946a2e11b-maas-api-service-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:22.305832 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.305803    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"
Sep 10 14:36:22.306007 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.305802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf" event={"ID":"49570f81-c33c-4d82-b343-125946a2e11b","Type":"ContainerDied","Data":"2b0964dafe0a16d66f9c9a617913e5277a9c23c5028be513e8dffe4835cf45e0"}
Sep 10 14:36:22.306007 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.305925    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b0964dafe0a16d66f9c9a617913e5277a9c23c5028be513e8dffe4835cf45e0"
Sep 10 14:36:22.481736 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.481703    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"]
Sep 10 14:36:22.482897 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.482867    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49570f81-c33c-4d82-b343-125946a2e11b" containerName="revoke-keys"
Sep 10 14:36:22.482897 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.482897    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="49570f81-c33c-4d82-b343-125946a2e11b" containerName="revoke-keys"
Sep 10 14:36:22.483115 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.483019    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="df835c40-57f0-4293-ac8c-4de1a8a63aab" containerName="istio-proxy"
Sep 10 14:36:22.483115 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.483039    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="49570f81-c33c-4d82-b343-125946a2e11b" containerName="revoke-keys"
Sep 10 14:36:22.485660 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.485640    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"
Sep 10 14:36:22.489154 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.489129    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwr7b\""
Sep 10 14:36:22.494839 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.494813    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"]
Sep 10 14:36:22.660968 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.660876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba41315-caa4-499f-be17-f5fad9b57af4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-600197-4zjss\" (UID: \"aba41315-caa4-499f-be17-f5fad9b57af4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"
Sep 10 14:36:22.762090 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.762051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba41315-caa4-499f-be17-f5fad9b57af4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-600197-4zjss\" (UID: \"aba41315-caa4-499f-be17-f5fad9b57af4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"
Sep 10 14:36:22.762699 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.762676    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba41315-caa4-499f-be17-f5fad9b57af4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-600197-4zjss\" (UID: \"aba41315-caa4-499f-be17-f5fad9b57af4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"
Sep 10 14:36:22.798235 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:22.798196    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"
Sep 10 14:36:23.073090 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:23.073059    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"]
Sep 10 14:36:23.075547 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:36:23.075522    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba41315_caa4_499f_be17_f5fad9b57af4.slice/crio-3e8e911d592d24a46f8808ca43f211a8d702062945963e03b56558243de2f45f WatchSource:0}: Error finding container 3e8e911d592d24a46f8808ca43f211a8d702062945963e03b56558243de2f45f: Status 404 returned error can't find the container with id 3e8e911d592d24a46f8808ca43f211a8d702062945963e03b56558243de2f45f
Sep 10 14:36:23.312839 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:23.312807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss" event={"ID":"aba41315-caa4-499f-be17-f5fad9b57af4","Type":"ContainerStarted","Data":"3e8e911d592d24a46f8808ca43f211a8d702062945963e03b56558243de2f45f"}
Sep 10 14:36:24.319797 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:24.319746    2579 generic.go:356] "Generic (PLEG): container finished" podID="aba41315-caa4-499f-be17-f5fad9b57af4" containerID="ed0fa6dc8669e0a9900af68633dfe613840765f84b3fddadff2caec9c93c79c0" exitCode=0
Sep 10 14:36:24.320197 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:24.319819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss" event={"ID":"aba41315-caa4-499f-be17-f5fad9b57af4","Type":"ContainerDied","Data":"ed0fa6dc8669e0a9900af68633dfe613840765f84b3fddadff2caec9c93c79c0"}
Sep 10 14:36:25.468307 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:25.468282    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"
Sep 10 14:36:25.589500 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:25.589406    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba41315-caa4-499f-be17-f5fad9b57af4-maas-api-service-ca\") pod \"aba41315-caa4-499f-be17-f5fad9b57af4\" (UID: \"aba41315-caa4-499f-be17-f5fad9b57af4\") "
Sep 10 14:36:25.589768 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:25.589744    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aba41315-caa4-499f-be17-f5fad9b57af4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "aba41315-caa4-499f-be17-f5fad9b57af4" (UID: "aba41315-caa4-499f-be17-f5fad9b57af4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:36:25.690267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:25.690226    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba41315-caa4-499f-be17-f5fad9b57af4-maas-api-service-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:26.332063 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:26.332033    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"
Sep 10 14:36:26.332250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:26.332068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss" event={"ID":"aba41315-caa4-499f-be17-f5fad9b57af4","Type":"ContainerDied","Data":"3e8e911d592d24a46f8808ca43f211a8d702062945963e03b56558243de2f45f"}
Sep 10 14:36:26.332250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:26.332126    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e8e911d592d24a46f8808ca43f211a8d702062945963e03b56558243de2f45f"
Sep 10 14:36:29.285561 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.285507    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"]
Sep 10 14:36:29.286429 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.286393    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll" podUID="e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47" containerName="payload-processing" containerID="cri-o://b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56" gracePeriod=30
Sep 10 14:36:29.435074 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.434986    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"]
Sep 10 14:36:29.438272 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.438127    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e25a5e89-svzbf"]
Sep 10 14:36:29.552951 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.552925    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:36:29.628750 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.628714    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mx4qx\" (UniqueName: \"kubernetes.io/projected/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-kube-api-access-mx4qx\") pod \"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47\" (UID: \"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47\") "
Sep 10 14:36:29.628923 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.628768    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-plugins-config-volume\") pod \"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47\" (UID: \"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47\") "
Sep 10 14:36:29.629131 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.629100    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47" (UID: "e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:36:29.631028 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.631009    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-kube-api-access-mx4qx" (OuterVolumeSpecName: "kube-api-access-mx4qx") pod "e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47" (UID: "e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47"). InnerVolumeSpecName "kube-api-access-mx4qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:36:29.729861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.729822    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mx4qx\" (UniqueName: \"kubernetes.io/projected/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-kube-api-access-mx4qx\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:29.729861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.729861    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:29.912668 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:29.912574    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49570f81-c33c-4d82-b343-125946a2e11b" path="/var/lib/kubelet/pods/49570f81-c33c-4d82-b343-125946a2e11b/volumes"
Sep 10 14:36:30.356709 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:30.356679    2579 generic.go:356] "Generic (PLEG): container finished" podID="e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47" containerID="b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56" exitCode=0
Sep 10 14:36:30.357260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:30.356726    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll" event={"ID":"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47","Type":"ContainerDied","Data":"b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56"}
Sep 10 14:36:30.357260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:30.356730    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"
Sep 10 14:36:30.357260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:30.356775    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll" event={"ID":"e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47","Type":"ContainerDied","Data":"1c68239e96c5e48394ecf1c267fc0001833a9da7a659bf890951f922b104d10f"}
Sep 10 14:36:30.357260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:30.356875    2579 scope.go:117] "RemoveContainer" containerID="b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56"
Sep 10 14:36:30.366134 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:30.366109    2579 scope.go:117] "RemoveContainer" containerID="b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56"
Sep 10 14:36:30.366461 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:36:30.366439    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56\": container with ID starting with b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56 not found: ID does not exist" containerID="b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56"
Sep 10 14:36:30.366553 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:30.366471    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56"} err="failed to get container status \"b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56\": rpc error: code = NotFound desc = could not find container \"b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56\": container with ID starting with b026dcb232559bdeb6b6a516ff5fd651293e9dc69037258b76e53e35c4f2ff56 not found: ID does not exist"
Sep 10 14:36:30.375113 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:30.375081    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"]
Sep 10 14:36:30.377046 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:30.377019    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-e25a5e89-8957d4cd9-plzll"]
Sep 10 14:36:31.913400 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:31.913353    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47" path="/var/lib/kubelet/pods/e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47/volumes"
Sep 10 14:36:33.158612 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.158577    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"]
Sep 10 14:36:33.159130 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.158898    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9" podUID="ee1a32d1-7b5b-4a14-a78a-819f62349a66" containerName="payload-processing" containerID="cri-o://a86772596bc768cbc13b7ba1a7efff7a04e8f56bef3be3f86467f31074fad03f" gracePeriod=30
Sep 10 14:36:33.167038 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.166984    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"]
Sep 10 14:36:33.167273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.167242    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd" podUID="0d151a93-e49e-4b3d-a416-987d1eb24af8" containerName="payload-pre-processing" containerID="cri-o://5edfd40b34a03a162355f9048df062e3514d80a77a37ad1f5513e00b4750c5f4" gracePeriod=30
Sep 10 14:36:33.306681 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.306611    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"]
Sep 10 14:36:33.309593 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.309539    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-600197-4zjss"]
Sep 10 14:36:33.377744 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.377707    2579 generic.go:356] "Generic (PLEG): container finished" podID="ee1a32d1-7b5b-4a14-a78a-819f62349a66" containerID="a86772596bc768cbc13b7ba1a7efff7a04e8f56bef3be3f86467f31074fad03f" exitCode=0
Sep 10 14:36:33.377905 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.377811    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9" event={"ID":"ee1a32d1-7b5b-4a14-a78a-819f62349a66","Type":"ContainerDied","Data":"a86772596bc768cbc13b7ba1a7efff7a04e8f56bef3be3f86467f31074fad03f"}
Sep 10 14:36:33.380245 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.380218    2579 generic.go:356] "Generic (PLEG): container finished" podID="0d151a93-e49e-4b3d-a416-987d1eb24af8" containerID="5edfd40b34a03a162355f9048df062e3514d80a77a37ad1f5513e00b4750c5f4" exitCode=0
Sep 10 14:36:33.380395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.380253    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd" event={"ID":"0d151a93-e49e-4b3d-a416-987d1eb24af8","Type":"ContainerDied","Data":"5edfd40b34a03a162355f9048df062e3514d80a77a37ad1f5513e00b4750c5f4"}
Sep 10 14:36:33.450289 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.450262    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:36:33.453384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.453361    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:36:33.571356 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.571323    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgqcm\" (UniqueName: \"kubernetes.io/projected/ee1a32d1-7b5b-4a14-a78a-819f62349a66-kube-api-access-dgqcm\") pod \"ee1a32d1-7b5b-4a14-a78a-819f62349a66\" (UID: \"ee1a32d1-7b5b-4a14-a78a-819f62349a66\") "
Sep 10 14:36:33.571532 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.571475    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd8lr\" (UniqueName: \"kubernetes.io/projected/0d151a93-e49e-4b3d-a416-987d1eb24af8-kube-api-access-zd8lr\") pod \"0d151a93-e49e-4b3d-a416-987d1eb24af8\" (UID: \"0d151a93-e49e-4b3d-a416-987d1eb24af8\") "
Sep 10 14:36:33.571532 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.571521    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d151a93-e49e-4b3d-a416-987d1eb24af8-plugins-config-volume\") pod \"0d151a93-e49e-4b3d-a416-987d1eb24af8\" (UID: \"0d151a93-e49e-4b3d-a416-987d1eb24af8\") "
Sep 10 14:36:33.571642 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.571550    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee1a32d1-7b5b-4a14-a78a-819f62349a66-plugins-config-volume\") pod \"ee1a32d1-7b5b-4a14-a78a-819f62349a66\" (UID: \"ee1a32d1-7b5b-4a14-a78a-819f62349a66\") "
Sep 10 14:36:33.571888 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.571859    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d151a93-e49e-4b3d-a416-987d1eb24af8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0d151a93-e49e-4b3d-a416-987d1eb24af8" (UID: "0d151a93-e49e-4b3d-a416-987d1eb24af8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:36:33.572013 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.571915    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee1a32d1-7b5b-4a14-a78a-819f62349a66-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ee1a32d1-7b5b-4a14-a78a-819f62349a66" (UID: "ee1a32d1-7b5b-4a14-a78a-819f62349a66"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:36:33.573695 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.573671    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee1a32d1-7b5b-4a14-a78a-819f62349a66-kube-api-access-dgqcm" (OuterVolumeSpecName: "kube-api-access-dgqcm") pod "ee1a32d1-7b5b-4a14-a78a-819f62349a66" (UID: "ee1a32d1-7b5b-4a14-a78a-819f62349a66"). InnerVolumeSpecName "kube-api-access-dgqcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:36:33.573695 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.573685    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d151a93-e49e-4b3d-a416-987d1eb24af8-kube-api-access-zd8lr" (OuterVolumeSpecName: "kube-api-access-zd8lr") pod "0d151a93-e49e-4b3d-a416-987d1eb24af8" (UID: "0d151a93-e49e-4b3d-a416-987d1eb24af8"). InnerVolumeSpecName "kube-api-access-zd8lr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:36:33.672705 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.672661    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd8lr\" (UniqueName: \"kubernetes.io/projected/0d151a93-e49e-4b3d-a416-987d1eb24af8-kube-api-access-zd8lr\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:33.672705 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.672696    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0d151a93-e49e-4b3d-a416-987d1eb24af8-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:33.672705 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.672705    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ee1a32d1-7b5b-4a14-a78a-819f62349a66-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:33.672705 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.672717    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgqcm\" (UniqueName: \"kubernetes.io/projected/ee1a32d1-7b5b-4a14-a78a-819f62349a66-kube-api-access-dgqcm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:33.912041 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:33.912010    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aba41315-caa4-499f-be17-f5fad9b57af4" path="/var/lib/kubelet/pods/aba41315-caa4-499f-be17-f5fad9b57af4/volumes"
Sep 10 14:36:34.387134 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:34.387110    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"
Sep 10 14:36:34.387609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:34.387145    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd" event={"ID":"0d151a93-e49e-4b3d-a416-987d1eb24af8","Type":"ContainerDied","Data":"cd176a309ad1029942bc63567fed07bb137cf9f2ef5a1a242541ebcbb70c04f1"}
Sep 10 14:36:34.387609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:34.387206    2579 scope.go:117] "RemoveContainer" containerID="5edfd40b34a03a162355f9048df062e3514d80a77a37ad1f5513e00b4750c5f4"
Sep 10 14:36:34.388701 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:34.388675    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"
Sep 10 14:36:34.388701 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:34.388683    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9" event={"ID":"ee1a32d1-7b5b-4a14-a78a-819f62349a66","Type":"ContainerDied","Data":"9c3cb87194dc940f245c92dddeb166013cf207871eb882c7d2c1d8bf0aa54b63"}
Sep 10 14:36:34.396501 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:34.396480    2579 scope.go:117] "RemoveContainer" containerID="a86772596bc768cbc13b7ba1a7efff7a04e8f56bef3be3f86467f31074fad03f"
Sep 10 14:36:34.420027 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:34.419994    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"]
Sep 10 14:36:34.432974 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:34.432948    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-600197-84567bdfb6-v7wqd"]
Sep 10 14:36:34.470187 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:34.470153    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"]
Sep 10 14:36:34.481213 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:34.481180    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-600197-6f99b5676c-bfjf9"]
Sep 10 14:36:35.912042 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:35.912007    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d151a93-e49e-4b3d-a416-987d1eb24af8" path="/var/lib/kubelet/pods/0d151a93-e49e-4b3d-a416-987d1eb24af8/volumes"
Sep 10 14:36:35.912412 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:35.912363    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee1a32d1-7b5b-4a14-a78a-819f62349a66" path="/var/lib/kubelet/pods/ee1a32d1-7b5b-4a14-a78a-819f62349a66/volumes"
Sep 10 14:36:39.721373 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:39.721331    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"]
Sep 10 14:36:39.721857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:39.721542    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy" containerID="cri-o://3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e" gracePeriod=30
Sep 10 14:36:40.080493 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.080455    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"]
Sep 10 14:36:40.080958 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.080931    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba41315-caa4-499f-be17-f5fad9b57af4" containerName="revoke-keys"
Sep 10 14:36:40.080958 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.080961    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba41315-caa4-499f-be17-f5fad9b57af4" containerName="revoke-keys"
Sep 10 14:36:40.081058 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.080985    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47" containerName="payload-processing"
Sep 10 14:36:40.081058 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.080990    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47" containerName="payload-processing"
Sep 10 14:36:40.081058 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.081006    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d151a93-e49e-4b3d-a416-987d1eb24af8" containerName="payload-pre-processing"
Sep 10 14:36:40.081058 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.081012    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d151a93-e49e-4b3d-a416-987d1eb24af8" containerName="payload-pre-processing"
Sep 10 14:36:40.081058 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.081018    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee1a32d1-7b5b-4a14-a78a-819f62349a66" containerName="payload-processing"
Sep 10 14:36:40.081058 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.081024    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee1a32d1-7b5b-4a14-a78a-819f62349a66" containerName="payload-processing"
Sep 10 14:36:40.081235 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.081083    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d151a93-e49e-4b3d-a416-987d1eb24af8" containerName="payload-pre-processing"
Sep 10 14:36:40.081235 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.081092    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba41315-caa4-499f-be17-f5fad9b57af4" containerName="revoke-keys"
Sep 10 14:36:40.081235 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.081098    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e066ab1d-f7fc-46a2-a8a0-4bbdc5b06d47" containerName="payload-processing"
Sep 10 14:36:40.081235 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.081104    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee1a32d1-7b5b-4a14-a78a-819f62349a66" containerName="payload-processing"
Sep 10 14:36:40.083178 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.083162    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"
Sep 10 14:36:40.085677 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.085655    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwr7b\""
Sep 10 14:36:40.090769 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.090741    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"]
Sep 10 14:36:40.132715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.132679    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/545b6be9-8f6d-47fe-a7b5-ef61da0badcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w\" (UID: \"545b6be9-8f6d-47fe-a7b5-ef61da0badcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"
Sep 10 14:36:40.234158 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.234112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/545b6be9-8f6d-47fe-a7b5-ef61da0badcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w\" (UID: \"545b6be9-8f6d-47fe-a7b5-ef61da0badcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"
Sep 10 14:36:40.234833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.234775    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/545b6be9-8f6d-47fe-a7b5-ef61da0badcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w\" (UID: \"545b6be9-8f6d-47fe-a7b5-ef61da0badcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"
Sep 10 14:36:40.395299 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.395209    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"
Sep 10 14:36:40.665609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:40.665584    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"]
Sep 10 14:36:40.667677 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:36:40.667653    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545b6be9_8f6d_47fe_a7b5_ef61da0badcb.slice/crio-561e94cb5b4d334c2532ebebb69291e252331c7cb48a7c95f14534c9ea6249e5 WatchSource:0}: Error finding container 561e94cb5b4d334c2532ebebb69291e252331c7cb48a7c95f14534c9ea6249e5: Status 404 returned error can't find the container with id 561e94cb5b4d334c2532ebebb69291e252331c7cb48a7c95f14534c9ea6249e5
Sep 10 14:36:41.430655 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:41.430619    2579 generic.go:356] "Generic (PLEG): container finished" podID="545b6be9-8f6d-47fe-a7b5-ef61da0badcb" containerID="580ee5cb11f402e22b94cb55d6704f9325c0788c0397cd8d36c5f99615d06e27" exitCode=0
Sep 10 14:36:41.431046 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:41.430664    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w" event={"ID":"545b6be9-8f6d-47fe-a7b5-ef61da0badcb","Type":"ContainerDied","Data":"580ee5cb11f402e22b94cb55d6704f9325c0788c0397cd8d36c5f99615d06e27"}
Sep 10 14:36:41.431046 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:41.430716    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w" event={"ID":"545b6be9-8f6d-47fe-a7b5-ef61da0badcb","Type":"ContainerStarted","Data":"561e94cb5b4d334c2532ebebb69291e252331c7cb48a7c95f14534c9ea6249e5"}
Sep 10 14:36:42.573536 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:42.573511    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"
Sep 10 14:36:42.659019 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:42.658982    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/545b6be9-8f6d-47fe-a7b5-ef61da0badcb-maas-api-service-ca\") pod \"545b6be9-8f6d-47fe-a7b5-ef61da0badcb\" (UID: \"545b6be9-8f6d-47fe-a7b5-ef61da0badcb\") "
Sep 10 14:36:42.659392 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:42.659364    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/545b6be9-8f6d-47fe-a7b5-ef61da0badcb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "545b6be9-8f6d-47fe-a7b5-ef61da0badcb" (UID: "545b6be9-8f6d-47fe-a7b5-ef61da0badcb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:36:42.760341 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:42.760308    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/545b6be9-8f6d-47fe-a7b5-ef61da0badcb-maas-api-service-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:43.442829 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:43.442771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w" event={"ID":"545b6be9-8f6d-47fe-a7b5-ef61da0badcb","Type":"ContainerDied","Data":"561e94cb5b4d334c2532ebebb69291e252331c7cb48a7c95f14534c9ea6249e5"}
Sep 10 14:36:43.443003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:43.442844    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="561e94cb5b4d334c2532ebebb69291e252331c7cb48a7c95f14534c9ea6249e5"
Sep 10 14:36:43.443003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:43.442800    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"
Sep 10 14:36:44.982995 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:44.982967    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:36:45.083942 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.083893    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-certs\") pod \"04a09c79-275a-403c-8b17-7500202fa5b8\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") "
Sep 10 14:36:45.084153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.083973    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-envoy\") pod \"04a09c79-275a-403c-8b17-7500202fa5b8\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") "
Sep 10 14:36:45.084153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084014    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-credential-socket\") pod \"04a09c79-275a-403c-8b17-7500202fa5b8\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") "
Sep 10 14:36:45.084153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-socket\") pod \"04a09c79-275a-403c-8b17-7500202fa5b8\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") "
Sep 10 14:36:45.084153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084097    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04a09c79-275a-403c-8b17-7500202fa5b8-istiod-ca-cert\") pod \"04a09c79-275a-403c-8b17-7500202fa5b8\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") "
Sep 10 14:36:45.084153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084128    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-istio-token\") pod \"04a09c79-275a-403c-8b17-7500202fa5b8\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") "
Sep 10 14:36:45.084428 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084158    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04a09c79-275a-403c-8b17-7500202fa5b8-istio-podinfo\") pod \"04a09c79-275a-403c-8b17-7500202fa5b8\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") "
Sep 10 14:36:45.084428 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084202    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-data\") pod \"04a09c79-275a-403c-8b17-7500202fa5b8\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") "
Sep 10 14:36:45.084428 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084237    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlzvr\" (UniqueName: \"kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-kube-api-access-dlzvr\") pod \"04a09c79-275a-403c-8b17-7500202fa5b8\" (UID: \"04a09c79-275a-403c-8b17-7500202fa5b8\") "
Sep 10 14:36:45.084428 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084246    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "04a09c79-275a-403c-8b17-7500202fa5b8" (UID: "04a09c79-275a-403c-8b17-7500202fa5b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:36:45.084428 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084367    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "04a09c79-275a-403c-8b17-7500202fa5b8" (UID: "04a09c79-275a-403c-8b17-7500202fa5b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:36:45.084688 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084529    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "04a09c79-275a-403c-8b17-7500202fa5b8" (UID: "04a09c79-275a-403c-8b17-7500202fa5b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:36:45.084688 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084576    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "04a09c79-275a-403c-8b17-7500202fa5b8" (UID: "04a09c79-275a-403c-8b17-7500202fa5b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:36:45.084688 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084656    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a09c79-275a-403c-8b17-7500202fa5b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "04a09c79-275a-403c-8b17-7500202fa5b8" (UID: "04a09c79-275a-403c-8b17-7500202fa5b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:36:45.084688 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084682    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:45.084901 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084701    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:45.084901 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084716    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:45.084901 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.084730    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:45.086539 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.086506    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/04a09c79-275a-403c-8b17-7500202fa5b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "04a09c79-275a-403c-8b17-7500202fa5b8" (UID: "04a09c79-275a-403c-8b17-7500202fa5b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:36:45.086716 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.086698    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "04a09c79-275a-403c-8b17-7500202fa5b8" (UID: "04a09c79-275a-403c-8b17-7500202fa5b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:36:45.086935 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.086917    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "04a09c79-275a-403c-8b17-7500202fa5b8" (UID: "04a09c79-275a-403c-8b17-7500202fa5b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:36:45.086935 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.086922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-kube-api-access-dlzvr" (OuterVolumeSpecName: "kube-api-access-dlzvr") pod "04a09c79-275a-403c-8b17-7500202fa5b8" (UID: "04a09c79-275a-403c-8b17-7500202fa5b8"). InnerVolumeSpecName "kube-api-access-dlzvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:36:45.185300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.185266    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:45.185300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.185293    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/04a09c79-275a-403c-8b17-7500202fa5b8-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:45.185300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.185302    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlzvr\" (UniqueName: \"kubernetes.io/projected/04a09c79-275a-403c-8b17-7500202fa5b8-kube-api-access-dlzvr\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:45.185300 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.185312    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/04a09c79-275a-403c-8b17-7500202fa5b8-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:45.185564 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.185320    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/04a09c79-275a-403c-8b17-7500202fa5b8-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:45.454946 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.454867    2579 generic.go:356] "Generic (PLEG): container finished" podID="04a09c79-275a-403c-8b17-7500202fa5b8" containerID="3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e" exitCode=0
Sep 10 14:36:45.454946 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.454925    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"
Sep 10 14:36:45.455158 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.454958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" event={"ID":"04a09c79-275a-403c-8b17-7500202fa5b8","Type":"ContainerDied","Data":"3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e"}
Sep 10 14:36:45.455158 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.455017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr" event={"ID":"04a09c79-275a-403c-8b17-7500202fa5b8","Type":"ContainerDied","Data":"96a42ba1a7a3cb002c754e263eef9cd399936be8283f5e8a036c6253c7856c2e"}
Sep 10 14:36:45.455158 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.455048    2579 scope.go:117] "RemoveContainer" containerID="3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e"
Sep 10 14:36:45.464427 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.464410    2579 scope.go:117] "RemoveContainer" containerID="a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26"
Sep 10 14:36:45.473184 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.473162    2579 scope.go:117] "RemoveContainer" containerID="3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e"
Sep 10 14:36:45.473480 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:36:45.473462    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e\": container with ID starting with 3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e not found: ID does not exist" containerID="3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e"
Sep 10 14:36:45.473559 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.473488    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e"} err="failed to get container status \"3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e\": rpc error: code = NotFound desc = could not find container \"3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e\": container with ID starting with 3ebc8ce82e7560d9b9fe4708018f09377cc1502b27f65f8b705aa88ce4495b5e not found: ID does not exist"
Sep 10 14:36:45.473559 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.473507    2579 scope.go:117] "RemoveContainer" containerID="a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26"
Sep 10 14:36:45.473774 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:36:45.473756    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26\": container with ID starting with a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26 not found: ID does not exist" containerID="a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26"
Sep 10 14:36:45.473896 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.473877    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26"} err="failed to get container status \"a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26\": rpc error: code = NotFound desc = could not find container \"a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26\": container with ID starting with a2cb7911284004589ef8e6d2ae2eade7839e87c059b8a9c17d96596d3d1fec26 not found: ID does not exist"
Sep 10 14:36:45.477257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.477228    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"]
Sep 10 14:36:45.486231 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.486208    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-600197-openshift-default-7574dcc9b4-gvrgr"]
Sep 10 14:36:45.912088 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:45.912055    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" path="/var/lib/kubelet/pods/04a09c79-275a-403c-8b17-7500202fa5b8/volumes"
Sep 10 14:36:49.451409 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.451269    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"]
Sep 10 14:36:49.451962 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.451932    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy"
Sep 10 14:36:49.451962 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.451959    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy"
Sep 10 14:36:49.452168 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.451986    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="545b6be9-8f6d-47fe-a7b5-ef61da0badcb" containerName="revoke-keys"
Sep 10 14:36:49.452168 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.451994    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="545b6be9-8f6d-47fe-a7b5-ef61da0badcb" containerName="revoke-keys"
Sep 10 14:36:49.452168 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.452061    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy"
Sep 10 14:36:49.452168 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.452078    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="545b6be9-8f6d-47fe-a7b5-ef61da0badcb" containerName="revoke-keys"
Sep 10 14:36:49.455210 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.455188    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.458079 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.458057    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-8ecc1f-openshift-default-dockercfg-whrxf\""
Sep 10 14:36:49.467425 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.467391    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"]
Sep 10 14:36:49.532668 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.532625    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-certs\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.532885 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.532683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-envoy\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.532885 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.532747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-credential-socket\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.532885 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.532799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-podinfo\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.532885 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.532822    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-token\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.532885 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.532862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-data\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.533070 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.532898    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-socket\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.533070 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.532966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkjx4\" (UniqueName: \"kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-kube-api-access-jkjx4\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.533070 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.533014    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istiod-ca-cert\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634014 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.633978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-credential-socket\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-podinfo\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634209    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-token\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-data\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-socket\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkjx4\" (UniqueName: \"kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-kube-api-access-jkjx4\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istiod-ca-cert\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-credential-socket\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634887 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-certs\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634887 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-envoy\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634887 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634565    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-socket\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634887 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-data\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.634887 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.634809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-certs\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.635315 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.635291    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istiod-ca-cert\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.636809 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.636756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-podinfo\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.636897 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.636765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-envoy\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.642352 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.642332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-token\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.642619 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.642598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkjx4\" (UniqueName: \"kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-kube-api-access-jkjx4\") pod \"e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") " pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:49.766881 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:49.766846    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:50.049220 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.049194    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"]
Sep 10 14:36:50.051296 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:36:50.051260    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5511fa0a_dac6_4871_9ea6_b4b36dc45888.slice/crio-784b58c2b6c6d38da36fa4546ff402d7d870d3e46c92a6bdb62e8b288c7fc9c4 WatchSource:0}: Error finding container 784b58c2b6c6d38da36fa4546ff402d7d870d3e46c92a6bdb62e8b288c7fc9c4: Status 404 returned error can't find the container with id 784b58c2b6c6d38da36fa4546ff402d7d870d3e46c92a6bdb62e8b288c7fc9c4
Sep 10 14:36:50.053577 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.053544    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:36:50.053663 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.053609    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:36:50.053663 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.053639    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:36:50.483763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.483667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" event={"ID":"5511fa0a-dac6-4871-9ea6-b4b36dc45888","Type":"ContainerStarted","Data":"002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d"}
Sep 10 14:36:50.483763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.483723    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" event={"ID":"5511fa0a-dac6-4871-9ea6-b4b36dc45888","Type":"ContainerStarted","Data":"784b58c2b6c6d38da36fa4546ff402d7d870d3e46c92a6bdb62e8b288c7fc9c4"}
Sep 10 14:36:50.505176 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.505122    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" podStartSLOduration=1.505104123 podStartE2EDuration="1.505104123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:50.504083028 +0000 UTC m=+1057.096287798" watchObservedRunningTime="2026-09-10 14:36:50.505104123 +0000 UTC m=+1057.097308891"
Sep 10 14:36:50.666312 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.666275    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"]
Sep 10 14:36:50.666518 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.666496    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs" podUID="5e4543cd-3d26-4d40-af64-ba4feb988830" containerName="payload-processing" containerID="cri-o://465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518" gracePeriod=30
Sep 10 14:36:50.677081 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.677051    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"]
Sep 10 14:36:50.677489 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.677458    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn" podUID="85f2fa43-e19c-4728-a7b7-026d3db0a648" containerName="payload-pre-processing" containerID="cri-o://7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618" gracePeriod=30
Sep 10 14:36:50.767623 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.767589    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:50.838427 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.838352    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"]
Sep 10 14:36:50.840606 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.840526    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ee208-npm7w"]
Sep 10 14:36:50.966868 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.966845    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:36:50.969858 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:50.969832    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:36:51.049447 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.049413    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f2fa43-e19c-4728-a7b7-026d3db0a648-plugins-config-volume\") pod \"85f2fa43-e19c-4728-a7b7-026d3db0a648\" (UID: \"85f2fa43-e19c-4728-a7b7-026d3db0a648\") "
Sep 10 14:36:51.049642 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.049460    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9lg2\" (UniqueName: \"kubernetes.io/projected/85f2fa43-e19c-4728-a7b7-026d3db0a648-kube-api-access-l9lg2\") pod \"85f2fa43-e19c-4728-a7b7-026d3db0a648\" (UID: \"85f2fa43-e19c-4728-a7b7-026d3db0a648\") "
Sep 10 14:36:51.049642 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.049559    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94npd\" (UniqueName: \"kubernetes.io/projected/5e4543cd-3d26-4d40-af64-ba4feb988830-kube-api-access-94npd\") pod \"5e4543cd-3d26-4d40-af64-ba4feb988830\" (UID: \"5e4543cd-3d26-4d40-af64-ba4feb988830\") "
Sep 10 14:36:51.049642 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.049586    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e4543cd-3d26-4d40-af64-ba4feb988830-plugins-config-volume\") pod \"5e4543cd-3d26-4d40-af64-ba4feb988830\" (UID: \"5e4543cd-3d26-4d40-af64-ba4feb988830\") "
Sep 10 14:36:51.049947 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.049919    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85f2fa43-e19c-4728-a7b7-026d3db0a648-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85f2fa43-e19c-4728-a7b7-026d3db0a648" (UID: "85f2fa43-e19c-4728-a7b7-026d3db0a648"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:36:51.050060 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.050038    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e4543cd-3d26-4d40-af64-ba4feb988830-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5e4543cd-3d26-4d40-af64-ba4feb988830" (UID: "5e4543cd-3d26-4d40-af64-ba4feb988830"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:36:51.051907 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.051883    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85f2fa43-e19c-4728-a7b7-026d3db0a648-kube-api-access-l9lg2" (OuterVolumeSpecName: "kube-api-access-l9lg2") pod "85f2fa43-e19c-4728-a7b7-026d3db0a648" (UID: "85f2fa43-e19c-4728-a7b7-026d3db0a648"). InnerVolumeSpecName "kube-api-access-l9lg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:36:51.051982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.051955    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e4543cd-3d26-4d40-af64-ba4feb988830-kube-api-access-94npd" (OuterVolumeSpecName: "kube-api-access-94npd") pod "5e4543cd-3d26-4d40-af64-ba4feb988830" (UID: "5e4543cd-3d26-4d40-af64-ba4feb988830"). InnerVolumeSpecName "kube-api-access-94npd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:36:51.151006 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.150961    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94npd\" (UniqueName: \"kubernetes.io/projected/5e4543cd-3d26-4d40-af64-ba4feb988830-kube-api-access-94npd\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:51.151006 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.150997    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e4543cd-3d26-4d40-af64-ba4feb988830-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:51.151006 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.151008    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f2fa43-e19c-4728-a7b7-026d3db0a648-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:51.151006 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.151016    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9lg2\" (UniqueName: \"kubernetes.io/projected/85f2fa43-e19c-4728-a7b7-026d3db0a648-kube-api-access-l9lg2\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:36:51.490155 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.490061    2579 generic.go:356] "Generic (PLEG): container finished" podID="5e4543cd-3d26-4d40-af64-ba4feb988830" containerID="465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518" exitCode=0
Sep 10 14:36:51.490155 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.490108    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"
Sep 10 14:36:51.490680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.490147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs" event={"ID":"5e4543cd-3d26-4d40-af64-ba4feb988830","Type":"ContainerDied","Data":"465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518"}
Sep 10 14:36:51.490680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.490205    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs" event={"ID":"5e4543cd-3d26-4d40-af64-ba4feb988830","Type":"ContainerDied","Data":"f18dfedae5264d845a5ef59dab046796b3e11e44ee2f4cfc390ffd8fc9e865a2"}
Sep 10 14:36:51.490680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.490236    2579 scope.go:117] "RemoveContainer" containerID="465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518"
Sep 10 14:36:51.491687 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.491659    2579 generic.go:356] "Generic (PLEG): container finished" podID="85f2fa43-e19c-4728-a7b7-026d3db0a648" containerID="7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618" exitCode=0
Sep 10 14:36:51.491759 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.491713    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"
Sep 10 14:36:51.491829 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.491754    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn" event={"ID":"85f2fa43-e19c-4728-a7b7-026d3db0a648","Type":"ContainerDied","Data":"7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618"}
Sep 10 14:36:51.491829 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.491820    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn" event={"ID":"85f2fa43-e19c-4728-a7b7-026d3db0a648","Type":"ContainerDied","Data":"a5d7962a70c273300928e8a387f83e2f8c2ce314dedb505f415e467432ccafd2"}
Sep 10 14:36:51.499636 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.499614    2579 scope.go:117] "RemoveContainer" containerID="465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518"
Sep 10 14:36:51.500045 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:36:51.500021    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518\": container with ID starting with 465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518 not found: ID does not exist" containerID="465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518"
Sep 10 14:36:51.500147 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.500057    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518"} err="failed to get container status \"465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518\": rpc error: code = NotFound desc = could not find container \"465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518\": container with ID starting with 465aa6459bba78f9f75768a714c7d8cd3533d283c1afe7e25ddd9afa69cc8518 not found: ID does not exist"
Sep 10 14:36:51.500147 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.500079    2579 scope.go:117] "RemoveContainer" containerID="7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618"
Sep 10 14:36:51.508698 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.508676    2579 scope.go:117] "RemoveContainer" containerID="7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618"
Sep 10 14:36:51.509005 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:36:51.508984    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618\": container with ID starting with 7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618 not found: ID does not exist" containerID="7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618"
Sep 10 14:36:51.509081 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.509016    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618"} err="failed to get container status \"7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618\": rpc error: code = NotFound desc = could not find container \"7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618\": container with ID starting with 7f79073053d906c617663f0cbd9a032634a500deb6c64674f41c608982eba618 not found: ID does not exist"
Sep 10 14:36:51.515886 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.515860    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"]
Sep 10 14:36:51.520429 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.520402    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-8ee208-556c8c4c9d-h6dhn"]
Sep 10 14:36:51.529632 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.529599    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"]
Sep 10 14:36:51.533641 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.533610    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-8ee208-575799d9c9-mbtcs"]
Sep 10 14:36:51.772657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.772626    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:51.917395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.917360    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="545b6be9-8f6d-47fe-a7b5-ef61da0badcb" path="/var/lib/kubelet/pods/545b6be9-8f6d-47fe-a7b5-ef61da0badcb/volumes"
Sep 10 14:36:51.917725 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.917712    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e4543cd-3d26-4d40-af64-ba4feb988830" path="/var/lib/kubelet/pods/5e4543cd-3d26-4d40-af64-ba4feb988830/volumes"
Sep 10 14:36:51.918050 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:51.918037    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85f2fa43-e19c-4728-a7b7-026d3db0a648" path="/var/lib/kubelet/pods/85f2fa43-e19c-4728-a7b7-026d3db0a648/volumes"
Sep 10 14:36:52.500512 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:52.500476    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:52.501509 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:52.501493    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:36:54.453016 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.452984    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"]
Sep 10 14:36:54.453618 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.453600    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85f2fa43-e19c-4728-a7b7-026d3db0a648" containerName="payload-pre-processing"
Sep 10 14:36:54.453681 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.453623    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85f2fa43-e19c-4728-a7b7-026d3db0a648" containerName="payload-pre-processing"
Sep 10 14:36:54.453681 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.453663    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e4543cd-3d26-4d40-af64-ba4feb988830" containerName="payload-processing"
Sep 10 14:36:54.453681 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.453675    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e4543cd-3d26-4d40-af64-ba4feb988830" containerName="payload-processing"
Sep 10 14:36:54.453772 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.453699    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy"
Sep 10 14:36:54.453772 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.453707    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy"
Sep 10 14:36:54.453907 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.453894    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a09c79-275a-403c-8b17-7500202fa5b8" containerName="istio-proxy"
Sep 10 14:36:54.453943 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.453912    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="85f2fa43-e19c-4728-a7b7-026d3db0a648" containerName="payload-pre-processing"
Sep 10 14:36:54.453943 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.453928    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e4543cd-3d26-4d40-af64-ba4feb988830" containerName="payload-processing"
Sep 10 14:36:54.457214 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.457194    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:36:54.459820 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.459766    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-8ecc1f\""
Sep 10 14:36:54.459953 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.459850    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-8ecc1f-dockercfg-h8d8m\""
Sep 10 14:36:54.467384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.467356    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"]
Sep 10 14:36:54.488332 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.488299    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"]
Sep 10 14:36:54.490703 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.490679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:36:54.502221 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.502194    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"]
Sep 10 14:36:54.587645 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.587611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czgjk\" (UniqueName: \"kubernetes.io/projected/76d0c4f8-a349-422e-921f-7256008a6eff-kube-api-access-czgjk\") pod \"payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb\" (UID: \"76d0c4f8-a349-422e-921f-7256008a6eff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:36:54.587878 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.587683    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf\" (UID: \"fac6aa3d-1bd5-45d7-890b-3a8c50b26549\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:36:54.587878 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.587709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5db47\" (UniqueName: \"kubernetes.io/projected/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-kube-api-access-5db47\") pod \"payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf\" (UID: \"fac6aa3d-1bd5-45d7-890b-3a8c50b26549\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:36:54.587878 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.587768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76d0c4f8-a349-422e-921f-7256008a6eff-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb\" (UID: \"76d0c4f8-a349-422e-921f-7256008a6eff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:36:54.689162 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.689125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czgjk\" (UniqueName: \"kubernetes.io/projected/76d0c4f8-a349-422e-921f-7256008a6eff-kube-api-access-czgjk\") pod \"payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb\" (UID: \"76d0c4f8-a349-422e-921f-7256008a6eff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:36:54.689352 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.689326    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf\" (UID: \"fac6aa3d-1bd5-45d7-890b-3a8c50b26549\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:36:54.689414 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.689369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5db47\" (UniqueName: \"kubernetes.io/projected/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-kube-api-access-5db47\") pod \"payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf\" (UID: \"fac6aa3d-1bd5-45d7-890b-3a8c50b26549\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:36:54.689534 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.689512    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76d0c4f8-a349-422e-921f-7256008a6eff-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb\" (UID: \"76d0c4f8-a349-422e-921f-7256008a6eff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:36:54.690257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.690231    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf\" (UID: \"fac6aa3d-1bd5-45d7-890b-3a8c50b26549\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:36:54.690344 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.690236    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76d0c4f8-a349-422e-921f-7256008a6eff-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb\" (UID: \"76d0c4f8-a349-422e-921f-7256008a6eff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:36:54.697527 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.697495    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czgjk\" (UniqueName: \"kubernetes.io/projected/76d0c4f8-a349-422e-921f-7256008a6eff-kube-api-access-czgjk\") pod \"payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb\" (UID: \"76d0c4f8-a349-422e-921f-7256008a6eff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:36:54.697638 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.697532    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5db47\" (UniqueName: \"kubernetes.io/projected/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-kube-api-access-5db47\") pod \"payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf\" (UID: \"fac6aa3d-1bd5-45d7-890b-3a8c50b26549\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:36:54.769159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.769122    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:36:54.801835 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:54.801801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:36:55.044597 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:55.044571    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"]
Sep 10 14:36:55.046902 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:36:55.046874    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d0c4f8_a349_422e_921f_7256008a6eff.slice/crio-e6299266172778221492881f3ee36761bb1d98140f73416a35266433028b0e70 WatchSource:0}: Error finding container e6299266172778221492881f3ee36761bb1d98140f73416a35266433028b0e70: Status 404 returned error can't find the container with id e6299266172778221492881f3ee36761bb1d98140f73416a35266433028b0e70
Sep 10 14:36:55.083322 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:55.083292    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"]
Sep 10 14:36:55.085816 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:36:55.085756    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac6aa3d_1bd5_45d7_890b_3a8c50b26549.slice/crio-5bbdc282642bc8f1325ef565be8c397564a62369b30914f3cda0c0097bc08503 WatchSource:0}: Error finding container 5bbdc282642bc8f1325ef565be8c397564a62369b30914f3cda0c0097bc08503: Status 404 returned error can't find the container with id 5bbdc282642bc8f1325ef565be8c397564a62369b30914f3cda0c0097bc08503
Sep 10 14:36:55.519875 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:55.519676    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf" event={"ID":"fac6aa3d-1bd5-45d7-890b-3a8c50b26549","Type":"ContainerStarted","Data":"fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a"}
Sep 10 14:36:55.519875 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:55.519773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf" event={"ID":"fac6aa3d-1bd5-45d7-890b-3a8c50b26549","Type":"ContainerStarted","Data":"5bbdc282642bc8f1325ef565be8c397564a62369b30914f3cda0c0097bc08503"}
Sep 10 14:36:55.520414 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:55.519970    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:36:55.529365 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:55.529334    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb" event={"ID":"76d0c4f8-a349-422e-921f-7256008a6eff","Type":"ContainerStarted","Data":"61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3"}
Sep 10 14:36:55.529551 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:55.529408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb" event={"ID":"76d0c4f8-a349-422e-921f-7256008a6eff","Type":"ContainerStarted","Data":"e6299266172778221492881f3ee36761bb1d98140f73416a35266433028b0e70"}
Sep 10 14:36:55.529551 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:55.529434    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:36:55.543185 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:55.543134    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf" podStartSLOduration=1.543119205 podStartE2EDuration="1.543119205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:55.541309037 +0000 UTC m=+1062.133513807" watchObservedRunningTime="2026-09-10 14:36:55.543119205 +0000 UTC m=+1062.135324014"
Sep 10 14:36:55.560572 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:55.560507    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb" podStartSLOduration=1.5604864809999999 podStartE2EDuration="1.560486481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:36:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:55.557442256 +0000 UTC m=+1062.149647026" watchObservedRunningTime="2026-09-10 14:36:55.560486481 +0000 UTC m=+1062.152691251"
Sep 10 14:36:58.323936 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.323900    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"]
Sep 10 14:36:58.326572 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.326552    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.329298 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.329269    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-7bf16f-openshift-default-dockercfg-gtkzk\""
Sep 10 14:36:58.340457 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.340419    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"]
Sep 10 14:36:58.425607 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.425570    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-token\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.425607 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.425617    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd4t2\" (UniqueName: \"kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-kube-api-access-fd4t2\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.425989 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.425661    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-data\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.425989 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.425711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-credential-socket\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.425989 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.425775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-podinfo\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.425989 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.425852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-certs\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.425989 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.425915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istiod-ca-cert\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.426200 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.425991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-socket\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.426200 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.426043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-envoy\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.527564 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.527517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-data\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.527564 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.527561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-credential-socket\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.527879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.527673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-podinfo\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.527879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.527714    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-certs\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.527879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.527773    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istiod-ca-cert\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.528050 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.527891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-socket\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.528050 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.527951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-envoy\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.528050 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.527993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-token\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.528050 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.528026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd4t2\" (UniqueName: \"kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-kube-api-access-fd4t2\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.528219 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.528070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-data\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.528219 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.528023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-credential-socket\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.528219 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.528098    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-certs\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.528476 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.528455    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-socket\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.528551 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.528488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istiod-ca-cert\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.530310 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.530287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-envoy\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.530560 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.530540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-podinfo\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.536359 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.536322    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-token\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.537014 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.536988    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd4t2\" (UniqueName: \"kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-kube-api-access-fd4t2\") pod \"e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") " pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.640260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.640175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:58.921243 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.921211    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"]
Sep 10 14:36:58.923031 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:36:58.923004    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fcf7760_0d7a_4c95_bfa9_53f9b30f7a7b.slice/crio-9717e9db5493b8e063c05f183ae6467599a62d48ee277a7d4ba7ede947c0a858 WatchSource:0}: Error finding container 9717e9db5493b8e063c05f183ae6467599a62d48ee277a7d4ba7ede947c0a858: Status 404 returned error can't find the container with id 9717e9db5493b8e063c05f183ae6467599a62d48ee277a7d4ba7ede947c0a858
Sep 10 14:36:58.925294 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.925261    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:36:58.925409 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.925332    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:36:58.925409 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:58.925361    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:36:59.553738 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:59.553705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" event={"ID":"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b","Type":"ContainerStarted","Data":"7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83"}
Sep 10 14:36:59.554151 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:59.553756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" event={"ID":"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b","Type":"ContainerStarted","Data":"9717e9db5493b8e063c05f183ae6467599a62d48ee277a7d4ba7ede947c0a858"}
Sep 10 14:36:59.576764 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:59.576707    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" podStartSLOduration=1.57668789 podStartE2EDuration="1.57668789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:36:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:36:59.573756126 +0000 UTC m=+1066.165960888" watchObservedRunningTime="2026-09-10 14:36:59.57668789 +0000 UTC m=+1066.168892659"
Sep 10 14:36:59.640390 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:59.640341    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:36:59.645929 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:36:59.645898    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:37:00.563062 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:00.563025    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:37:00.567292 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:00.567253    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:37:03.299860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.299821    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"]
Sep 10 14:37:03.303072 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.303055    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:37:03.305758 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.305731    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-7bf16f-dockercfg-8p5qp\""
Sep 10 14:37:03.305907 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.305768    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-7bf16f\""
Sep 10 14:37:03.315339 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.315308    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"]
Sep 10 14:37:03.387163 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.387121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d10cf3b6-4756-485e-803f-0b41a0faa671-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp\" (UID: \"d10cf3b6-4756-485e-803f-0b41a0faa671\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:37:03.387329 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.387240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv9l7\" (UniqueName: \"kubernetes.io/projected/d10cf3b6-4756-485e-803f-0b41a0faa671-kube-api-access-zv9l7\") pod \"payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp\" (UID: \"d10cf3b6-4756-485e-803f-0b41a0faa671\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:37:03.488846 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.488748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d10cf3b6-4756-485e-803f-0b41a0faa671-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp\" (UID: \"d10cf3b6-4756-485e-803f-0b41a0faa671\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:37:03.489055 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.488878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv9l7\" (UniqueName: \"kubernetes.io/projected/d10cf3b6-4756-485e-803f-0b41a0faa671-kube-api-access-zv9l7\") pod \"payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp\" (UID: \"d10cf3b6-4756-485e-803f-0b41a0faa671\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:37:03.489556 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.489527    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d10cf3b6-4756-485e-803f-0b41a0faa671-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp\" (UID: \"d10cf3b6-4756-485e-803f-0b41a0faa671\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:37:03.499732 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.499701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv9l7\" (UniqueName: \"kubernetes.io/projected/d10cf3b6-4756-485e-803f-0b41a0faa671-kube-api-access-zv9l7\") pod \"payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp\" (UID: \"d10cf3b6-4756-485e-803f-0b41a0faa671\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:37:03.615129 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.615029    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:37:03.924792 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:03.924748    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"]
Sep 10 14:37:03.926700 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:37:03.926668    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10cf3b6_4756_485e_803f_0b41a0faa671.slice/crio-2b1753ad2f93cabcfdda6e6e18e88ef92db4b8c40e62e855e4deacfefb0b4630 WatchSource:0}: Error finding container 2b1753ad2f93cabcfdda6e6e18e88ef92db4b8c40e62e855e4deacfefb0b4630: Status 404 returned error can't find the container with id 2b1753ad2f93cabcfdda6e6e18e88ef92db4b8c40e62e855e4deacfefb0b4630
Sep 10 14:37:04.593936 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:04.593899    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp" event={"ID":"d10cf3b6-4756-485e-803f-0b41a0faa671","Type":"ContainerStarted","Data":"655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011"}
Sep 10 14:37:04.594435 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:04.593960    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp" event={"ID":"d10cf3b6-4756-485e-803f-0b41a0faa671","Type":"ContainerStarted","Data":"2b1753ad2f93cabcfdda6e6e18e88ef92db4b8c40e62e855e4deacfefb0b4630"}
Sep 10 14:37:04.594435 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:04.594085    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:37:04.611044 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:04.610987    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp" podStartSLOduration=1.6109678010000001 podStartE2EDuration="1.610967801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:37:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:37:04.609637111 +0000 UTC m=+1071.201841892" watchObservedRunningTime="2026-09-10 14:37:04.610967801 +0000 UTC m=+1071.203172570"
Sep 10 14:37:06.537679 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:06.537648    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:37:06.538195 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:06.537870    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:37:08.543014 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:08.542966    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:37:08.543497 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:08.543053    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:37:09.628894 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:09.628859    2579 generic.go:356] "Generic (PLEG): container finished" podID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerID="002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d" exitCode=0
Sep 10 14:37:09.629332 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:09.628909    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" event={"ID":"5511fa0a-dac6-4871-9ea6-b4b36dc45888","Type":"ContainerDied","Data":"002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d"}
Sep 10 14:37:09.629332 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:09.629312    2579 scope.go:117] "RemoveContainer" containerID="002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d"
Sep 10 14:37:09.630453 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:09.630423    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:09.630526 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:09.630493    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:09.630571 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:09.630524    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:10.636461 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:10.636429    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" event={"ID":"5511fa0a-dac6-4871-9ea6-b4b36dc45888","Type":"ContainerStarted","Data":"6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e"}
Sep 10 14:37:10.768153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:10.768114    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:37:10.768800 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:10.768749    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 10 14:37:10.769017 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:10.768991    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 10 14:37:11.768191 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:11.768150    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 10 14:37:11.769270 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:11.769220    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 10 14:37:12.767609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:12.767569    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 10 14:37:12.767971 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:12.767923    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 10 14:37:13.767680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:13.767633    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 10 14:37:13.768193 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:13.767729    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 10 14:37:14.771685 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:14.771183    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 10 14:37:14.771685 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:14.771262    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 10 14:37:15.604211 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:15.604176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:37:15.767384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:15.767337    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 10 14:37:15.767699 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:15.767410    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 10 14:37:16.605010 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:16.604960    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:37:16.605467 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:16.605056    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:37:16.771736 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:16.771705    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:37:16.772147 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:16.772117    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:37:16.773036 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:16.773010    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:37:17.683595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:17.683497    2579 generic.go:356] "Generic (PLEG): container finished" podID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerID="7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83" exitCode=0
Sep 10 14:37:17.683595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:17.683580    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" event={"ID":"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b","Type":"ContainerDied","Data":"7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83"}
Sep 10 14:37:17.684114 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:17.684099    2579 scope.go:117] "RemoveContainer" containerID="7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83"
Sep 10 14:37:17.685170 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:17.685143    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:17.685266 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:17.685240    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:17.685330 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:17.685317    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:18.691083 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:18.691046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" event={"ID":"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b","Type":"ContainerStarted","Data":"b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4"}
Sep 10 14:37:19.640498 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:19.640457    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:37:19.640715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:19.640688    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 10 14:37:19.640821 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:19.640752    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 10 14:37:20.641167 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:20.641128    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 10 14:37:20.641557 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:20.641186    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 10 14:37:21.641221 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:21.641185    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 10 14:37:21.641634 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:21.641248    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 10 14:37:22.641042 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:22.641002    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 10 14:37:22.641225 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:22.641057    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 10 14:37:23.641264 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:23.641220    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 10 14:37:23.641661 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:23.641289    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 10 14:37:24.676266 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:24.676234    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:37:24.676643 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:24.676549    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:37:24.677346 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:24.677323    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:37:26.990054 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:26.990015    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"]
Sep 10 14:37:26.993840 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:26.993813    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:26.996497 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:26.996475    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-59dc59-openshift-default-dockercfg-pflcr\""
Sep 10 14:37:27.004479 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.004436    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"]
Sep 10 14:37:27.158136 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.158091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-socket\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.158350 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.158143    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-token\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.158350 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.158255    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/394d8fb4-8d73-4698-9795-70523b4c3ee0-istiod-ca-cert\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.158350 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.158317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-envoy\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.158535 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.158353    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-data\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.158535 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.158415    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-podinfo\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.158535 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.158502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6jxn\" (UniqueName: \"kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-kube-api-access-x6jxn\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.158674 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.158534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-certs\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.158674 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.158591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-credential-socket\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.259626 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.259594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/394d8fb4-8d73-4698-9795-70523b4c3ee0-istiod-ca-cert\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.259809 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.259645    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-envoy\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.259809 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.259694    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-data\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.259809 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.259720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-podinfo\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.259809 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.259795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6jxn\" (UniqueName: \"kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-kube-api-access-x6jxn\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.260023 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.259821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-certs\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.260023 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.259977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-credential-socket\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.260136 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.260084    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-socket\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.260136 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.260119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-token\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.260232 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.260204    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-certs\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.260381 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.260329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-credential-socket\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.260683 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.260446    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/394d8fb4-8d73-4698-9795-70523b4c3ee0-istiod-ca-cert\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.260683 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.260652    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-socket\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.260833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.260807    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-data\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.262257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.262234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-envoy\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.262501 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.262483    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-podinfo\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.273695 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.273670    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6jxn\" (UniqueName: \"kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-kube-api-access-x6jxn\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.274364 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.274345    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-token\") pod \"e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") " pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.306620 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.306579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:27.590851 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.590701    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"]
Sep 10 14:37:27.593888 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:37:27.593861    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod394d8fb4_8d73_4698_9795_70523b4c3ee0.slice/crio-bc36150deda5e48c12823fc633bf7583c034554a210435ea715e931207b2bd52 WatchSource:0}: Error finding container bc36150deda5e48c12823fc633bf7583c034554a210435ea715e931207b2bd52: Status 404 returned error can't find the container with id bc36150deda5e48c12823fc633bf7583c034554a210435ea715e931207b2bd52
Sep 10 14:37:27.596034 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.596005    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:27.596129 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.596069    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:27.596129 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.596097    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:27.744667 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.744627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" event={"ID":"394d8fb4-8d73-4698-9795-70523b4c3ee0","Type":"ContainerStarted","Data":"c2c2e0b3b6bb3c46d24a577071949f86ecdb26a8ab56f48ea20d5e676bd82a7a"}
Sep 10 14:37:27.744894 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.744699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" event={"ID":"394d8fb4-8d73-4698-9795-70523b4c3ee0","Type":"ContainerStarted","Data":"bc36150deda5e48c12823fc633bf7583c034554a210435ea715e931207b2bd52"}
Sep 10 14:37:27.766461 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:27.766388    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" podStartSLOduration=1.7663658249999998 podStartE2EDuration="1.766365825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:37:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:37:27.764325836 +0000 UTC m=+1094.356530627" watchObservedRunningTime="2026-09-10 14:37:27.766365825 +0000 UTC m=+1094.358570595"
Sep 10 14:37:28.306930 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:28.306897    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:28.312248 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:28.312219    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:28.750855 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:28.750833    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:28.752004 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:28.751987    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:31.481072 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:31.481037    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"]
Sep 10 14:37:31.483661 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:31.483645    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:37:31.486261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:31.486241    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-59dc59\""
Sep 10 14:37:31.495932 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:31.495903    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"]
Sep 10 14:37:31.501420 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:31.501386    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6de9741-867e-4e71-83d1-4c3f90d79894-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx\" (UID: \"e6de9741-867e-4e71-83d1-4c3f90d79894\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:37:31.501584 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:31.501564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s62st\" (UniqueName: \"kubernetes.io/projected/e6de9741-867e-4e71-83d1-4c3f90d79894-kube-api-access-s62st\") pod \"payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx\" (UID: \"e6de9741-867e-4e71-83d1-4c3f90d79894\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:37:31.602297 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:31.602255    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6de9741-867e-4e71-83d1-4c3f90d79894-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx\" (UID: \"e6de9741-867e-4e71-83d1-4c3f90d79894\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:37:31.602495 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:31.602406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s62st\" (UniqueName: \"kubernetes.io/projected/e6de9741-867e-4e71-83d1-4c3f90d79894-kube-api-access-s62st\") pod \"payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx\" (UID: \"e6de9741-867e-4e71-83d1-4c3f90d79894\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:37:31.603182 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:31.603150    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6de9741-867e-4e71-83d1-4c3f90d79894-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx\" (UID: \"e6de9741-867e-4e71-83d1-4c3f90d79894\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:37:31.611107 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:31.611072    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s62st\" (UniqueName: \"kubernetes.io/projected/e6de9741-867e-4e71-83d1-4c3f90d79894-kube-api-access-s62st\") pod \"payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx\" (UID: \"e6de9741-867e-4e71-83d1-4c3f90d79894\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:37:31.795912 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:31.795876    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:37:32.071753 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:32.071724    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"]
Sep 10 14:37:32.073426 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:37:32.073399    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6de9741_867e_4e71_83d1_4c3f90d79894.slice/crio-b372abfbd172d32e272e48418bd5e4d59deeafbf8aab59e03271bc33ddc444e9 WatchSource:0}: Error finding container b372abfbd172d32e272e48418bd5e4d59deeafbf8aab59e03271bc33ddc444e9: Status 404 returned error can't find the container with id b372abfbd172d32e272e48418bd5e4d59deeafbf8aab59e03271bc33ddc444e9
Sep 10 14:37:32.773185 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:32.773148    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx" event={"ID":"e6de9741-867e-4e71-83d1-4c3f90d79894","Type":"ContainerStarted","Data":"81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c"}
Sep 10 14:37:32.773599 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:32.773205    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx" event={"ID":"e6de9741-867e-4e71-83d1-4c3f90d79894","Type":"ContainerStarted","Data":"b372abfbd172d32e272e48418bd5e4d59deeafbf8aab59e03271bc33ddc444e9"}
Sep 10 14:37:32.773599 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:32.773232    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:37:32.790022 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:32.789963    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx" podStartSLOduration=1.789945308 podStartE2EDuration="1.789945308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:37:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:37:32.788596081 +0000 UTC m=+1099.380800851" watchObservedRunningTime="2026-09-10 14:37:32.789945308 +0000 UTC m=+1099.382150077"
Sep 10 14:37:43.783085 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:43.783054    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:37:47.864896 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:47.864816    2579 generic.go:356] "Generic (PLEG): container finished" podID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerID="c2c2e0b3b6bb3c46d24a577071949f86ecdb26a8ab56f48ea20d5e676bd82a7a" exitCode=0
Sep 10 14:37:47.865303 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:47.864899    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" event={"ID":"394d8fb4-8d73-4698-9795-70523b4c3ee0","Type":"ContainerDied","Data":"c2c2e0b3b6bb3c46d24a577071949f86ecdb26a8ab56f48ea20d5e676bd82a7a"}
Sep 10 14:37:47.865366 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:47.865350    2579 scope.go:117] "RemoveContainer" containerID="c2c2e0b3b6bb3c46d24a577071949f86ecdb26a8ab56f48ea20d5e676bd82a7a"
Sep 10 14:37:47.866702 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:47.866669    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:47.866849 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:47.866757    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:47.866849 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:47.866838    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:48.880443 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:48.880404    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" event={"ID":"394d8fb4-8d73-4698-9795-70523b4c3ee0","Type":"ContainerStarted","Data":"4b4a60144ec1e9418e05760514297f03a7426ef017e79123ece89823911867be"}
Sep 10 14:37:49.307394 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:49.307351    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:49.307655 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:49.307630    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 10 14:37:49.307714 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:49.307695    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 10 14:37:50.307492 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:50.307457    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 10 14:37:50.307905 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:50.307512    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 10 14:37:51.307808 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:51.307733    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 10 14:37:51.308206 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:51.307831    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 10 14:37:52.307157 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:52.307120    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 10 14:37:52.307370 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:52.307203    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 10 14:37:53.307927 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:53.307891    2579 patch_prober.go:28] interesting pod/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 10 14:37:53.308315 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:53.307947    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 10 14:37:54.312819 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:54.312275    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:54.318475 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:54.313961    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:54.319920 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:54.319891    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:37:55.677186 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.677156    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"]
Sep 10 14:37:55.679824 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.679804    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.682596 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.682572    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-25792506-openshift-default-dockercfg-vmvlm\""
Sep 10 14:37:55.693597 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.693570    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"]
Sep 10 14:37:55.744849 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.744775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-podinfo\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.745031 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.744889    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-envoy\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.745031 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.744930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-credential-socket\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.745031 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.744964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-token\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.745031 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.744995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-socket\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.745031 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.745029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kbsb\" (UniqueName: \"kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-kube-api-access-4kbsb\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.745244 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.745051    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-data\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.745244 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.745100    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-certs\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.745244 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.745136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istiod-ca-cert\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.845809 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.845733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-credential-socket\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.845992 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.845842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-token\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.845992 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.845876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-socket\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.846074 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.846032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kbsb\" (UniqueName: \"kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-kube-api-access-4kbsb\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.846120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.846094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-data\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.846159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.846135    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-certs\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.846213 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.846198    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-socket\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.846274 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.846219    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-credential-socket\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.846274 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.846239    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istiod-ca-cert\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.846367 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.846297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-podinfo\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.846425 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.846370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-envoy\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.846504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.846482    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-certs\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.846572 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.846541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-data\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.846847 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.846828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istiod-ca-cert\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.848819 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.848798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-envoy\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.848966 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.848948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-podinfo\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.854586 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.854556    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-token\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.854738 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.854719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kbsb\" (UniqueName: \"kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-kube-api-access-4kbsb\") pod \"e2e-mt-25792506-openshift-default-564b5b8588-65lvx\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") " pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:55.991585 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:55.991493    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:56.268639 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:56.268613    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"]
Sep 10 14:37:56.270263 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:37:56.270230    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a39a6b_9075_4470_b6d2_bcc0098c89d1.slice/crio-056e8d8d4379b4c349c2b18577d8e287d82edb9d785cf0c3a8f805ba55bfdea8 WatchSource:0}: Error finding container 056e8d8d4379b4c349c2b18577d8e287d82edb9d785cf0c3a8f805ba55bfdea8: Status 404 returned error can't find the container with id 056e8d8d4379b4c349c2b18577d8e287d82edb9d785cf0c3a8f805ba55bfdea8
Sep 10 14:37:56.272673 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:56.272629    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:56.272758 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:56.272730    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:56.272857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:56.272803    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:37:56.933524 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:56.933486    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" event={"ID":"b6a39a6b-9075-4470-b6d2-bcc0098c89d1","Type":"ContainerStarted","Data":"873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b"}
Sep 10 14:37:56.933930 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:56.933548    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" event={"ID":"b6a39a6b-9075-4470-b6d2-bcc0098c89d1","Type":"ContainerStarted","Data":"056e8d8d4379b4c349c2b18577d8e287d82edb9d785cf0c3a8f805ba55bfdea8"}
Sep 10 14:37:56.955458 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:56.955404    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" podStartSLOduration=1.955387683 podStartE2EDuration="1.955387683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:37:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:37:56.952483521 +0000 UTC m=+1123.544688291" watchObservedRunningTime="2026-09-10 14:37:56.955387683 +0000 UTC m=+1123.547592453"
Sep 10 14:37:56.992229 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:56.992194    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:57.998184 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:57.998152    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:58.944180 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:58.944148    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:37:58.945186 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:37:58.945165    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:38:00.520797 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.520751    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"]
Sep 10 14:38:00.523424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.523405    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:38:00.526137 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.526114    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-25792506-dockercfg-p5q4m\""
Sep 10 14:38:00.526267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.526113    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-25792506\""
Sep 10 14:38:00.535265 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.535236    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"]
Sep 10 14:38:00.594295 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.594253    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0230a127-f884-444b-8c8c-e71137bcf136-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h\" (UID: \"0230a127-f884-444b-8c8c-e71137bcf136\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:38:00.594476 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.594309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s47pm\" (UniqueName: \"kubernetes.io/projected/0230a127-f884-444b-8c8c-e71137bcf136-kube-api-access-s47pm\") pod \"payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h\" (UID: \"0230a127-f884-444b-8c8c-e71137bcf136\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:38:00.695078 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.695034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0230a127-f884-444b-8c8c-e71137bcf136-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h\" (UID: \"0230a127-f884-444b-8c8c-e71137bcf136\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:38:00.695252 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.695090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s47pm\" (UniqueName: \"kubernetes.io/projected/0230a127-f884-444b-8c8c-e71137bcf136-kube-api-access-s47pm\") pod \"payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h\" (UID: \"0230a127-f884-444b-8c8c-e71137bcf136\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:38:00.695739 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.695716    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0230a127-f884-444b-8c8c-e71137bcf136-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h\" (UID: \"0230a127-f884-444b-8c8c-e71137bcf136\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:38:00.704525 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.704486    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s47pm\" (UniqueName: \"kubernetes.io/projected/0230a127-f884-444b-8c8c-e71137bcf136-kube-api-access-s47pm\") pod \"payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h\" (UID: \"0230a127-f884-444b-8c8c-e71137bcf136\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:38:00.836583 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:00.836486    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:38:01.107866 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:01.107843    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"]
Sep 10 14:38:01.109674 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:38:01.109648    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0230a127_f884_444b_8c8c_e71137bcf136.slice/crio-318e409106b890e69539d27dddb144bfed9689a6fe9222a3595beaa0f551ed52 WatchSource:0}: Error finding container 318e409106b890e69539d27dddb144bfed9689a6fe9222a3595beaa0f551ed52: Status 404 returned error can't find the container with id 318e409106b890e69539d27dddb144bfed9689a6fe9222a3595beaa0f551ed52
Sep 10 14:38:01.964328 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:01.964275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h" event={"ID":"0230a127-f884-444b-8c8c-e71137bcf136","Type":"ContainerStarted","Data":"8dad2341b7d721e277c4fc1d6c356729774401a6a4514f8e3abde23d3c06c2f8"}
Sep 10 14:38:01.964748 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:01.964342    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h" event={"ID":"0230a127-f884-444b-8c8c-e71137bcf136","Type":"ContainerStarted","Data":"318e409106b890e69539d27dddb144bfed9689a6fe9222a3595beaa0f551ed52"}
Sep 10 14:38:01.964748 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:01.964395    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:38:01.981535 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:01.981480    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h" podStartSLOduration=1.981463089 podStartE2EDuration="1.981463089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:38:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:38:01.980651158 +0000 UTC m=+1128.572855928" watchObservedRunningTime="2026-09-10 14:38:01.981463089 +0000 UTC m=+1128.573667857"
Sep 10 14:38:12.975708 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:12.975675    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:38:17.784548 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:38:17.784508    2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@8-21422-0.service\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a39a6b_9075_4470_b6d2_bcc0098c89d1.slice/crio-conmon-873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 14:38:18.065857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:18.065825    2579 generic.go:356] "Generic (PLEG): container finished" podID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerID="873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b" exitCode=0
Sep 10 14:38:18.066037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:18.065906    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" event={"ID":"b6a39a6b-9075-4470-b6d2-bcc0098c89d1","Type":"ContainerDied","Data":"873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b"}
Sep 10 14:38:18.066487 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:18.066463    2579 scope.go:117] "RemoveContainer" containerID="873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b"
Sep 10 14:38:18.067812 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:18.067759    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:38:18.067889 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:18.067856    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:38:18.067971 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:18.067888    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:38:19.078578 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:19.078534    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" event={"ID":"b6a39a6b-9075-4470-b6d2-bcc0098c89d1","Type":"ContainerStarted","Data":"1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5"}
Sep 10 14:38:19.992164 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:19.992118    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:38:19.992395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:19.992374    2579 patch_prober.go:28] interesting pod/e2e-mt-25792506-openshift-default-564b5b8588-65lvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 14:38:19.992482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:19.992435    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 14:38:20.992898 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:20.992861    2579 patch_prober.go:28] interesting pod/e2e-mt-25792506-openshift-default-564b5b8588-65lvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 14:38:20.993290 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:20.992921    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 14:38:21.992183 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:21.992147    2579 patch_prober.go:28] interesting pod/e2e-mt-25792506-openshift-default-564b5b8588-65lvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 14:38:21.992366 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:21.992208    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 14:38:22.992563 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:22.992523    2579 patch_prober.go:28] interesting pod/e2e-mt-25792506-openshift-default-564b5b8588-65lvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 14:38:22.992983 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:22.992592    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 14:38:23.992050 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:23.992009    2579 patch_prober.go:28] interesting pod/e2e-mt-25792506-openshift-default-564b5b8588-65lvx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 10 14:38:23.992234 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:23.992075    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 10 14:38:24.996889 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:24.996856    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:38:24.997398 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:24.997375    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:38:24.998226 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:38:24.998205    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:39:13.955021 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:13.954990    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:39:13.955562 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:13.954994    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:39:13.961561 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:13.961540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:39:13.961707 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:13.961540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:39:44.434772 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:44.434734    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"]
Sep 10 14:39:44.435313 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:44.434980    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h" podUID="0230a127-f884-444b-8c8c-e71137bcf136" containerName="payload-pre-processing" containerID="cri-o://8dad2341b7d721e277c4fc1d6c356729774401a6a4514f8e3abde23d3c06c2f8" gracePeriod=30
Sep 10 14:39:44.559460 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:44.559427    2579 generic.go:356] "Generic (PLEG): container finished" podID="0230a127-f884-444b-8c8c-e71137bcf136" containerID="8dad2341b7d721e277c4fc1d6c356729774401a6a4514f8e3abde23d3c06c2f8" exitCode=0
Sep 10 14:39:44.559631 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:44.559475    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h" event={"ID":"0230a127-f884-444b-8c8c-e71137bcf136","Type":"ContainerDied","Data":"8dad2341b7d721e277c4fc1d6c356729774401a6a4514f8e3abde23d3c06c2f8"}
Sep 10 14:39:44.700375 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:44.700315    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:39:44.759203 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:44.759168    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0230a127-f884-444b-8c8c-e71137bcf136-plugins-config-volume\") pod \"0230a127-f884-444b-8c8c-e71137bcf136\" (UID: \"0230a127-f884-444b-8c8c-e71137bcf136\") "
Sep 10 14:39:44.759203 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:44.759211    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s47pm\" (UniqueName: \"kubernetes.io/projected/0230a127-f884-444b-8c8c-e71137bcf136-kube-api-access-s47pm\") pod \"0230a127-f884-444b-8c8c-e71137bcf136\" (UID: \"0230a127-f884-444b-8c8c-e71137bcf136\") "
Sep 10 14:39:44.759550 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:44.759512    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0230a127-f884-444b-8c8c-e71137bcf136-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0230a127-f884-444b-8c8c-e71137bcf136" (UID: "0230a127-f884-444b-8c8c-e71137bcf136"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:39:44.761745 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:44.761721    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0230a127-f884-444b-8c8c-e71137bcf136-kube-api-access-s47pm" (OuterVolumeSpecName: "kube-api-access-s47pm") pod "0230a127-f884-444b-8c8c-e71137bcf136" (UID: "0230a127-f884-444b-8c8c-e71137bcf136"). InnerVolumeSpecName "kube-api-access-s47pm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:39:44.860208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:44.860164    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0230a127-f884-444b-8c8c-e71137bcf136-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:39:44.860208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:44.860199    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s47pm\" (UniqueName: \"kubernetes.io/projected/0230a127-f884-444b-8c8c-e71137bcf136-kube-api-access-s47pm\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:39:45.566367 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:45.566324    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h" event={"ID":"0230a127-f884-444b-8c8c-e71137bcf136","Type":"ContainerDied","Data":"318e409106b890e69539d27dddb144bfed9689a6fe9222a3595beaa0f551ed52"}
Sep 10 14:39:45.566852 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:45.566371    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"
Sep 10 14:39:45.566852 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:45.566435    2579 scope.go:117] "RemoveContainer" containerID="8dad2341b7d721e277c4fc1d6c356729774401a6a4514f8e3abde23d3c06c2f8"
Sep 10 14:39:45.589795 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:45.589754    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"]
Sep 10 14:39:45.593841 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:45.593808    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-25792506-b84c5b58-g674h"]
Sep 10 14:39:45.913193 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:39:45.913110    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0230a127-f884-444b-8c8c-e71137bcf136" path="/var/lib/kubelet/pods/0230a127-f884-444b-8c8c-e71137bcf136/volumes"
Sep 10 14:40:14.065671 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:14.065579    2579 scope.go:117] "RemoveContainer" containerID="ab0233a4f4ec198aedf8e5704d2b325b25026964b4ef9e87b99ebf339bf2a1d4"
Sep 10 14:40:36.454060 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:36.454021    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"]
Sep 10 14:40:36.454645 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:36.454298    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy" containerID="cri-o://1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5" gracePeriod=30
Sep 10 14:40:40.000453 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:40.000402    2579 patch_prober.go:28] interesting pod/e2e-mt-25792506-openshift-default-564b5b8588-65lvx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:40:40.000873 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:40.000465    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:40:41.711010 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.710983    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:40:41.848263 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848223    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istiod-ca-cert\") pod \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") "
Sep 10 14:40:41.848455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848276    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-credential-socket\") pod \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") "
Sep 10 14:40:41.848455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848295    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-data\") pod \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") "
Sep 10 14:40:41.848455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848319    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kbsb\" (UniqueName: \"kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-kube-api-access-4kbsb\") pod \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") "
Sep 10 14:40:41.848455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848343    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-envoy\") pod \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") "
Sep 10 14:40:41.848455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848369    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-socket\") pod \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") "
Sep 10 14:40:41.848455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848392    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-podinfo\") pod \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") "
Sep 10 14:40:41.848455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848440    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-token\") pod \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") "
Sep 10 14:40:41.848836 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848547    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-certs\") pod \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\" (UID: \"b6a39a6b-9075-4470-b6d2-bcc0098c89d1\") "
Sep 10 14:40:41.848836 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848649    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "b6a39a6b-9075-4470-b6d2-bcc0098c89d1" (UID: "b6a39a6b-9075-4470-b6d2-bcc0098c89d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:40:41.848836 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848682    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b6a39a6b-9075-4470-b6d2-bcc0098c89d1" (UID: "b6a39a6b-9075-4470-b6d2-bcc0098c89d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:40:41.849000 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848862    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b6a39a6b-9075-4470-b6d2-bcc0098c89d1" (UID: "b6a39a6b-9075-4470-b6d2-bcc0098c89d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:40:41.849000 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848923    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b6a39a6b-9075-4470-b6d2-bcc0098c89d1" (UID: "b6a39a6b-9075-4470-b6d2-bcc0098c89d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:40:41.849000 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.848883    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b6a39a6b-9075-4470-b6d2-bcc0098c89d1" (UID: "b6a39a6b-9075-4470-b6d2-bcc0098c89d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:40:41.849121 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.849086    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:40:41.849121 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.849105    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:40:41.849121 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.849117    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:40:41.849254 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.849126    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:40:41.849254 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.849135    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:40:41.851023 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.850991    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b6a39a6b-9075-4470-b6d2-bcc0098c89d1" (UID: "b6a39a6b-9075-4470-b6d2-bcc0098c89d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:40:41.851023 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.851008    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-kube-api-access-4kbsb" (OuterVolumeSpecName: "kube-api-access-4kbsb") pod "b6a39a6b-9075-4470-b6d2-bcc0098c89d1" (UID: "b6a39a6b-9075-4470-b6d2-bcc0098c89d1"). InnerVolumeSpecName "kube-api-access-4kbsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:40:41.851023 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.851015    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "b6a39a6b-9075-4470-b6d2-bcc0098c89d1" (UID: "b6a39a6b-9075-4470-b6d2-bcc0098c89d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:40:41.851201 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.851179    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b6a39a6b-9075-4470-b6d2-bcc0098c89d1" (UID: "b6a39a6b-9075-4470-b6d2-bcc0098c89d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:40:41.888176 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.888140    2579 generic.go:356] "Generic (PLEG): container finished" podID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerID="1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5" exitCode=0
Sep 10 14:40:41.888327 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.888196    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"
Sep 10 14:40:41.888327 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.888219    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" event={"ID":"b6a39a6b-9075-4470-b6d2-bcc0098c89d1","Type":"ContainerDied","Data":"1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5"}
Sep 10 14:40:41.888327 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.888278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx" event={"ID":"b6a39a6b-9075-4470-b6d2-bcc0098c89d1","Type":"ContainerDied","Data":"056e8d8d4379b4c349c2b18577d8e287d82edb9d785cf0c3a8f805ba55bfdea8"}
Sep 10 14:40:41.888327 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.888300    2579 scope.go:117] "RemoveContainer" containerID="1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5"
Sep 10 14:40:41.898452 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.898434    2579 scope.go:117] "RemoveContainer" containerID="873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b"
Sep 10 14:40:41.907371 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.907352    2579 scope.go:117] "RemoveContainer" containerID="1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5"
Sep 10 14:40:41.907715 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:40:41.907694    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5\": container with ID starting with 1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5 not found: ID does not exist" containerID="1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5"
Sep 10 14:40:41.907805 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.907727    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5"} err="failed to get container status \"1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5\": rpc error: code = NotFound desc = could not find container \"1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5\": container with ID starting with 1bf710017fd54960008284b1b63517688b4d66ae82a7f36f3e33599c8bd41cd5 not found: ID does not exist"
Sep 10 14:40:41.907805 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.907755    2579 scope.go:117] "RemoveContainer" containerID="873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b"
Sep 10 14:40:41.908096 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:40:41.908047    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b\": container with ID starting with 873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b not found: ID does not exist" containerID="873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b"
Sep 10 14:40:41.908096 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.908071    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b"} err="failed to get container status \"873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b\": rpc error: code = NotFound desc = could not find container \"873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b\": container with ID starting with 873697d53011e5882f2fd85458a1e40516163f91920d4776db5334038887331b not found: ID does not exist"
Sep 10 14:40:41.914377 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.914350    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"]
Sep 10 14:40:41.915720 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.915702    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-25792506-openshift-default-564b5b8588-65lvx"]
Sep 10 14:40:41.950582 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.950551    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kbsb\" (UniqueName: \"kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-kube-api-access-4kbsb\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:40:41.950582 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.950581    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:40:41.950806 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.950595    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:40:41.950806 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:41.950606    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a39a6b-9075-4470-b6d2-bcc0098c89d1-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:40:43.913642 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:40:43.913607    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" path="/var/lib/kubelet/pods/b6a39a6b-9075-4470-b6d2-bcc0098c89d1/volumes"
Sep 10 14:41:31.135800 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.135746    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"]
Sep 10 14:41:31.136249 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.136232    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0230a127-f884-444b-8c8c-e71137bcf136" containerName="payload-pre-processing"
Sep 10 14:41:31.136293 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.136251    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0230a127-f884-444b-8c8c-e71137bcf136" containerName="payload-pre-processing"
Sep 10 14:41:31.136293 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.136278    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy"
Sep 10 14:41:31.136293 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.136284    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy"
Sep 10 14:41:31.136293 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.136293    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy"
Sep 10 14:41:31.136419 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.136299    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy"
Sep 10 14:41:31.136419 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.136379    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0230a127-f884-444b-8c8c-e71137bcf136" containerName="payload-pre-processing"
Sep 10 14:41:31.136419 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.136391    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy"
Sep 10 14:41:31.136419 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.136397    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a39a6b-9075-4470-b6d2-bcc0098c89d1" containerName="istio-proxy"
Sep 10 14:41:31.138980 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.138957    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.143187 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.142157    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1d2af2-openshift-default-dockercfg-7px28\""
Sep 10 14:41:31.155120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.154737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"]
Sep 10 14:41:31.240851 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.240815    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-data\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.241052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.240883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istiod-ca-cert\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.241052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.240946    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-envoy\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.241052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.240977    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lzbl\" (UniqueName: \"kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-kube-api-access-7lzbl\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.241052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.241005    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-socket\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.241052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.241030    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-certs\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.241338 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.241061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-credential-socket\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.241338 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.241097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-token\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.241338 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.241138    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-podinfo\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.341974 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.341935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istiod-ca-cert\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.342159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.341994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-envoy\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.342159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lzbl\" (UniqueName: \"kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-kube-api-access-7lzbl\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.342159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-socket\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.342159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-certs\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.342159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342069    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-credential-socket\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.342159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-token\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.342159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-podinfo\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.342438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-data\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.342678 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istiod-ca-cert\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.342837 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342732    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-certs\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.342837 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342755    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-credential-socket\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.343143 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342868    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-socket\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.343143 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.342891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-data\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.344760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.344739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-envoy\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.344963 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.344945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-podinfo\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.350044 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.350023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-token\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.350160 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.350143    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lzbl\" (UniqueName: \"kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-kube-api-access-7lzbl\") pod \"e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") " pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.459249 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.459161    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:31.738150 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.738122    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"]
Sep 10 14:41:31.740017 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:41:31.739989    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a247369_4e1c_42c1_99b2_480f65fa9b6c.slice/crio-ea392a0ffbc8ebf1c08b81e8fbb6e14bc23fd16e283ca9e47c21e7f6e3fceefb WatchSource:0}: Error finding container ea392a0ffbc8ebf1c08b81e8fbb6e14bc23fd16e283ca9e47c21e7f6e3fceefb: Status 404 returned error can't find the container with id ea392a0ffbc8ebf1c08b81e8fbb6e14bc23fd16e283ca9e47c21e7f6e3fceefb
Sep 10 14:41:31.742445 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.742410    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:41:31.742529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.742488    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:41:31.742529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:31.742521    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:41:32.171349 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:32.171304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" event={"ID":"7a247369-4e1c-42c1-99b2-480f65fa9b6c","Type":"ContainerStarted","Data":"2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2"}
Sep 10 14:41:32.171873 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:32.171366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" event={"ID":"7a247369-4e1c-42c1-99b2-480f65fa9b6c","Type":"ContainerStarted","Data":"ea392a0ffbc8ebf1c08b81e8fbb6e14bc23fd16e283ca9e47c21e7f6e3fceefb"}
Sep 10 14:41:32.194795 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:32.194730    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" podStartSLOduration=1.194713713 podStartE2EDuration="1.194713713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:41:32.19241024 +0000 UTC m=+1338.784615008" watchObservedRunningTime="2026-09-10 14:41:32.194713713 +0000 UTC m=+1338.786918481"
Sep 10 14:41:32.459606 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:32.459519    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:32.465231 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:32.465199    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:33.179507 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:33.179477    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:33.180495 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:33.180471    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:35.933368 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:35.933283    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"]
Sep 10 14:41:35.936102 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:35.936083    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:41:35.945372 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:35.945349    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-1d2af2\""
Sep 10 14:41:35.953460 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:35.953435    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"]
Sep 10 14:41:35.987345 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:35.987294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm\" (UID: \"4724d800-f9eb-46ae-9dc0-fce7d2d90a18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:41:35.987650 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:35.987621    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt5hn\" (UniqueName: \"kubernetes.io/projected/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-kube-api-access-vt5hn\") pod \"payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm\" (UID: \"4724d800-f9eb-46ae-9dc0-fce7d2d90a18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:41:36.088327 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:36.088286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt5hn\" (UniqueName: \"kubernetes.io/projected/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-kube-api-access-vt5hn\") pod \"payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm\" (UID: \"4724d800-f9eb-46ae-9dc0-fce7d2d90a18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:41:36.088497 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:36.088349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm\" (UID: \"4724d800-f9eb-46ae-9dc0-fce7d2d90a18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:41:36.089024 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:36.089006    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm\" (UID: \"4724d800-f9eb-46ae-9dc0-fce7d2d90a18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:41:36.097513 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:36.097488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt5hn\" (UniqueName: \"kubernetes.io/projected/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-kube-api-access-vt5hn\") pod \"payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm\" (UID: \"4724d800-f9eb-46ae-9dc0-fce7d2d90a18\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:41:36.247014 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:36.246929    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:41:36.521705 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:36.521675    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"]
Sep 10 14:41:36.523580 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:41:36.523555    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4724d800_f9eb_46ae_9dc0_fce7d2d90a18.slice/crio-6b944ecdd759906abd947174309fdfe037c0f0a432976043142751b1cb045a53 WatchSource:0}: Error finding container 6b944ecdd759906abd947174309fdfe037c0f0a432976043142751b1cb045a53: Status 404 returned error can't find the container with id 6b944ecdd759906abd947174309fdfe037c0f0a432976043142751b1cb045a53
Sep 10 14:41:37.205701 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:37.205654    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm" event={"ID":"4724d800-f9eb-46ae-9dc0-fce7d2d90a18","Type":"ContainerStarted","Data":"141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432"}
Sep 10 14:41:37.206189 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:37.205724    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm" event={"ID":"4724d800-f9eb-46ae-9dc0-fce7d2d90a18","Type":"ContainerStarted","Data":"6b944ecdd759906abd947174309fdfe037c0f0a432976043142751b1cb045a53"}
Sep 10 14:41:37.206189 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:37.205756    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:41:37.224611 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:37.224544    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm" podStartSLOduration=2.224526522 podStartE2EDuration="2.224526522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:41:37.223309523 +0000 UTC m=+1343.815514310" watchObservedRunningTime="2026-09-10 14:41:37.224526522 +0000 UTC m=+1343.816731290"
Sep 10 14:41:48.213281 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:48.213235    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:41:54.321324 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:54.321287    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerID="2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2" exitCode=0
Sep 10 14:41:54.321833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:54.321368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" event={"ID":"7a247369-4e1c-42c1-99b2-480f65fa9b6c","Type":"ContainerDied","Data":"2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2"}
Sep 10 14:41:54.321903 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:54.321892    2579 scope.go:117] "RemoveContainer" containerID="2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2"
Sep 10 14:41:54.323061 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:54.323033    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:41:54.323129 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:54.323102    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:41:54.323176 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:54.323151    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:41:55.328870 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:55.328835    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" event={"ID":"7a247369-4e1c-42c1-99b2-480f65fa9b6c","Type":"ContainerStarted","Data":"a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29"}
Sep 10 14:41:55.460159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:55.460111    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:41:55.460379 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:55.460268    2579 patch_prober.go:28] interesting pod/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:41:55.460379 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:55.460316    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 10 14:41:56.460393 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:56.460352    2579 patch_prober.go:28] interesting pod/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:41:56.461023 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:56.460988    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 10 14:41:57.460339 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:57.460284    2579 patch_prober.go:28] interesting pod/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:41:57.460877 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:57.460840    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 10 14:41:58.460513 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:58.460052    2579 patch_prober.go:28] interesting pod/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:41:58.460513 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:58.460117    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 10 14:41:59.460306 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.460264    2579 patch_prober.go:28] interesting pod/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:41:59.460848 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.460340    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 10 14:41:59.886890 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.886835    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"]
Sep 10 14:41:59.891508 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.891481    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:41:59.894438 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.894016    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4ba551-openshift-default-dockercfg-rvnh8\""
Sep 10 14:41:59.920282 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.920249    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"]
Sep 10 14:41:59.936640 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.936607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-envoy\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:41:59.936821 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.936698    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-credential-socket\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:41:59.936821 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.936724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-socket\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:41:59.936821 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.936757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-podinfo\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:41:59.936940 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.936862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-data\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:41:59.936940 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.936911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q25wj\" (UniqueName: \"kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-kube-api-access-q25wj\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:41:59.937009 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.936944    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-token\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:41:59.937009 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.936974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istiod-ca-cert\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:41:59.937077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:41:59.937047    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-certs\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.037883 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.037839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istiod-ca-cert\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.038088 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.037926    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-certs\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.038088 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.037962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-envoy\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.038088 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.038026    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-credential-socket\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.038088 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.038055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-socket\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.038372 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.038350    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-credential-socket\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.038447 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.038411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-podinfo\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.038512 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.038455    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-certs\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.038564 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.038524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-data\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.038620 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.038587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q25wj\" (UniqueName: \"kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-kube-api-access-q25wj\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.038686 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.038626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-token\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.038686 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.038658    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istiod-ca-cert\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.039009 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.038969    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-data\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.039296 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.039278    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-socket\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.041324 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.041298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-envoy\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.041459 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.041436    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-podinfo\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.048181 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.048145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-token\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.049137 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.049115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q25wj\" (UniqueName: \"kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-kube-api-access-q25wj\") pod \"e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") " pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.210675 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.210584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:00.459711 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.459669    2579 patch_prober.go:28] interesting pod/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 10 14:42:00.459903 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.459733    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 10 14:42:00.517162 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.517136    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"]
Sep 10 14:42:00.519495 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:42:00.519458    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65308ad1_03c7_4f60_ba8d_8d647cb7463f.slice/crio-63fa4e00909dc171b437ba6686545a98bc0b6b1c9b07204251f4906a4b1d5c30 WatchSource:0}: Error finding container 63fa4e00909dc171b437ba6686545a98bc0b6b1c9b07204251f4906a4b1d5c30: Status 404 returned error can't find the container with id 63fa4e00909dc171b437ba6686545a98bc0b6b1c9b07204251f4906a4b1d5c30
Sep 10 14:42:00.522321 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.522279    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:42:00.522394 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.522378    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:42:00.522439 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:00.522424    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:42:01.389808 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:01.389743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" event={"ID":"65308ad1-03c7-4f60-ba8d-8d647cb7463f","Type":"ContainerStarted","Data":"9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85"}
Sep 10 14:42:01.390030 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:01.389840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" event={"ID":"65308ad1-03c7-4f60-ba8d-8d647cb7463f","Type":"ContainerStarted","Data":"63fa4e00909dc171b437ba6686545a98bc0b6b1c9b07204251f4906a4b1d5c30"}
Sep 10 14:42:01.411580 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:01.411523    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" podStartSLOduration=2.411504009 podStartE2EDuration="2.411504009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:42:01.409536016 +0000 UTC m=+1368.001740786" watchObservedRunningTime="2026-09-10 14:42:01.411504009 +0000 UTC m=+1368.003708777"
Sep 10 14:42:01.463444 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:01.463414    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:42:01.463822 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:01.463773    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:42:01.464526 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:01.464510    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:42:02.211414 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:02.211372    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:02.216849 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:02.216822    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:02.395956 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:02.395925    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:02.396977 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:02.396955    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:05.324537 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.324503    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"]
Sep 10 14:42:05.328394 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.328375    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:42:05.331032 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.331007    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-4ba551\""
Sep 10 14:42:05.331147 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.331093    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-4ba551-dockercfg-ttfqr\""
Sep 10 14:42:05.339626 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.339545    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"]
Sep 10 14:42:05.395769 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.395481    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6667d14e-b26c-4d90-ae24-35e6edad2f65-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b\" (UID: \"6667d14e-b26c-4d90-ae24-35e6edad2f65\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:42:05.395769 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.395634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl699\" (UniqueName: \"kubernetes.io/projected/6667d14e-b26c-4d90-ae24-35e6edad2f65-kube-api-access-zl699\") pod \"payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b\" (UID: \"6667d14e-b26c-4d90-ae24-35e6edad2f65\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:42:05.497211 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.497156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl699\" (UniqueName: \"kubernetes.io/projected/6667d14e-b26c-4d90-ae24-35e6edad2f65-kube-api-access-zl699\") pod \"payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b\" (UID: \"6667d14e-b26c-4d90-ae24-35e6edad2f65\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:42:05.497412 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.497247    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6667d14e-b26c-4d90-ae24-35e6edad2f65-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b\" (UID: \"6667d14e-b26c-4d90-ae24-35e6edad2f65\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:42:05.498050 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.498029    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6667d14e-b26c-4d90-ae24-35e6edad2f65-plugins-config-volume\") pod \"payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b\" (UID: \"6667d14e-b26c-4d90-ae24-35e6edad2f65\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:42:05.507489 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.507456    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl699\" (UniqueName: \"kubernetes.io/projected/6667d14e-b26c-4d90-ae24-35e6edad2f65-kube-api-access-zl699\") pod \"payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b\" (UID: \"6667d14e-b26c-4d90-ae24-35e6edad2f65\") " pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:42:05.641003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.640911    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:42:05.916441 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:05.916414    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"]
Sep 10 14:42:05.917842 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:42:05.917813    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6667d14e_b26c_4d90_ae24_35e6edad2f65.slice/crio-82e1ff48b6c251ed6167fd84514d0a4c83b821f783cb6294b76236d0c0e190da WatchSource:0}: Error finding container 82e1ff48b6c251ed6167fd84514d0a4c83b821f783cb6294b76236d0c0e190da: Status 404 returned error can't find the container with id 82e1ff48b6c251ed6167fd84514d0a4c83b821f783cb6294b76236d0c0e190da
Sep 10 14:42:06.426643 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:06.426610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b" event={"ID":"6667d14e-b26c-4d90-ae24-35e6edad2f65","Type":"ContainerStarted","Data":"42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96"}
Sep 10 14:42:06.427162 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:06.426667    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:42:06.427162 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:06.426688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b" event={"ID":"6667d14e-b26c-4d90-ae24-35e6edad2f65","Type":"ContainerStarted","Data":"82e1ff48b6c251ed6167fd84514d0a4c83b821f783cb6294b76236d0c0e190da"}
Sep 10 14:42:17.435543 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:17.435506    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:42:17.453430 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:17.453376    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b" podStartSLOduration=12.453359241 podStartE2EDuration="12.453359241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:42:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:42:06.447399385 +0000 UTC m=+1373.039604157" watchObservedRunningTime="2026-09-10 14:42:17.453359241 +0000 UTC m=+1384.045564049"
Sep 10 14:42:26.558849 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:26.558730    2579 generic.go:356] "Generic (PLEG): container finished" podID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerID="9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85" exitCode=0
Sep 10 14:42:26.558849 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:26.558813    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" event={"ID":"65308ad1-03c7-4f60-ba8d-8d647cb7463f","Type":"ContainerDied","Data":"9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85"}
Sep 10 14:42:26.559377 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:26.559359    2579 scope.go:117] "RemoveContainer" containerID="9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85"
Sep 10 14:42:26.560920 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:26.560886    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:42:26.561059 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:26.561037    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:42:26.561145 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:26.561124    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:42:27.572961 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:27.572918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" event={"ID":"65308ad1-03c7-4f60-ba8d-8d647cb7463f","Type":"ContainerStarted","Data":"767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08"}
Sep 10 14:42:28.211384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:28.211344    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:28.212662 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:28.212629    2579 patch_prober.go:28] interesting pod/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 14:42:28.212820 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:28.212685    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 14:42:29.211528 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:29.211494    2579 patch_prober.go:28] interesting pod/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 14:42:29.211950 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:29.211558    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 14:42:30.211518 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:30.211479    2579 patch_prober.go:28] interesting pod/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 14:42:30.211700 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:30.211545    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 14:42:31.211483 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:31.211444    2579 patch_prober.go:28] interesting pod/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 14:42:31.211722 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:31.211501    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 14:42:32.211832 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:32.211757    2579 patch_prober.go:28] interesting pod/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 10 14:42:32.212248 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:32.211855    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 10 14:42:32.396038 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:32.395993    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:33.215299 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:33.215264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:33.216408 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:33.216385    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:42:47.207275 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.207241    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"]
Sep 10 14:42:47.207860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.207471    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm" podUID="4724d800-f9eb-46ae-9dc0-fce7d2d90a18" containerName="payload-pre-processing" containerID="cri-o://141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432" gracePeriod=30
Sep 10 14:42:47.504007 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.503981    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:42:47.655545 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.655505    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt5hn\" (UniqueName: \"kubernetes.io/projected/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-kube-api-access-vt5hn\") pod \"4724d800-f9eb-46ae-9dc0-fce7d2d90a18\" (UID: \"4724d800-f9eb-46ae-9dc0-fce7d2d90a18\") "
Sep 10 14:42:47.655727 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.655565    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-plugins-config-volume\") pod \"4724d800-f9eb-46ae-9dc0-fce7d2d90a18\" (UID: \"4724d800-f9eb-46ae-9dc0-fce7d2d90a18\") "
Sep 10 14:42:47.656050 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.656017    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4724d800-f9eb-46ae-9dc0-fce7d2d90a18" (UID: "4724d800-f9eb-46ae-9dc0-fce7d2d90a18"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:47.657929 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.657903    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-kube-api-access-vt5hn" (OuterVolumeSpecName: "kube-api-access-vt5hn") pod "4724d800-f9eb-46ae-9dc0-fce7d2d90a18" (UID: "4724d800-f9eb-46ae-9dc0-fce7d2d90a18"). InnerVolumeSpecName "kube-api-access-vt5hn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:47.692174 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.692143    2579 generic.go:356] "Generic (PLEG): container finished" podID="4724d800-f9eb-46ae-9dc0-fce7d2d90a18" containerID="141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432" exitCode=0
Sep 10 14:42:47.692347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.692198    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"
Sep 10 14:42:47.692347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.692230    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm" event={"ID":"4724d800-f9eb-46ae-9dc0-fce7d2d90a18","Type":"ContainerDied","Data":"141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432"}
Sep 10 14:42:47.692347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.692287    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm" event={"ID":"4724d800-f9eb-46ae-9dc0-fce7d2d90a18","Type":"ContainerDied","Data":"6b944ecdd759906abd947174309fdfe037c0f0a432976043142751b1cb045a53"}
Sep 10 14:42:47.692347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.692314    2579 scope.go:117] "RemoveContainer" containerID="141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432"
Sep 10 14:42:47.702041 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.702018    2579 scope.go:117] "RemoveContainer" containerID="141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432"
Sep 10 14:42:47.702345 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:42:47.702326    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432\": container with ID starting with 141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432 not found: ID does not exist" containerID="141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432"
Sep 10 14:42:47.702424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.702352    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432"} err="failed to get container status \"141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432\": rpc error: code = NotFound desc = could not find container \"141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432\": container with ID starting with 141fe8b9f1fa5aa7d145d8a37cea627dc2d397d915a02fd8b1345ef6f570b432 not found: ID does not exist"
Sep 10 14:42:47.717588 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.717519    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"]
Sep 10 14:42:47.721314 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.721261    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1d2af2-6f59cfd574-csshm"]
Sep 10 14:42:47.757226 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.757192    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt5hn\" (UniqueName: \"kubernetes.io/projected/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-kube-api-access-vt5hn\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:42:47.757226 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.757220    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4724d800-f9eb-46ae-9dc0-fce7d2d90a18-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:42:47.912463 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:47.912427    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4724d800-f9eb-46ae-9dc0-fce7d2d90a18" path="/var/lib/kubelet/pods/4724d800-f9eb-46ae-9dc0-fce7d2d90a18/volumes"
Sep 10 14:42:54.081521 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:54.081489    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"]
Sep 10 14:42:54.082052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:54.081768    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy" containerID="cri-o://a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29" gracePeriod=30
Sep 10 14:42:59.345287 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.345250    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:42:59.488067 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.487969    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-envoy\") pod \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") "
Sep 10 14:42:59.488067 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lzbl\" (UniqueName: \"kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-kube-api-access-7lzbl\") pod \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") "
Sep 10 14:42:59.488294 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488101    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istiod-ca-cert\") pod \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") "
Sep 10 14:42:59.488294 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488151    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-credential-socket\") pod \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") "
Sep 10 14:42:59.488294 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488176    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-data\") pod \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") "
Sep 10 14:42:59.488294 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488237    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-token\") pod \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") "
Sep 10 14:42:59.488592 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488272    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-certs\") pod \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") "
Sep 10 14:42:59.488688 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488641    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-socket\") pod \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") "
Sep 10 14:42:59.488688 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488528    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a247369-4e1c-42c1-99b2-480f65fa9b6c" (UID: "7a247369-4e1c-42c1-99b2-480f65fa9b6c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:59.488688 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488672    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-podinfo\") pod \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\" (UID: \"7a247369-4e1c-42c1-99b2-480f65fa9b6c\") "
Sep 10 14:42:59.489027 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488532    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a247369-4e1c-42c1-99b2-480f65fa9b6c" (UID: "7a247369-4e1c-42c1-99b2-480f65fa9b6c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:59.489027 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488557    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a247369-4e1c-42c1-99b2-480f65fa9b6c" (UID: "7a247369-4e1c-42c1-99b2-480f65fa9b6c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:59.489027 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.488577    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a247369-4e1c-42c1-99b2-480f65fa9b6c" (UID: "7a247369-4e1c-42c1-99b2-480f65fa9b6c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:42:59.489273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.489080    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a247369-4e1c-42c1-99b2-480f65fa9b6c" (UID: "7a247369-4e1c-42c1-99b2-480f65fa9b6c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:59.489273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.489184    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:42:59.489273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.489204    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:42:59.489273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.489219    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:42:59.489273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.489233    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:42:59.489273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.489247    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:42:59.490533 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.490502    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a247369-4e1c-42c1-99b2-480f65fa9b6c" (UID: "7a247369-4e1c-42c1-99b2-480f65fa9b6c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:42:59.490648 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.490598    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-kube-api-access-7lzbl" (OuterVolumeSpecName: "kube-api-access-7lzbl") pod "7a247369-4e1c-42c1-99b2-480f65fa9b6c" (UID: "7a247369-4e1c-42c1-99b2-480f65fa9b6c"). InnerVolumeSpecName "kube-api-access-7lzbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:59.490648 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.490599    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a247369-4e1c-42c1-99b2-480f65fa9b6c" (UID: "7a247369-4e1c-42c1-99b2-480f65fa9b6c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:42:59.491010 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.490994    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a247369-4e1c-42c1-99b2-480f65fa9b6c" (UID: "7a247369-4e1c-42c1-99b2-480f65fa9b6c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:42:59.590482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.590447    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lzbl\" (UniqueName: \"kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-kube-api-access-7lzbl\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:42:59.590482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.590476    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:42:59.590482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.590486    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:42:59.590482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.590493    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a247369-4e1c-42c1-99b2-480f65fa9b6c-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:42:59.763469 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.763433    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerID="a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29" exitCode=0
Sep 10 14:42:59.763647 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.763494    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"
Sep 10 14:42:59.763647 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.763522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" event={"ID":"7a247369-4e1c-42c1-99b2-480f65fa9b6c","Type":"ContainerDied","Data":"a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29"}
Sep 10 14:42:59.763647 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.763576    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v" event={"ID":"7a247369-4e1c-42c1-99b2-480f65fa9b6c","Type":"ContainerDied","Data":"ea392a0ffbc8ebf1c08b81e8fbb6e14bc23fd16e283ca9e47c21e7f6e3fceefb"}
Sep 10 14:42:59.763647 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.763601    2579 scope.go:117] "RemoveContainer" containerID="a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29"
Sep 10 14:42:59.773657 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.773637    2579 scope.go:117] "RemoveContainer" containerID="2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2"
Sep 10 14:42:59.783016 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.782997    2579 scope.go:117] "RemoveContainer" containerID="a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29"
Sep 10 14:42:59.783326 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:42:59.783306    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29\": container with ID starting with a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29 not found: ID does not exist" containerID="a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29"
Sep 10 14:42:59.783379 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.783336    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29"} err="failed to get container status \"a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29\": rpc error: code = NotFound desc = could not find container \"a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29\": container with ID starting with a649fa69063cc14e9a2626b75e3b7ebf530e6a85fa485971a9b9c2c3eec07c29 not found: ID does not exist"
Sep 10 14:42:59.783379 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.783353    2579 scope.go:117] "RemoveContainer" containerID="2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2"
Sep 10 14:42:59.783615 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:42:59.783597    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2\": container with ID starting with 2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2 not found: ID does not exist" containerID="2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2"
Sep 10 14:42:59.783659 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.783620    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2"} err="failed to get container status \"2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2\": rpc error: code = NotFound desc = could not find container \"2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2\": container with ID starting with 2476cbfd581c9b6cce3b86329f079fbd85ecb5dee94db6e6d942682db05f2fa2 not found: ID does not exist"
Sep 10 14:42:59.788085 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.788063    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"]
Sep 10 14:42:59.792068 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.792045    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1d2af2-openshift-default-6897d8b696-6rd2v"]
Sep 10 14:42:59.912151 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:42:59.912117    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" path="/var/lib/kubelet/pods/7a247369-4e1c-42c1-99b2-480f65fa9b6c/volumes"
Sep 10 14:43:09.898030 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:09.897937    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"]
Sep 10 14:43:09.898504 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:09.898281    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b" podUID="6667d14e-b26c-4d90-ae24-35e6edad2f65" containerName="payload-processing" containerID="cri-o://42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96" gracePeriod=30
Sep 10 14:43:10.191316 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.191285    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:43:10.293941 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.293889    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl699\" (UniqueName: \"kubernetes.io/projected/6667d14e-b26c-4d90-ae24-35e6edad2f65-kube-api-access-zl699\") pod \"6667d14e-b26c-4d90-ae24-35e6edad2f65\" (UID: \"6667d14e-b26c-4d90-ae24-35e6edad2f65\") "
Sep 10 14:43:10.293941 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.293953    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6667d14e-b26c-4d90-ae24-35e6edad2f65-plugins-config-volume\") pod \"6667d14e-b26c-4d90-ae24-35e6edad2f65\" (UID: \"6667d14e-b26c-4d90-ae24-35e6edad2f65\") "
Sep 10 14:43:10.294347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.294324    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6667d14e-b26c-4d90-ae24-35e6edad2f65-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6667d14e-b26c-4d90-ae24-35e6edad2f65" (UID: "6667d14e-b26c-4d90-ae24-35e6edad2f65"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:10.296314 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.296292    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6667d14e-b26c-4d90-ae24-35e6edad2f65-kube-api-access-zl699" (OuterVolumeSpecName: "kube-api-access-zl699") pod "6667d14e-b26c-4d90-ae24-35e6edad2f65" (UID: "6667d14e-b26c-4d90-ae24-35e6edad2f65"). InnerVolumeSpecName "kube-api-access-zl699". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:10.395877 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.395823    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6667d14e-b26c-4d90-ae24-35e6edad2f65-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:10.395877 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.395870    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl699\" (UniqueName: \"kubernetes.io/projected/6667d14e-b26c-4d90-ae24-35e6edad2f65-kube-api-access-zl699\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:10.826544 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.826507    2579 generic.go:356] "Generic (PLEG): container finished" podID="6667d14e-b26c-4d90-ae24-35e6edad2f65" containerID="42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96" exitCode=0
Sep 10 14:43:10.826733 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.826560    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"
Sep 10 14:43:10.826733 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.826579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b" event={"ID":"6667d14e-b26c-4d90-ae24-35e6edad2f65","Type":"ContainerDied","Data":"42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96"}
Sep 10 14:43:10.826733 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.826621    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b" event={"ID":"6667d14e-b26c-4d90-ae24-35e6edad2f65","Type":"ContainerDied","Data":"82e1ff48b6c251ed6167fd84514d0a4c83b821f783cb6294b76236d0c0e190da"}
Sep 10 14:43:10.826733 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.826642    2579 scope.go:117] "RemoveContainer" containerID="42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96"
Sep 10 14:43:10.836540 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.836522    2579 scope.go:117] "RemoveContainer" containerID="42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96"
Sep 10 14:43:10.836866 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:43:10.836843    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96\": container with ID starting with 42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96 not found: ID does not exist" containerID="42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96"
Sep 10 14:43:10.836978 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.836876    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96"} err="failed to get container status \"42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96\": rpc error: code = NotFound desc = could not find container \"42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96\": container with ID starting with 42be3059f8ede4758919f7930cc4ec80b2310daab3c8d4fc48c2df98ce5cee96 not found: ID does not exist"
Sep 10 14:43:10.856883 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.856851    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"]
Sep 10 14:43:10.864554 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:10.864519    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-4ba551-bc6c77477-b7g7b"]
Sep 10 14:43:11.912183 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:11.912149    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6667d14e-b26c-4d90-ae24-35e6edad2f65" path="/var/lib/kubelet/pods/6667d14e-b26c-4d90-ae24-35e6edad2f65/volumes"
Sep 10 14:43:14.113873 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:14.113840    2579 scope.go:117] "RemoveContainer" containerID="580ee5cb11f402e22b94cb55d6704f9325c0788c0397cd8d36c5f99615d06e27"
Sep 10 14:43:14.124216 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:14.124193    2579 scope.go:117] "RemoveContainer" containerID="ed0fa6dc8669e0a9900af68633dfe613840765f84b3fddadff2caec9c93c79c0"
Sep 10 14:43:14.132853 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:14.132831    2579 scope.go:117] "RemoveContainer" containerID="65acc4ccbb6c553df9532ac5df4bde8a2901c25260446840899d90c2eb7c1569"
Sep 10 14:43:16.561852 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:16.561815    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"]
Sep 10 14:43:16.562343 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:16.562072    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy" containerID="cri-o://767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08" gracePeriod=30
Sep 10 14:43:18.218352 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:18.218307    2579 patch_prober.go:28] interesting pod/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:43:18.218724 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:18.218377    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:43:21.825667 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.825602    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:43:21.895399 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.895363    2579 generic.go:356] "Generic (PLEG): container finished" podID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerID="767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08" exitCode=0
Sep 10 14:43:21.895579 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.895420    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"
Sep 10 14:43:21.895579 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.895458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" event={"ID":"65308ad1-03c7-4f60-ba8d-8d647cb7463f","Type":"ContainerDied","Data":"767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08"}
Sep 10 14:43:21.895579 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.895517    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7" event={"ID":"65308ad1-03c7-4f60-ba8d-8d647cb7463f","Type":"ContainerDied","Data":"63fa4e00909dc171b437ba6686545a98bc0b6b1c9b07204251f4906a4b1d5c30"}
Sep 10 14:43:21.895579 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.895540    2579 scope.go:117] "RemoveContainer" containerID="767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08"
Sep 10 14:43:21.905101 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905078    2579 scope.go:117] "RemoveContainer" containerID="9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85"
Sep 10 14:43:21.905311 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905294    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q25wj\" (UniqueName: \"kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-kube-api-access-q25wj\") pod \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") "
Sep 10 14:43:21.905377 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905321    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-token\") pod \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") "
Sep 10 14:43:21.905426 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905374    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-envoy\") pod \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") "
Sep 10 14:43:21.905426 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905419    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-certs\") pod \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") "
Sep 10 14:43:21.905609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905589    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istiod-ca-cert\") pod \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") "
Sep 10 14:43:21.905702 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905669    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-credential-socket\") pod \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") "
Sep 10 14:43:21.905759 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905690    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65308ad1-03c7-4f60-ba8d-8d647cb7463f" (UID: "65308ad1-03c7-4f60-ba8d-8d647cb7463f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:21.905759 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905746    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-podinfo\") pod \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") "
Sep 10 14:43:21.905905 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905878    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-socket\") pod \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") "
Sep 10 14:43:21.905959 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905907    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65308ad1-03c7-4f60-ba8d-8d647cb7463f" (UID: "65308ad1-03c7-4f60-ba8d-8d647cb7463f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:21.905959 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.905946    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-data\") pod \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\" (UID: \"65308ad1-03c7-4f60-ba8d-8d647cb7463f\") "
Sep 10 14:43:21.906071 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.906028    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65308ad1-03c7-4f60-ba8d-8d647cb7463f" (UID: "65308ad1-03c7-4f60-ba8d-8d647cb7463f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:21.906361 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.906288    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65308ad1-03c7-4f60-ba8d-8d647cb7463f" (UID: "65308ad1-03c7-4f60-ba8d-8d647cb7463f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:21.906485 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.906460    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-data" (OuterVolumeSpecName: "istio-data") pod "65308ad1-03c7-4f60-ba8d-8d647cb7463f" (UID: "65308ad1-03c7-4f60-ba8d-8d647cb7463f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:21.906558 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.906481    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:21.906558 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.906505    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:21.906558 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.906518    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:21.906558 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.906531    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:21.908086 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.908047    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-token" (OuterVolumeSpecName: "istio-token") pod "65308ad1-03c7-4f60-ba8d-8d647cb7463f" (UID: "65308ad1-03c7-4f60-ba8d-8d647cb7463f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:21.908086 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.908060    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-kube-api-access-q25wj" (OuterVolumeSpecName: "kube-api-access-q25wj") pod "65308ad1-03c7-4f60-ba8d-8d647cb7463f" (UID: "65308ad1-03c7-4f60-ba8d-8d647cb7463f"). InnerVolumeSpecName "kube-api-access-q25wj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:21.908244 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.908104    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65308ad1-03c7-4f60-ba8d-8d647cb7463f" (UID: "65308ad1-03c7-4f60-ba8d-8d647cb7463f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:21.908483 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.908464    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65308ad1-03c7-4f60-ba8d-8d647cb7463f" (UID: "65308ad1-03c7-4f60-ba8d-8d647cb7463f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:43:21.930528 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.930507    2579 scope.go:117] "RemoveContainer" containerID="767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08"
Sep 10 14:43:21.930869 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:43:21.930843    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08\": container with ID starting with 767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08 not found: ID does not exist" containerID="767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08"
Sep 10 14:43:21.930993 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.930884    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08"} err="failed to get container status \"767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08\": rpc error: code = NotFound desc = could not find container \"767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08\": container with ID starting with 767cf980746ca87860e96f38267c1d6f3fda964367cf4756def5141ffdd88e08 not found: ID does not exist"
Sep 10 14:43:21.930993 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.930908    2579 scope.go:117] "RemoveContainer" containerID="9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85"
Sep 10 14:43:21.931232 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:43:21.931209    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85\": container with ID starting with 9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85 not found: ID does not exist" containerID="9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85"
Sep 10 14:43:21.931273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:21.931238    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85"} err="failed to get container status \"9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85\": rpc error: code = NotFound desc = could not find container \"9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85\": container with ID starting with 9b51c66ff924e42739fa596793defa2371676e5baf890b2bfd6169213b39db85 not found: ID does not exist"
Sep 10 14:43:22.008108 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:22.008073    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:22.008108 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:22.008103    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:22.008108 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:22.008113    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:22.008354 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:22.008121    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q25wj\" (UniqueName: \"kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-kube-api-access-q25wj\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:22.008354 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:22.008130    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65308ad1-03c7-4f60-ba8d-8d647cb7463f-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:22.222937 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:22.222847    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"]
Sep 10 14:43:22.237031 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:22.236993    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4ba551-openshift-default-66fc7d6c58-vgls7"]
Sep 10 14:43:23.912471 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:23.912437    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" path="/var/lib/kubelet/pods/65308ad1-03c7-4f60-ba8d-8d647cb7463f/volumes"
Sep 10 14:43:27.518711 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.518671    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"]
Sep 10 14:43:27.519433 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.519393    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf" podUID="fac6aa3d-1bd5-45d7-890b-3a8c50b26549" containerName="payload-processing" containerID="cri-o://fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a" gracePeriod=30
Sep 10 14:43:27.528745 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.528704    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"]
Sep 10 14:43:27.529111 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.529079    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb" podUID="76d0c4f8-a349-422e-921f-7256008a6eff" containerName="payload-pre-processing" containerID="cri-o://61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3" gracePeriod=30
Sep 10 14:43:27.812255 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.812230    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:43:27.854102 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.854067    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:43:27.931681 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.931647    2579 generic.go:356] "Generic (PLEG): container finished" podID="fac6aa3d-1bd5-45d7-890b-3a8c50b26549" containerID="fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a" exitCode=0
Sep 10 14:43:27.931902 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.931698    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"
Sep 10 14:43:27.931902 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.931744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf" event={"ID":"fac6aa3d-1bd5-45d7-890b-3a8c50b26549","Type":"ContainerDied","Data":"fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a"}
Sep 10 14:43:27.931902 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.931820    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf" event={"ID":"fac6aa3d-1bd5-45d7-890b-3a8c50b26549","Type":"ContainerDied","Data":"5bbdc282642bc8f1325ef565be8c397564a62369b30914f3cda0c0097bc08503"}
Sep 10 14:43:27.931902 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.931844    2579 scope.go:117] "RemoveContainer" containerID="fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a"
Sep 10 14:43:27.933363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.933322    2579 generic.go:356] "Generic (PLEG): container finished" podID="76d0c4f8-a349-422e-921f-7256008a6eff" containerID="61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3" exitCode=0
Sep 10 14:43:27.933363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.933361    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb" event={"ID":"76d0c4f8-a349-422e-921f-7256008a6eff","Type":"ContainerDied","Data":"61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3"}
Sep 10 14:43:27.933513 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.933395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb" event={"ID":"76d0c4f8-a349-422e-921f-7256008a6eff","Type":"ContainerDied","Data":"e6299266172778221492881f3ee36761bb1d98140f73416a35266433028b0e70"}
Sep 10 14:43:27.933555 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.933537    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"
Sep 10 14:43:27.940775 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.940757    2579 scope.go:117] "RemoveContainer" containerID="fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a"
Sep 10 14:43:27.941109 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:43:27.941090    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a\": container with ID starting with fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a not found: ID does not exist" containerID="fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a"
Sep 10 14:43:27.941163 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.941118    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a"} err="failed to get container status \"fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a\": rpc error: code = NotFound desc = could not find container \"fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a\": container with ID starting with fa8e8e4e533f52608a9310a7b54077dd21dcf51ff90376bf9188103c8361fd8a not found: ID does not exist"
Sep 10 14:43:27.941163 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.941137    2579 scope.go:117] "RemoveContainer" containerID="61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3"
Sep 10 14:43:27.949479 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.949456    2579 scope.go:117] "RemoveContainer" containerID="61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3"
Sep 10 14:43:27.949761 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:43:27.949744    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3\": container with ID starting with 61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3 not found: ID does not exist" containerID="61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3"
Sep 10 14:43:27.949841 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.949768    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3"} err="failed to get container status \"61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3\": rpc error: code = NotFound desc = could not find container \"61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3\": container with ID starting with 61a113ec6f229cfaca73304db77c794145925ce18d0cdd54eb09dd9ad8b1c5f3 not found: ID does not exist"
Sep 10 14:43:27.973231 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.973198    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-plugins-config-volume\") pod \"fac6aa3d-1bd5-45d7-890b-3a8c50b26549\" (UID: \"fac6aa3d-1bd5-45d7-890b-3a8c50b26549\") "
Sep 10 14:43:27.973378 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.973252    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76d0c4f8-a349-422e-921f-7256008a6eff-plugins-config-volume\") pod \"76d0c4f8-a349-422e-921f-7256008a6eff\" (UID: \"76d0c4f8-a349-422e-921f-7256008a6eff\") "
Sep 10 14:43:27.973378 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.973309    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czgjk\" (UniqueName: \"kubernetes.io/projected/76d0c4f8-a349-422e-921f-7256008a6eff-kube-api-access-czgjk\") pod \"76d0c4f8-a349-422e-921f-7256008a6eff\" (UID: \"76d0c4f8-a349-422e-921f-7256008a6eff\") "
Sep 10 14:43:27.973452 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.973382    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5db47\" (UniqueName: \"kubernetes.io/projected/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-kube-api-access-5db47\") pod \"fac6aa3d-1bd5-45d7-890b-3a8c50b26549\" (UID: \"fac6aa3d-1bd5-45d7-890b-3a8c50b26549\") "
Sep 10 14:43:27.973658 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.973632    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76d0c4f8-a349-422e-921f-7256008a6eff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "76d0c4f8-a349-422e-921f-7256008a6eff" (UID: "76d0c4f8-a349-422e-921f-7256008a6eff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:27.973740 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.973634    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fac6aa3d-1bd5-45d7-890b-3a8c50b26549" (UID: "fac6aa3d-1bd5-45d7-890b-3a8c50b26549"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:27.975668 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.975639    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-kube-api-access-5db47" (OuterVolumeSpecName: "kube-api-access-5db47") pod "fac6aa3d-1bd5-45d7-890b-3a8c50b26549" (UID: "fac6aa3d-1bd5-45d7-890b-3a8c50b26549"). InnerVolumeSpecName "kube-api-access-5db47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:27.975752 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:27.975665    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76d0c4f8-a349-422e-921f-7256008a6eff-kube-api-access-czgjk" (OuterVolumeSpecName: "kube-api-access-czgjk") pod "76d0c4f8-a349-422e-921f-7256008a6eff" (UID: "76d0c4f8-a349-422e-921f-7256008a6eff"). InnerVolumeSpecName "kube-api-access-czgjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:28.074718 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:28.074613    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5db47\" (UniqueName: \"kubernetes.io/projected/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-kube-api-access-5db47\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:28.074718 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:28.074655    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fac6aa3d-1bd5-45d7-890b-3a8c50b26549-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:28.074718 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:28.074664    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76d0c4f8-a349-422e-921f-7256008a6eff-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:28.074718 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:28.074673    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czgjk\" (UniqueName: \"kubernetes.io/projected/76d0c4f8-a349-422e-921f-7256008a6eff-kube-api-access-czgjk\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:28.256523 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:28.256484    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"]
Sep 10 14:43:28.260692 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:28.260662    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-8ecc1f-856d9cc485-tsbxf"]
Sep 10 14:43:28.271146 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:28.271114    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"]
Sep 10 14:43:28.275409 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:28.275374    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-8ecc1f-5bf6bb8498-mrslb"]
Sep 10 14:43:29.911880 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:29.911844    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76d0c4f8-a349-422e-921f-7256008a6eff" path="/var/lib/kubelet/pods/76d0c4f8-a349-422e-921f-7256008a6eff/volumes"
Sep 10 14:43:29.912270 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:29.912209    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fac6aa3d-1bd5-45d7-890b-3a8c50b26549" path="/var/lib/kubelet/pods/fac6aa3d-1bd5-45d7-890b-3a8c50b26549/volumes"
Sep 10 14:43:34.125622 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.125584    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"]
Sep 10 14:43:34.126127 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.125870    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy" containerID="cri-o://6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e" gracePeriod=30
Sep 10 14:43:34.494257 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494162    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"]
Sep 10 14:43:34.494664 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494645    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac6aa3d-1bd5-45d7-890b-3a8c50b26549" containerName="payload-processing"
Sep 10 14:43:34.494760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494667    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac6aa3d-1bd5-45d7-890b-3a8c50b26549" containerName="payload-processing"
Sep 10 14:43:34.494760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494690    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6667d14e-b26c-4d90-ae24-35e6edad2f65" containerName="payload-processing"
Sep 10 14:43:34.494760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494698    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6667d14e-b26c-4d90-ae24-35e6edad2f65" containerName="payload-processing"
Sep 10 14:43:34.494760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494721    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy"
Sep 10 14:43:34.494760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494730    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy"
Sep 10 14:43:34.494760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494744    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy"
Sep 10 14:43:34.494760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494751    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494763    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76d0c4f8-a349-422e-921f-7256008a6eff" containerName="payload-pre-processing"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494772    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="76d0c4f8-a349-422e-921f-7256008a6eff" containerName="payload-pre-processing"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494802    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494810    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494828    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494835    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494845    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4724d800-f9eb-46ae-9dc0-fce7d2d90a18" containerName="payload-pre-processing"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494852    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4724d800-f9eb-46ae-9dc0-fce7d2d90a18" containerName="payload-pre-processing"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494963    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6667d14e-b26c-4d90-ae24-35e6edad2f65" containerName="payload-processing"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494975    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494985    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4724d800-f9eb-46ae-9dc0-fce7d2d90a18" containerName="payload-pre-processing"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.494996    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.495005    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="76d0c4f8-a349-422e-921f-7256008a6eff" containerName="payload-pre-processing"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.495015    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a247369-4e1c-42c1-99b2-480f65fa9b6c" containerName="istio-proxy"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.495024    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac6aa3d-1bd5-45d7-890b-3a8c50b26549" containerName="payload-processing"
Sep 10 14:43:34.495139 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.495035    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="65308ad1-03c7-4f60-ba8d-8d647cb7463f" containerName="istio-proxy"
Sep 10 14:43:34.499868 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.499846    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"
Sep 10 14:43:34.502623 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.502594    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwr7b\""
Sep 10 14:43:34.505766 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.505741    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"]
Sep 10 14:43:34.635690 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.635649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6949e815-e5e2-4173-b25a-41e75fd876a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26\" (UID: \"6949e815-e5e2-4173-b25a-41e75fd876a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"
Sep 10 14:43:34.736721 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.736681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6949e815-e5e2-4173-b25a-41e75fd876a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26\" (UID: \"6949e815-e5e2-4173-b25a-41e75fd876a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"
Sep 10 14:43:34.737361 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.737340    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6949e815-e5e2-4173-b25a-41e75fd876a8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26\" (UID: \"6949e815-e5e2-4173-b25a-41e75fd876a8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"
Sep 10 14:43:34.813423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:34.813380    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"
Sep 10 14:43:35.089456 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:35.089422    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"]
Sep 10 14:43:35.980386 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:35.980348    2579 generic.go:356] "Generic (PLEG): container finished" podID="6949e815-e5e2-4173-b25a-41e75fd876a8" containerID="5ab6047d15ef5cf6dc5946a0cde99af2cfaaf206fcaae939faf92e3266f28d66" exitCode=0
Sep 10 14:43:35.980764 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:35.980443    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26" event={"ID":"6949e815-e5e2-4173-b25a-41e75fd876a8","Type":"ContainerDied","Data":"5ab6047d15ef5cf6dc5946a0cde99af2cfaaf206fcaae939faf92e3266f28d66"}
Sep 10 14:43:35.980764 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:35.980500    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26" event={"ID":"6949e815-e5e2-4173-b25a-41e75fd876a8","Type":"ContainerStarted","Data":"a54da2403447c75f6a92a570bb330ac8483fc235c727cbed38a515a58641bf15"}
Sep 10 14:43:37.127754 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:37.127727    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"
Sep 10 14:43:37.157109 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:37.157079    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6949e815-e5e2-4173-b25a-41e75fd876a8-maas-api-service-ca\") pod \"6949e815-e5e2-4173-b25a-41e75fd876a8\" (UID: \"6949e815-e5e2-4173-b25a-41e75fd876a8\") "
Sep 10 14:43:37.157487 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:37.157462    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6949e815-e5e2-4173-b25a-41e75fd876a8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6949e815-e5e2-4173-b25a-41e75fd876a8" (UID: "6949e815-e5e2-4173-b25a-41e75fd876a8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:37.258760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:37.258727    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6949e815-e5e2-4173-b25a-41e75fd876a8-maas-api-service-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:37.993189 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:37.993162    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"
Sep 10 14:43:37.993357 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:37.993203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26" event={"ID":"6949e815-e5e2-4173-b25a-41e75fd876a8","Type":"ContainerDied","Data":"a54da2403447c75f6a92a570bb330ac8483fc235c727cbed38a515a58641bf15"}
Sep 10 14:43:37.993357 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:37.993247    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a54da2403447c75f6a92a570bb330ac8483fc235c727cbed38a515a58641bf15"
Sep 10 14:43:39.379563 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.379533    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:43:39.481274 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481180    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkjx4\" (UniqueName: \"kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-kube-api-access-jkjx4\") pod \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") "
Sep 10 14:43:39.481274 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481248    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-token\") pod \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") "
Sep 10 14:43:39.481476 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481291    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-data\") pod \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") "
Sep 10 14:43:39.481476 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481381    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-credential-socket\") pod \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") "
Sep 10 14:43:39.481476 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481452    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-socket\") pod \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") "
Sep 10 14:43:39.481621 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481491    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-certs\") pod \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") "
Sep 10 14:43:39.481621 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481525    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-podinfo\") pod \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") "
Sep 10 14:43:39.481621 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481557    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istiod-ca-cert\") pod \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") "
Sep 10 14:43:39.481621 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481589    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-envoy\") pod \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\" (UID: \"5511fa0a-dac6-4871-9ea6-b4b36dc45888\") "
Sep 10 14:43:39.481983 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481585    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-data" (OuterVolumeSpecName: "istio-data") pod "5511fa0a-dac6-4871-9ea6-b4b36dc45888" (UID: "5511fa0a-dac6-4871-9ea6-b4b36dc45888"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:39.482117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481605    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5511fa0a-dac6-4871-9ea6-b4b36dc45888" (UID: "5511fa0a-dac6-4871-9ea6-b4b36dc45888"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:39.482117 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481937    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5511fa0a-dac6-4871-9ea6-b4b36dc45888" (UID: "5511fa0a-dac6-4871-9ea6-b4b36dc45888"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:39.482423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.481899    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5511fa0a-dac6-4871-9ea6-b4b36dc45888" (UID: "5511fa0a-dac6-4871-9ea6-b4b36dc45888"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:39.482423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.482413    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5511fa0a-dac6-4871-9ea6-b4b36dc45888" (UID: "5511fa0a-dac6-4871-9ea6-b4b36dc45888"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:43:39.483758 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.483729    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-kube-api-access-jkjx4" (OuterVolumeSpecName: "kube-api-access-jkjx4") pod "5511fa0a-dac6-4871-9ea6-b4b36dc45888" (UID: "5511fa0a-dac6-4871-9ea6-b4b36dc45888"). InnerVolumeSpecName "kube-api-access-jkjx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:39.483758 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.483742    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-token" (OuterVolumeSpecName: "istio-token") pod "5511fa0a-dac6-4871-9ea6-b4b36dc45888" (UID: "5511fa0a-dac6-4871-9ea6-b4b36dc45888"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:43:39.483918 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.483829    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5511fa0a-dac6-4871-9ea6-b4b36dc45888" (UID: "5511fa0a-dac6-4871-9ea6-b4b36dc45888"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:43:39.483999 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.483980    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5511fa0a-dac6-4871-9ea6-b4b36dc45888" (UID: "5511fa0a-dac6-4871-9ea6-b4b36dc45888"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:43:39.582858 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.582818    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:39.582858 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.582852    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:39.583083 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.582865    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:39.583083 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.582879    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:39.583083 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.582890    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:39.583083 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.582901    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:39.583083 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.582914    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:39.583083 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.582924    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkjx4\" (UniqueName: \"kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-kube-api-access-jkjx4\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:39.583083 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:39.582935    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5511fa0a-dac6-4871-9ea6-b4b36dc45888-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:43:40.005857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.005819    2579 generic.go:356] "Generic (PLEG): container finished" podID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerID="6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e" exitCode=0
Sep 10 14:43:40.006038 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.005881    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"
Sep 10 14:43:40.006038 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.005906    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" event={"ID":"5511fa0a-dac6-4871-9ea6-b4b36dc45888","Type":"ContainerDied","Data":"6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e"}
Sep 10 14:43:40.006038 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.005964    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw" event={"ID":"5511fa0a-dac6-4871-9ea6-b4b36dc45888","Type":"ContainerDied","Data":"784b58c2b6c6d38da36fa4546ff402d7d870d3e46c92a6bdb62e8b288c7fc9c4"}
Sep 10 14:43:40.006038 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.005986    2579 scope.go:117] "RemoveContainer" containerID="6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e"
Sep 10 14:43:40.015505 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.015483    2579 scope.go:117] "RemoveContainer" containerID="002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d"
Sep 10 14:43:40.025249 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.025228    2579 scope.go:117] "RemoveContainer" containerID="6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e"
Sep 10 14:43:40.025574 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:43:40.025554    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e\": container with ID starting with 6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e not found: ID does not exist" containerID="6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e"
Sep 10 14:43:40.025668 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.025584    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e"} err="failed to get container status \"6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e\": rpc error: code = NotFound desc = could not find container \"6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e\": container with ID starting with 6d632757fcb3434c5fd36d4838e5a8e595d9fcdcfd9487c1c9bc743afe37141e not found: ID does not exist"
Sep 10 14:43:40.025668 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.025602    2579 scope.go:117] "RemoveContainer" containerID="002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d"
Sep 10 14:43:40.025859 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:43:40.025833    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d\": container with ID starting with 002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d not found: ID does not exist" containerID="002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d"
Sep 10 14:43:40.025924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.025869    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d"} err="failed to get container status \"002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d\": rpc error: code = NotFound desc = could not find container \"002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d\": container with ID starting with 002c4a2b5743ec353e996fdd448ba422cd006789e2fea0bfd0122b0f5162f77d not found: ID does not exist"
Sep 10 14:43:40.026407 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.026385    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"]
Sep 10 14:43:40.029985 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:40.029961    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-8ecc1f-openshift-default-d9f57fdfd-gmmjw"]
Sep 10 14:43:41.911895 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:41.911864    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" path="/var/lib/kubelet/pods/5511fa0a-dac6-4871-9ea6-b4b36dc45888/volumes"
Sep 10 14:43:45.113672 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:45.113633    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"]
Sep 10 14:43:45.115544 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:45.115520    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-fc06d4-xcx26"]
Sep 10 14:43:45.912322 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:43:45.912290    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6949e815-e5e2-4173-b25a-41e75fd876a8" path="/var/lib/kubelet/pods/6949e815-e5e2-4173-b25a-41e75fd876a8/volumes"
Sep 10 14:44:13.989363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:13.989332    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:44:13.990255 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:13.990228    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:44:13.996771 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:13.996747    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:44:13.997232 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:13.997214    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:44:27.838482 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.838446    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"]
Sep 10 14:44:27.839267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.838966    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6949e815-e5e2-4173-b25a-41e75fd876a8" containerName="revoke-keys"
Sep 10 14:44:27.839267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.838986    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6949e815-e5e2-4173-b25a-41e75fd876a8" containerName="revoke-keys"
Sep 10 14:44:27.839267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.839004    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy"
Sep 10 14:44:27.839267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.839010    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy"
Sep 10 14:44:27.839267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.839038    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy"
Sep 10 14:44:27.839267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.839047    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy"
Sep 10 14:44:27.839267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.839160    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy"
Sep 10 14:44:27.839267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.839173    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6949e815-e5e2-4173-b25a-41e75fd876a8" containerName="revoke-keys"
Sep 10 14:44:27.843978 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.843952    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:27.846609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.846583    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-42514d-openshift-default-dockercfg-rrsrg\""
Sep 10 14:44:27.854994 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.854964    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"]
Sep 10 14:44:27.950882 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.950773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-data\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:27.951197 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.951172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-envoy\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:27.951386 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.951368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-socket\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:27.951570 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.951545    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-certs\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:27.951704 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.951579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-podinfo\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:27.951704 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.951605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istiod-ca-cert\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:27.951704 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.951629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-credential-socket\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:27.951704 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.951675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-token\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:27.951952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:27.951739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh76x\" (UniqueName: \"kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-kube-api-access-kh76x\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053253 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-data\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053458 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053270    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-envoy\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053458 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053305    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-socket\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053458 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-certs\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053458 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-podinfo\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053458 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istiod-ca-cert\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053458 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-credential-socket\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053458 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053420    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-token\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053726    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-data\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh76x\" (UniqueName: \"kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-kube-api-access-kh76x\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-socket\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.053879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-certs\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.054078 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.053924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-credential-socket\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.054197 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.054157    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istiod-ca-cert\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.055947 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.055925    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-envoy\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.056157 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.056141    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-podinfo\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.061758 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.061734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-token\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.061968 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.061949    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh76x\" (UniqueName: \"kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-kube-api-access-kh76x\") pod \"e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") " pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.156353 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.156263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:28.437585 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.437557    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"]
Sep 10 14:44:28.439656 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:44:28.439628    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ea06ff_ba5d_4974_aa65_8bc7c2e71cb4.slice/crio-4d1ebbe319528f21f25268f3a570c0b244162bf0006782d23ce4bd2506e13e11 WatchSource:0}: Error finding container 4d1ebbe319528f21f25268f3a570c0b244162bf0006782d23ce4bd2506e13e11: Status 404 returned error can't find the container with id 4d1ebbe319528f21f25268f3a570c0b244162bf0006782d23ce4bd2506e13e11
Sep 10 14:44:28.442006 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.441967    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:44:28.442098 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.442057    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:44:28.442137 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:28.442104    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:44:29.282430 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:29.282391    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" event={"ID":"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4","Type":"ContainerStarted","Data":"b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c"}
Sep 10 14:44:29.283009 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:29.282449    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" event={"ID":"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4","Type":"ContainerStarted","Data":"4d1ebbe319528f21f25268f3a570c0b244162bf0006782d23ce4bd2506e13e11"}
Sep 10 14:44:29.303439 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:29.303384    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" podStartSLOduration=2.303365611 podStartE2EDuration="2.303365611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:44:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:44:29.301085418 +0000 UTC m=+1515.893290189" watchObservedRunningTime="2026-09-10 14:44:29.303365611 +0000 UTC m=+1515.895570380"
Sep 10 14:44:30.156762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:30.156719    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:30.162176 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:30.162146    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:30.287793 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:30.287761    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:30.288712 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:30.288691    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:46.329980 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:46.329925    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 14:44:46.330585 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:46.330001    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 14:44:48.395106 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:48.395073    2579 generic.go:356] "Generic (PLEG): container finished" podID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerID="b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c" exitCode=0
Sep 10 14:44:48.395525 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:48.395150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" event={"ID":"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4","Type":"ContainerDied","Data":"b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c"}
Sep 10 14:44:48.395587 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:48.395573    2579 scope.go:117] "RemoveContainer" containerID="b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c"
Sep 10 14:44:48.396690 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:48.396667    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:44:48.396758 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:48.396729    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:44:48.396813 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:48.396764    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:44:49.403557 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:49.403512    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" event={"ID":"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4","Type":"ContainerStarted","Data":"21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95"}
Sep 10 14:44:50.157078 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:50.157040    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:50.157361 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:50.157331    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 14:44:50.157446 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:50.157398    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 14:44:51.157675 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:51.157632    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 14:44:51.158346 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:51.158309    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 14:44:52.156980 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:52.156937    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 14:44:52.157208 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:52.157010    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 14:44:53.157396 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:53.157360    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 14:44:53.157993 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:53.157957    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 14:44:54.162526 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:54.162480    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 10 14:44:54.163077 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:54.162558    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 10 14:44:55.160540 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:55.160507    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:55.160838 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:55.160814    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:55.161431 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:55.161413    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:44:57.118067 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.118028    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"]
Sep 10 14:44:57.118553 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.118536    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5511fa0a-dac6-4871-9ea6-b4b36dc45888" containerName="istio-proxy"
Sep 10 14:44:57.121838 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.121814    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.124877 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.124853    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-5c43af-openshift-default-dockercfg-9m2zz\""
Sep 10 14:44:57.134702 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.134679    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"]
Sep 10 14:44:57.166149 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.166116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-envoy\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.166149 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.166153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqgzp\" (UniqueName: \"kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-kube-api-access-xqgzp\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.166369 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.166178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istiod-ca-cert\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.166369 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.166200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-certs\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.166369 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.166268    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-socket\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.166369 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.166285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-token\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.166369 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.166341    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-credential-socket\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.166529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.166405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-data\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.166529 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.166441    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-podinfo\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.267604 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.267560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-data\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.267807 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.267621    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-podinfo\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.267807 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.267689    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-envoy\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.267807 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.267717    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqgzp\" (UniqueName: \"kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-kube-api-access-xqgzp\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.267938 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.267807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istiod-ca-cert\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.267938 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.267843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-certs\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.267938 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.267902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-socket\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.267938 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.267930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-token\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.268141 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.268063    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-data\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.268141 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.268079    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-credential-socket\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.268254 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.268207    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-socket\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.268424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.268396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-certs\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.268550 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.268480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istiod-ca-cert\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.268694 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.268675    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-credential-socket\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.270169 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.270138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-envoy\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.270479 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.270458    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-podinfo\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.277461 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.277436    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqgzp\" (UniqueName: \"kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-kube-api-access-xqgzp\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.277551 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.277488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-token\") pod \"e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") " pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.432801 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.432684    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:57.717347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.717320    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"]
Sep 10 14:44:57.719489 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:44:57.719458    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb527ede_f5dc_477f_8ac1_f12a60bb628d.slice/crio-acceabbe51a5e0ef8a5a1530d6aab9ce1fc613669ec6bba428e155e9e1a13b53 WatchSource:0}: Error finding container acceabbe51a5e0ef8a5a1530d6aab9ce1fc613669ec6bba428e155e9e1a13b53: Status 404 returned error can't find the container with id acceabbe51a5e0ef8a5a1530d6aab9ce1fc613669ec6bba428e155e9e1a13b53
Sep 10 14:44:57.721705 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.721673    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:44:57.721773 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.721740    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:44:57.721773 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:57.721766    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:44:58.457452 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:58.457414    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" event={"ID":"fb527ede-f5dc-477f-8ac1-f12a60bb628d","Type":"ContainerStarted","Data":"3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc"}
Sep 10 14:44:58.457858 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:58.457470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" event={"ID":"fb527ede-f5dc-477f-8ac1-f12a60bb628d","Type":"ContainerStarted","Data":"acceabbe51a5e0ef8a5a1530d6aab9ce1fc613669ec6bba428e155e9e1a13b53"}
Sep 10 14:44:58.478522 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:58.478469    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" podStartSLOduration=1.478454256 podStartE2EDuration="1.478454256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:44:58.476823536 +0000 UTC m=+1545.069028305" watchObservedRunningTime="2026-09-10 14:44:58.478454256 +0000 UTC m=+1545.070659024"
Sep 10 14:44:59.433469 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:59.433429    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:59.439005 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:59.438979    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:59.463841 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:59.463803    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:44:59.464884 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:44:59.464863    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:45:00.141040 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.141002    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817525-tznbt"]
Sep 10 14:45:00.145028 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.145001    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-tznbt"
Sep 10 14:45:00.145358 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.145334    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6"]
Sep 10 14:45:00.148700 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.148678    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6"
Sep 10 14:45:00.151826 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.151771    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwr7b\""
Sep 10 14:45:00.159113 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.159082    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-tznbt"
Sep 10 14:45:00.161091 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.160979    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817525-tznbt"]
Sep 10 14:45:00.165769 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.165724    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6"]
Sep 10 14:45:00.170941 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.170913    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6"
Sep 10 14:45:00.452347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.452292    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29817525-tznbt"]
Sep 10 14:45:00.455575 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:45:00.455550    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2acb96a7_6fd9_4f1b_a67b_b3474e043bbe.slice/crio-a527abd39faaeda97e3de9d121d8bc1547c7f52a40d36c80fb262a930a49eb5f WatchSource:0}: Error finding container a527abd39faaeda97e3de9d121d8bc1547c7f52a40d36c80fb262a930a49eb5f: Status 404 returned error can't find the container with id a527abd39faaeda97e3de9d121d8bc1547c7f52a40d36c80fb262a930a49eb5f
Sep 10 14:45:00.456399 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.456374    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6"]
Sep 10 14:45:00.457739 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:45:00.457708    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c36cee9_a49f_429d_b0c8_04d0019459e2.slice/crio-2cba7c1adea6a861a09eac439e04c09987cb321d863034e3224ca558ffe85c39 WatchSource:0}: Error finding container 2cba7c1adea6a861a09eac439e04c09987cb321d863034e3224ca558ffe85c39: Status 404 returned error can't find the container with id 2cba7c1adea6a861a09eac439e04c09987cb321d863034e3224ca558ffe85c39
Sep 10 14:45:00.471426 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.471373    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-tznbt" event={"ID":"2acb96a7-6fd9-4f1b-a67b-b3474e043bbe","Type":"ContainerStarted","Data":"a527abd39faaeda97e3de9d121d8bc1547c7f52a40d36c80fb262a930a49eb5f"}
Sep 10 14:45:00.472964 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:00.472936    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6" event={"ID":"3c36cee9-a49f-429d-b0c8-04d0019459e2","Type":"ContainerStarted","Data":"2cba7c1adea6a861a09eac439e04c09987cb321d863034e3224ca558ffe85c39"}
Sep 10 14:45:01.480023 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:01.479990    2579 generic.go:356] "Generic (PLEG): container finished" podID="3c36cee9-a49f-429d-b0c8-04d0019459e2" containerID="f10dd62b5d53517ae8ea2769bffa777ad4a8a5aacf349dd2502ea3cf980cffa8" exitCode=0
Sep 10 14:45:01.480409 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:01.480070    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6" event={"ID":"3c36cee9-a49f-429d-b0c8-04d0019459e2","Type":"ContainerDied","Data":"f10dd62b5d53517ae8ea2769bffa777ad4a8a5aacf349dd2502ea3cf980cffa8"}
Sep 10 14:45:01.481748 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:01.481723    2579 generic.go:356] "Generic (PLEG): container finished" podID="2acb96a7-6fd9-4f1b-a67b-b3474e043bbe" containerID="c7065c72968682fa27f941d2b5ec439f7fb2ef7780653eeadcecf6d054147642" exitCode=0
Sep 10 14:45:01.481908 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:01.481806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-tznbt" event={"ID":"2acb96a7-6fd9-4f1b-a67b-b3474e043bbe","Type":"ContainerDied","Data":"c7065c72968682fa27f941d2b5ec439f7fb2ef7780653eeadcecf6d054147642"}
Sep 10 14:45:02.139728 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.139686    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"]
Sep 10 14:45:02.143571 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.143551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:45:02.146316 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.146294    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-5c43af\""
Sep 10 14:45:02.146435 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.146345    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-5c43af-dockercfg-lbrkw\""
Sep 10 14:45:02.155054 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.155024    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"]
Sep 10 14:45:02.218225 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.218191    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8015d05f-4d7a-47eb-9162-b39991a1da91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn\" (UID: \"8015d05f-4d7a-47eb-9162-b39991a1da91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:45:02.218424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.218278    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k29fd\" (UniqueName: \"kubernetes.io/projected/8015d05f-4d7a-47eb-9162-b39991a1da91-kube-api-access-k29fd\") pod \"payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn\" (UID: \"8015d05f-4d7a-47eb-9162-b39991a1da91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:45:02.319262 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.319218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8015d05f-4d7a-47eb-9162-b39991a1da91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn\" (UID: \"8015d05f-4d7a-47eb-9162-b39991a1da91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:45:02.319441 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.319338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k29fd\" (UniqueName: \"kubernetes.io/projected/8015d05f-4d7a-47eb-9162-b39991a1da91-kube-api-access-k29fd\") pod \"payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn\" (UID: \"8015d05f-4d7a-47eb-9162-b39991a1da91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:45:02.320062 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.320035    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8015d05f-4d7a-47eb-9162-b39991a1da91-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn\" (UID: \"8015d05f-4d7a-47eb-9162-b39991a1da91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:45:02.328318 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.328290    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k29fd\" (UniqueName: \"kubernetes.io/projected/8015d05f-4d7a-47eb-9162-b39991a1da91-kube-api-access-k29fd\") pod \"payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn\" (UID: \"8015d05f-4d7a-47eb-9162-b39991a1da91\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:45:02.455350 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.455243    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:45:02.691047 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.691022    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6"
Sep 10 14:45:02.693187 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.693170    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-tznbt"
Sep 10 14:45:02.751034 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:02.751003    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"]
Sep 10 14:45:02.752392 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:45:02.752358    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8015d05f_4d7a_47eb_9162_b39991a1da91.slice/crio-a1ac7bd0c04613211fd40617fa5f22b8ed36f5da4a18158a83b461a3276fc269 WatchSource:0}: Error finding container a1ac7bd0c04613211fd40617fa5f22b8ed36f5da4a18158a83b461a3276fc269: Status 404 returned error can't find the container with id a1ac7bd0c04613211fd40617fa5f22b8ed36f5da4a18158a83b461a3276fc269
Sep 10 14:45:03.496164 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:03.496128    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-tznbt"
Sep 10 14:45:03.496164 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:03.496146    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29817525-tznbt" event={"ID":"2acb96a7-6fd9-4f1b-a67b-b3474e043bbe","Type":"ContainerDied","Data":"a527abd39faaeda97e3de9d121d8bc1547c7f52a40d36c80fb262a930a49eb5f"}
Sep 10 14:45:03.496416 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:03.496199    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a527abd39faaeda97e3de9d121d8bc1547c7f52a40d36c80fb262a930a49eb5f"
Sep 10 14:45:03.497733 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:03.497705    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6"
Sep 10 14:45:03.497884 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:03.497737    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6" event={"ID":"3c36cee9-a49f-429d-b0c8-04d0019459e2","Type":"ContainerDied","Data":"2cba7c1adea6a861a09eac439e04c09987cb321d863034e3224ca558ffe85c39"}
Sep 10 14:45:03.497884 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:03.497810    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cba7c1adea6a861a09eac439e04c09987cb321d863034e3224ca558ffe85c39"
Sep 10 14:45:03.499621 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:03.499594    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn" event={"ID":"8015d05f-4d7a-47eb-9162-b39991a1da91","Type":"ContainerStarted","Data":"f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6"}
Sep 10 14:45:03.499767 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:03.499645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn" event={"ID":"8015d05f-4d7a-47eb-9162-b39991a1da91","Type":"ContainerStarted","Data":"a1ac7bd0c04613211fd40617fa5f22b8ed36f5da4a18158a83b461a3276fc269"}
Sep 10 14:45:03.499767 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:03.499753    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:45:03.518074 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:03.518024    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn" podStartSLOduration=1.5180054570000001 podStartE2EDuration="1.518005457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:45:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:45:03.516254982 +0000 UTC m=+1550.108459752" watchObservedRunningTime="2026-09-10 14:45:03.518005457 +0000 UTC m=+1550.110210226"
Sep 10 14:45:14.513863 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:14.513828    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:45:18.604026 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:18.603988    2579 generic.go:356] "Generic (PLEG): container finished" podID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerID="3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc" exitCode=0
Sep 10 14:45:18.604444 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:18.604067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" event={"ID":"fb527ede-f5dc-477f-8ac1-f12a60bb628d","Type":"ContainerDied","Data":"3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc"}
Sep 10 14:45:18.604596 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:18.604579    2579 scope.go:117] "RemoveContainer" containerID="3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc"
Sep 10 14:45:18.605760 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:18.605730    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:45:18.605887 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:18.605838    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:45:18.605952 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:18.605888    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:45:19.611639 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:19.611607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" event={"ID":"fb527ede-f5dc-477f-8ac1-f12a60bb628d","Type":"ContainerStarted","Data":"9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133"}
Sep 10 14:45:20.433423 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:20.433373    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:45:20.433655 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:20.433632    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 10 14:45:20.433705 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:20.433685    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 10 14:45:21.433387 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:21.433347    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 10 14:45:21.433816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:21.433411    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 10 14:45:22.433970 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:22.433929    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 10 14:45:22.434437 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:22.434003    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 10 14:45:23.434231 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:23.434189    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 10 14:45:23.434624 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:23.434263    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 10 14:45:24.433095 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:24.433057    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 10 14:45:24.433308 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:24.433104    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 10 14:45:25.437955 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:25.437919    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:45:25.438347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:25.438252    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:45:25.438905 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:25.438883    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:45:30.423734 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:45:30.423703    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pnm4r_838ce0c1-d8c7-4937-8923-5e52c2e29115/payload-processing/0.log"
Sep 10 14:46:01.073749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.073710    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pnm4r_838ce0c1-d8c7-4937-8923-5e52c2e29115/payload-processing/0.log"
Sep 10 14:46:01.734010 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.733972    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"]
Sep 10 14:46:01.734473 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.734457    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c36cee9-a49f-429d-b0c8-04d0019459e2" containerName="cleanup"
Sep 10 14:46:01.734526 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.734476    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c36cee9-a49f-429d-b0c8-04d0019459e2" containerName="cleanup"
Sep 10 14:46:01.734526 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.734488    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2acb96a7-6fd9-4f1b-a67b-b3474e043bbe" containerName="cleanup"
Sep 10 14:46:01.734526 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.734496    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2acb96a7-6fd9-4f1b-a67b-b3474e043bbe" containerName="cleanup"
Sep 10 14:46:01.734640 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.734567    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c36cee9-a49f-429d-b0c8-04d0019459e2" containerName="cleanup"
Sep 10 14:46:01.734640 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.734577    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2acb96a7-6fd9-4f1b-a67b-b3474e043bbe" containerName="cleanup"
Sep 10 14:46:01.736902 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.736883    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.739727 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.739703    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-268239-openshift-default-dockercfg-98ll5\""
Sep 10 14:46:01.749924 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.749894    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"]
Sep 10 14:46:01.771490 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.771303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf22m\" (UniqueName: \"kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-kube-api-access-xf22m\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.771490 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.771376    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-socket\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.771490 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.771429    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-certs\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.771490 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.771461    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-token\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.771938 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.771679    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-data\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.771938 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.771842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-podinfo\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.771938 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.771911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-credential-socket\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.772099 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.771990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.772099 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.772039    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-envoy\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.873640 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.873600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-data\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.873882 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.873650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-podinfo\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.873882 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.873669    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-credential-socket\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.873882 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.873698    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.873882 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.873715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-envoy\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.873882 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.873767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf22m\" (UniqueName: \"kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-kube-api-access-xf22m\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.873882 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.873845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-socket\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.874222 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.873893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-certs\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.874222 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.873914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-token\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.874222 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.874186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-data\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.874342 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.874240    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-credential-socket\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.874378 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.874346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-socket\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.874378 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.874364    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-certs\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.874714 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.874695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.877073 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.877044    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-envoy\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.877969 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.877949    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-podinfo\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.882190 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.882165    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-token\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:01.882638 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:01.882615    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf22m\" (UniqueName: \"kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-kube-api-access-xf22m\") pod \"e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") " pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:02.050009 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:02.049969    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:02.329411 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:02.329383    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"]
Sep 10 14:46:02.331281 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:46:02.331253    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a57bca0_1ada_49f0_a05d_f9006c4bc62d.slice/crio-3ff288321e2031450d61c98377cc90ce024202cbc239eecbceec2d284b8600c5 WatchSource:0}: Error finding container 3ff288321e2031450d61c98377cc90ce024202cbc239eecbceec2d284b8600c5: Status 404 returned error can't find the container with id 3ff288321e2031450d61c98377cc90ce024202cbc239eecbceec2d284b8600c5
Sep 10 14:46:02.334105 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:02.334073    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:46:02.334194 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:02.334137    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:46:02.334194 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:02.334166    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:46:02.867726 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:02.867693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" event={"ID":"3a57bca0-1ada-49f0-a05d-f9006c4bc62d","Type":"ContainerStarted","Data":"8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6"}
Sep 10 14:46:02.867942 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:02.867768    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" event={"ID":"3a57bca0-1ada-49f0-a05d-f9006c4bc62d","Type":"ContainerStarted","Data":"3ff288321e2031450d61c98377cc90ce024202cbc239eecbceec2d284b8600c5"}
Sep 10 14:46:02.889660 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:02.889604    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" podStartSLOduration=1.889586233 podStartE2EDuration="1.889586233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:46:02.88614118 +0000 UTC m=+1609.478345965" watchObservedRunningTime="2026-09-10 14:46:02.889586233 +0000 UTC m=+1609.481791002"
Sep 10 14:46:03.050512 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:03.050469    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:03.056244 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:03.056214    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:03.873776 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:03.873742    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:03.874728 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:03.874707    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:06.772004 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:06.771924    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"]
Sep 10 14:46:06.774620 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:06.774602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:06.778455 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:06.778435    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-268239\""
Sep 10 14:46:06.778682 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:06.778662    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-268239-dockercfg-sp29p\""
Sep 10 14:46:06.794421 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:06.794391    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"]
Sep 10 14:46:06.828492 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:06.828457    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/197810f8-d1f9-4e0a-9903-19bc005c766d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh\" (UID: \"197810f8-d1f9-4e0a-9903-19bc005c766d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:06.828679 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:06.828500    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmxzw\" (UniqueName: \"kubernetes.io/projected/197810f8-d1f9-4e0a-9903-19bc005c766d-kube-api-access-fmxzw\") pod \"payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh\" (UID: \"197810f8-d1f9-4e0a-9903-19bc005c766d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:06.929633 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:06.929589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/197810f8-d1f9-4e0a-9903-19bc005c766d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh\" (UID: \"197810f8-d1f9-4e0a-9903-19bc005c766d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:06.929826 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:06.929647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmxzw\" (UniqueName: \"kubernetes.io/projected/197810f8-d1f9-4e0a-9903-19bc005c766d-kube-api-access-fmxzw\") pod \"payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh\" (UID: \"197810f8-d1f9-4e0a-9903-19bc005c766d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:06.930322 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:06.930300    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/197810f8-d1f9-4e0a-9903-19bc005c766d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh\" (UID: \"197810f8-d1f9-4e0a-9903-19bc005c766d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:06.937926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:06.937894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmxzw\" (UniqueName: \"kubernetes.io/projected/197810f8-d1f9-4e0a-9903-19bc005c766d-kube-api-access-fmxzw\") pod \"payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh\" (UID: \"197810f8-d1f9-4e0a-9903-19bc005c766d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:07.086351 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:07.086265    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:07.361516 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:07.361437    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"]
Sep 10 14:46:07.365006 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:46:07.364972    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod197810f8_d1f9_4e0a_9903_19bc005c766d.slice/crio-97104c07bcdb6129f552bc61c2b2f914fa2b530adc1ddfc79e46f1b1332f50ca WatchSource:0}: Error finding container 97104c07bcdb6129f552bc61c2b2f914fa2b530adc1ddfc79e46f1b1332f50ca: Status 404 returned error can't find the container with id 97104c07bcdb6129f552bc61c2b2f914fa2b530adc1ddfc79e46f1b1332f50ca
Sep 10 14:46:07.912401 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:07.912368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh" event={"ID":"197810f8-d1f9-4e0a-9903-19bc005c766d","Type":"ContainerStarted","Data":"282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1"}
Sep 10 14:46:07.912767 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:07.912432    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:07.912767 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:07.912453    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh" event={"ID":"197810f8-d1f9-4e0a-9903-19bc005c766d","Type":"ContainerStarted","Data":"97104c07bcdb6129f552bc61c2b2f914fa2b530adc1ddfc79e46f1b1332f50ca"}
Sep 10 14:46:07.927606 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:07.927555    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh" podStartSLOduration=1.927537623 podStartE2EDuration="1.927537623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:46:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:46:07.926370152 +0000 UTC m=+1614.518574921" watchObservedRunningTime="2026-09-10 14:46:07.927537623 +0000 UTC m=+1614.519742393"
Sep 10 14:46:18.917725 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:18.917686    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:25.025091 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:25.025059    2579 generic.go:356] "Generic (PLEG): container finished" podID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerID="8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6" exitCode=0
Sep 10 14:46:25.025559 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:25.025132    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" event={"ID":"3a57bca0-1ada-49f0-a05d-f9006c4bc62d","Type":"ContainerDied","Data":"8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6"}
Sep 10 14:46:25.025608 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:25.025569    2579 scope.go:117] "RemoveContainer" containerID="8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6"
Sep 10 14:46:25.026804 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:25.026757    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:46:25.026868 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:25.026853    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:46:25.026912 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:25.026891    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 10 14:46:26.033580 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:26.033546    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" event={"ID":"3a57bca0-1ada-49f0-a05d-f9006c4bc62d","Type":"ContainerStarted","Data":"797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24"}
Sep 10 14:46:26.050373 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:26.050342    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:26.050564 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:26.050545    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 10 14:46:26.050613 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:26.050595    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 10 14:46:27.050522 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:27.050487    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 10 14:46:27.050955 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:27.050539    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 10 14:46:28.050804 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:28.050741    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 10 14:46:28.051201 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:28.050837    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 10 14:46:29.050316 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:29.050281    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 10 14:46:29.050522 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:29.050333    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 10 14:46:30.050751 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:30.050713    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 10 14:46:30.051177 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:30.050809    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 10 14:46:31.051389 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:31.051347    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 10 14:46:31.051804 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:31.051415    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 10 14:46:32.054542 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:32.054515    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:32.054951 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:32.054891    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:32.055702 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:32.055683    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:36.421404 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:36.421358    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"]
Sep 10 14:46:36.421888 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:36.421641    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh" podUID="197810f8-d1f9-4e0a-9903-19bc005c766d" containerName="payload-pre-processing" containerID="cri-o://282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1" gracePeriod=30
Sep 10 14:46:36.676417 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:36.676340    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:36.760535 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:36.759987    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmxzw\" (UniqueName: \"kubernetes.io/projected/197810f8-d1f9-4e0a-9903-19bc005c766d-kube-api-access-fmxzw\") pod \"197810f8-d1f9-4e0a-9903-19bc005c766d\" (UID: \"197810f8-d1f9-4e0a-9903-19bc005c766d\") "
Sep 10 14:46:36.761600 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:36.761019    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/197810f8-d1f9-4e0a-9903-19bc005c766d-plugins-config-volume\") pod \"197810f8-d1f9-4e0a-9903-19bc005c766d\" (UID: \"197810f8-d1f9-4e0a-9903-19bc005c766d\") "
Sep 10 14:46:36.761600 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:36.761549    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/197810f8-d1f9-4e0a-9903-19bc005c766d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "197810f8-d1f9-4e0a-9903-19bc005c766d" (UID: "197810f8-d1f9-4e0a-9903-19bc005c766d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:46:36.763053 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:36.763019    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/197810f8-d1f9-4e0a-9903-19bc005c766d-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:46:36.771543 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:36.771499    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/197810f8-d1f9-4e0a-9903-19bc005c766d-kube-api-access-fmxzw" (OuterVolumeSpecName: "kube-api-access-fmxzw") pod "197810f8-d1f9-4e0a-9903-19bc005c766d" (UID: "197810f8-d1f9-4e0a-9903-19bc005c766d"). InnerVolumeSpecName "kube-api-access-fmxzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:46:36.863602 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:36.863561    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmxzw\" (UniqueName: \"kubernetes.io/projected/197810f8-d1f9-4e0a-9903-19bc005c766d-kube-api-access-fmxzw\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:46:37.100653 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:37.100616    2579 generic.go:356] "Generic (PLEG): container finished" podID="197810f8-d1f9-4e0a-9903-19bc005c766d" containerID="282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1" exitCode=0
Sep 10 14:46:37.100870 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:37.100665    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"
Sep 10 14:46:37.100870 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:37.100669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh" event={"ID":"197810f8-d1f9-4e0a-9903-19bc005c766d","Type":"ContainerDied","Data":"282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1"}
Sep 10 14:46:37.100870 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:37.100816    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh" event={"ID":"197810f8-d1f9-4e0a-9903-19bc005c766d","Type":"ContainerDied","Data":"97104c07bcdb6129f552bc61c2b2f914fa2b530adc1ddfc79e46f1b1332f50ca"}
Sep 10 14:46:37.100870 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:37.100848    2579 scope.go:117] "RemoveContainer" containerID="282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1"
Sep 10 14:46:37.111138 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:37.111118    2579 scope.go:117] "RemoveContainer" containerID="282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1"
Sep 10 14:46:37.111440 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:46:37.111418    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1\": container with ID starting with 282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1 not found: ID does not exist" containerID="282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1"
Sep 10 14:46:37.111499 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:37.111451    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1"} err="failed to get container status \"282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1\": rpc error: code = NotFound desc = could not find container \"282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1\": container with ID starting with 282b870c17e044ec414fc2ca2d6e8279dc43777a927b6ce02951a84155ccb8e1 not found: ID does not exist"
Sep 10 14:46:37.126508 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:37.126478    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"]
Sep 10 14:46:37.128572 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:37.128550    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-268239-79c5568b4b-qkwdh"]
Sep 10 14:46:37.912853 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:37.912821    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="197810f8-d1f9-4e0a-9903-19bc005c766d" path="/var/lib/kubelet/pods/197810f8-d1f9-4e0a-9903-19bc005c766d/volumes"
Sep 10 14:46:43.163925 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:43.163891    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"]
Sep 10 14:46:43.164408 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:43.164106    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy" containerID="cri-o://797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24" gracePeriod=30
Sep 10 14:46:47.057321 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:47.057282    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:46:47.057700 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:47.057352    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:46:48.424664 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.424599    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:48.483505 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.483474    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-socket\") pod \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") "
Sep 10 14:46:48.483649 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.483534    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-credential-socket\") pod \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") "
Sep 10 14:46:48.483649 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.483611    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-envoy\") pod \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") "
Sep 10 14:46:48.483833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.483649    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-token\") pod \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") "
Sep 10 14:46:48.483833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.483698    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf22m\" (UniqueName: \"kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-kube-api-access-xf22m\") pod \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") "
Sep 10 14:46:48.483833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.483744    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istiod-ca-cert\") pod \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") "
Sep 10 14:46:48.483833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.483814    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-certs\") pod \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") "
Sep 10 14:46:48.484045 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.483826    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a57bca0-1ada-49f0-a05d-f9006c4bc62d" (UID: "3a57bca0-1ada-49f0-a05d-f9006c4bc62d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:46:48.484045 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.483850    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a57bca0-1ada-49f0-a05d-f9006c4bc62d" (UID: "3a57bca0-1ada-49f0-a05d-f9006c4bc62d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:46:48.484045 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.483840    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-data\") pod \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") "
Sep 10 14:46:48.484045 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.483937    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-podinfo\") pod \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\" (UID: \"3a57bca0-1ada-49f0-a05d-f9006c4bc62d\") "
Sep 10 14:46:48.484250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.484043    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a57bca0-1ada-49f0-a05d-f9006c4bc62d" (UID: "3a57bca0-1ada-49f0-a05d-f9006c4bc62d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:46:48.484250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.484057    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a57bca0-1ada-49f0-a05d-f9006c4bc62d" (UID: "3a57bca0-1ada-49f0-a05d-f9006c4bc62d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:46:48.484250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.484205    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a57bca0-1ada-49f0-a05d-f9006c4bc62d" (UID: "3a57bca0-1ada-49f0-a05d-f9006c4bc62d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:46:48.484580 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.484374    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:46:48.484580 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.484396    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:46:48.484580 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.484411    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:46:48.484580 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.484434    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:46:48.484815 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.484577    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:46:48.486049 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.486020    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-kube-api-access-xf22m" (OuterVolumeSpecName: "kube-api-access-xf22m") pod "3a57bca0-1ada-49f0-a05d-f9006c4bc62d" (UID: "3a57bca0-1ada-49f0-a05d-f9006c4bc62d"). InnerVolumeSpecName "kube-api-access-xf22m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:46:48.486172 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.486027    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a57bca0-1ada-49f0-a05d-f9006c4bc62d" (UID: "3a57bca0-1ada-49f0-a05d-f9006c4bc62d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:46:48.486172 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.486111    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a57bca0-1ada-49f0-a05d-f9006c4bc62d" (UID: "3a57bca0-1ada-49f0-a05d-f9006c4bc62d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:46:48.486248 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.486194    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a57bca0-1ada-49f0-a05d-f9006c4bc62d" (UID: "3a57bca0-1ada-49f0-a05d-f9006c4bc62d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:46:48.585395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.585348    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:46:48.585395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.585387    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:46:48.585395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.585397    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf22m\" (UniqueName: \"kubernetes.io/projected/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-kube-api-access-xf22m\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:46:48.585395 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:48.585406    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57bca0-1ada-49f0-a05d-f9006c4bc62d-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:46:49.173041 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.173007    2579 generic.go:356] "Generic (PLEG): container finished" podID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerID="797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24" exitCode=0
Sep 10 14:46:49.173227 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.173059    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"
Sep 10 14:46:49.173227 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.173089    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" event={"ID":"3a57bca0-1ada-49f0-a05d-f9006c4bc62d","Type":"ContainerDied","Data":"797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24"}
Sep 10 14:46:49.173227 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.173150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc" event={"ID":"3a57bca0-1ada-49f0-a05d-f9006c4bc62d","Type":"ContainerDied","Data":"3ff288321e2031450d61c98377cc90ce024202cbc239eecbceec2d284b8600c5"}
Sep 10 14:46:49.173227 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.173181    2579 scope.go:117] "RemoveContainer" containerID="797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24"
Sep 10 14:46:49.183949 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.183926    2579 scope.go:117] "RemoveContainer" containerID="8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6"
Sep 10 14:46:49.194130 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.194108    2579 scope.go:117] "RemoveContainer" containerID="797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24"
Sep 10 14:46:49.194504 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:46:49.194479    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24\": container with ID starting with 797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24 not found: ID does not exist" containerID="797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24"
Sep 10 14:46:49.194563 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.194522    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24"} err="failed to get container status \"797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24\": rpc error: code = NotFound desc = could not find container \"797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24\": container with ID starting with 797c7c665bcb9a105ceeabdf1b905e6a7cd0386b5929b64adb29addd57a1de24 not found: ID does not exist"
Sep 10 14:46:49.194563 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.194549    2579 scope.go:117] "RemoveContainer" containerID="8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6"
Sep 10 14:46:49.194893 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:46:49.194872    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6\": container with ID starting with 8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6 not found: ID does not exist" containerID="8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6"
Sep 10 14:46:49.194971 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.194901    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6"} err="failed to get container status \"8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6\": rpc error: code = NotFound desc = could not find container \"8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6\": container with ID starting with 8eccd853384b0559a882e60f4a15afe97e039b60cf668ea1316181d05ef919a6 not found: ID does not exist"
Sep 10 14:46:49.196123 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.196106    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"]
Sep 10 14:46:49.199649 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.199627    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-268239-openshift-default-54cf57b9dd-fgstc"]
Sep 10 14:46:49.912549 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:46:49.912513    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" path="/var/lib/kubelet/pods/3a57bca0-1ada-49f0-a05d-f9006c4bc62d/volumes"
Sep 10 14:47:02.248862 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:02.248823    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6"]
Sep 10 14:47:02.251159 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:02.251126    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-42514d-29817525-cs4c6"]
Sep 10 14:47:03.912743 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:03.912707    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c36cee9-a49f-429d-b0c8-04d0019459e2" path="/var/lib/kubelet/pods/3c36cee9-a49f-429d-b0c8-04d0019459e2/volumes"
Sep 10 14:47:50.596607 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:50.596522    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"]
Sep 10 14:47:50.597164 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:50.596795    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy" containerID="cri-o://21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95" gracePeriod=30
Sep 10 14:47:55.163769 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.163730    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:47:55.164176 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.163821    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:47:55.851980 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.851958    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:47:55.970926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.970837    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-data\") pod \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") "
Sep 10 14:47:55.970926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.970874    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-envoy\") pod \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") "
Sep 10 14:47:55.970926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.970900    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-token\") pod \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") "
Sep 10 14:47:55.970926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.970924    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-certs\") pod \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") "
Sep 10 14:47:55.971260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.970976    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-socket\") pod \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") "
Sep 10 14:47:55.971260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971000    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istiod-ca-cert\") pod \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") "
Sep 10 14:47:55.971260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971053    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh76x\" (UniqueName: \"kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-kube-api-access-kh76x\") pod \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") "
Sep 10 14:47:55.971260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971082    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-podinfo\") pod \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") "
Sep 10 14:47:55.971260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971153    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-credential-socket\") pod \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\" (UID: \"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4\") "
Sep 10 14:47:55.971260 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971227    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-data" (OuterVolumeSpecName: "istio-data") pod "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" (UID: "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:55.971536 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971302    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" (UID: "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:55.971536 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971343    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" (UID: "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:55.971536 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971420    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" (UID: "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:47:55.971702 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971559    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" (UID: "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:55.971930 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971900    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:47:55.971930 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971932    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:47:55.972133 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971947    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:47:55.972133 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971961    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:47:55.972133 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.971975    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:47:55.973290 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.973258    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" (UID: "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:47:55.973385 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.973370    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" (UID: "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:47:55.973472 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.973453    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-token" (OuterVolumeSpecName: "istio-token") pod "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" (UID: "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:47:55.973566 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:55.973550    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-kube-api-access-kh76x" (OuterVolumeSpecName: "kube-api-access-kh76x") pod "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" (UID: "89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4"). InnerVolumeSpecName "kube-api-access-kh76x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:47:56.072715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.072677    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:47:56.072715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.072708    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:47:56.072715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.072717    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh76x\" (UniqueName: \"kubernetes.io/projected/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-kube-api-access-kh76x\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:47:56.072964 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.072726    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:47:56.562835 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.562802    2579 generic.go:356] "Generic (PLEG): container finished" podID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerID="21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95" exitCode=0
Sep 10 14:47:56.562835 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.562840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" event={"ID":"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4","Type":"ContainerDied","Data":"21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95"}
Sep 10 14:47:56.563363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.562850    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"
Sep 10 14:47:56.563363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.562882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4" event={"ID":"89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4","Type":"ContainerDied","Data":"4d1ebbe319528f21f25268f3a570c0b244162bf0006782d23ce4bd2506e13e11"}
Sep 10 14:47:56.563363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.562903    2579 scope.go:117] "RemoveContainer" containerID="21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95"
Sep 10 14:47:56.573301 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.573282    2579 scope.go:117] "RemoveContainer" containerID="b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c"
Sep 10 14:47:56.582587 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.582563    2579 scope.go:117] "RemoveContainer" containerID="21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95"
Sep 10 14:47:56.582918 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:47:56.582896    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95\": container with ID starting with 21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95 not found: ID does not exist" containerID="21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95"
Sep 10 14:47:56.583000 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.582933    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95"} err="failed to get container status \"21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95\": rpc error: code = NotFound desc = could not find container \"21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95\": container with ID starting with 21f17bdd15ef1ca619ea19876bf9f49222700f5248441114a5785749d2a90a95 not found: ID does not exist"
Sep 10 14:47:56.583000 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.582957    2579 scope.go:117] "RemoveContainer" containerID="b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c"
Sep 10 14:47:56.583254 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:47:56.583236    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c\": container with ID starting with b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c not found: ID does not exist" containerID="b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c"
Sep 10 14:47:56.583303 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.583263    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c"} err="failed to get container status \"b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c\": rpc error: code = NotFound desc = could not find container \"b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c\": container with ID starting with b7c3f290fb5eac4979cc49ba26643173c23e884046070216f2cf6a673f8a850c not found: ID does not exist"
Sep 10 14:47:56.587162 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.587136    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"]
Sep 10 14:47:56.591713 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:56.591691    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-42514d-openshift-default-54ccc688db-mslt4"]
Sep 10 14:47:57.912283 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:47:57.912249    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" path="/var/lib/kubelet/pods/89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4/volumes"
Sep 10 14:48:01.832708 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:01.832663    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"]
Sep 10 14:48:01.833250 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:01.832943    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn" podUID="8015d05f-4d7a-47eb-9162-b39991a1da91" containerName="payload-pre-processing" containerID="cri-o://f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6" gracePeriod=30
Sep 10 14:48:02.099727 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.099646    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:48:02.243030 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.242986    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8015d05f-4d7a-47eb-9162-b39991a1da91-plugins-config-volume\") pod \"8015d05f-4d7a-47eb-9162-b39991a1da91\" (UID: \"8015d05f-4d7a-47eb-9162-b39991a1da91\") "
Sep 10 14:48:02.243218 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.243087    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k29fd\" (UniqueName: \"kubernetes.io/projected/8015d05f-4d7a-47eb-9162-b39991a1da91-kube-api-access-k29fd\") pod \"8015d05f-4d7a-47eb-9162-b39991a1da91\" (UID: \"8015d05f-4d7a-47eb-9162-b39991a1da91\") "
Sep 10 14:48:02.243411 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.243386    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8015d05f-4d7a-47eb-9162-b39991a1da91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8015d05f-4d7a-47eb-9162-b39991a1da91" (UID: "8015d05f-4d7a-47eb-9162-b39991a1da91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:48:02.245982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.245951    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8015d05f-4d7a-47eb-9162-b39991a1da91-kube-api-access-k29fd" (OuterVolumeSpecName: "kube-api-access-k29fd") pod "8015d05f-4d7a-47eb-9162-b39991a1da91" (UID: "8015d05f-4d7a-47eb-9162-b39991a1da91"). InnerVolumeSpecName "kube-api-access-k29fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:48:02.343972 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.343941    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8015d05f-4d7a-47eb-9162-b39991a1da91-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:02.343972 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.343968    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k29fd\" (UniqueName: \"kubernetes.io/projected/8015d05f-4d7a-47eb-9162-b39991a1da91-kube-api-access-k29fd\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:02.600630 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.600591    2579 generic.go:356] "Generic (PLEG): container finished" podID="8015d05f-4d7a-47eb-9162-b39991a1da91" containerID="f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6" exitCode=0
Sep 10 14:48:02.600855 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.600639    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"
Sep 10 14:48:02.600855 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.600678    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn" event={"ID":"8015d05f-4d7a-47eb-9162-b39991a1da91","Type":"ContainerDied","Data":"f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6"}
Sep 10 14:48:02.600855 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.600731    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn" event={"ID":"8015d05f-4d7a-47eb-9162-b39991a1da91","Type":"ContainerDied","Data":"a1ac7bd0c04613211fd40617fa5f22b8ed36f5da4a18158a83b461a3276fc269"}
Sep 10 14:48:02.600855 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.600752    2579 scope.go:117] "RemoveContainer" containerID="f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6"
Sep 10 14:48:02.610374 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.610354    2579 scope.go:117] "RemoveContainer" containerID="f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6"
Sep 10 14:48:02.610711 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:48:02.610690    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6\": container with ID starting with f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6 not found: ID does not exist" containerID="f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6"
Sep 10 14:48:02.610767 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.610721    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6"} err="failed to get container status \"f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6\": rpc error: code = NotFound desc = could not find container \"f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6\": container with ID starting with f7372222e3b8626c6137e5acfc034ee8c4e54a668b3d10171ba25b028296f8b6 not found: ID does not exist"
Sep 10 14:48:02.621796 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.621749    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"]
Sep 10 14:48:02.627385 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:02.627350    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-5c43af-779c6457cd-hmdjn"]
Sep 10 14:48:03.912741 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:03.912704    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8015d05f-4d7a-47eb-9162-b39991a1da91" path="/var/lib/kubelet/pods/8015d05f-4d7a-47eb-9162-b39991a1da91/volumes"
Sep 10 14:48:08.588822 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:08.588766    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"]
Sep 10 14:48:08.589227 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:08.589055    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy" containerID="cri-o://9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133" gracePeriod=30
Sep 10 14:48:10.440860 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:10.440815    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 14:48:10.441323 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:10.440882    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 14:48:13.846113 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.846079    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:48:13.960758 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.960668    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqgzp\" (UniqueName: \"kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-kube-api-access-xqgzp\") pod \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") "
Sep 10 14:48:13.960758 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.960752    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-data\") pod \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") "
Sep 10 14:48:13.960979 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.960811    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-podinfo\") pod \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") "
Sep 10 14:48:13.960979 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.960863    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-credential-socket\") pod \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") "
Sep 10 14:48:13.960979 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.960897    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-socket\") pod \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") "
Sep 10 14:48:13.960979 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.960944    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-envoy\") pod \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") "
Sep 10 14:48:13.960979 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.960972    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-certs\") pod \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") "
Sep 10 14:48:13.961228 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.961006    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-token\") pod \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") "
Sep 10 14:48:13.961228 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.961053    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istiod-ca-cert\") pod \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\" (UID: \"fb527ede-f5dc-477f-8ac1-f12a60bb628d\") "
Sep 10 14:48:13.961228 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.961132    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fb527ede-f5dc-477f-8ac1-f12a60bb628d" (UID: "fb527ede-f5dc-477f-8ac1-f12a60bb628d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:13.961228 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.961212    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fb527ede-f5dc-477f-8ac1-f12a60bb628d" (UID: "fb527ede-f5dc-477f-8ac1-f12a60bb628d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:13.961456 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.961223    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fb527ede-f5dc-477f-8ac1-f12a60bb628d" (UID: "fb527ede-f5dc-477f-8ac1-f12a60bb628d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:13.961456 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.961287    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-data" (OuterVolumeSpecName: "istio-data") pod "fb527ede-f5dc-477f-8ac1-f12a60bb628d" (UID: "fb527ede-f5dc-477f-8ac1-f12a60bb628d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:13.961568 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.961517    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:13.961568 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.961533    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:13.961568 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.961546    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:13.961568 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.961559    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:13.961969 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.961652    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fb527ede-f5dc-477f-8ac1-f12a60bb628d" (UID: "fb527ede-f5dc-477f-8ac1-f12a60bb628d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:48:13.963137 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.963106    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-kube-api-access-xqgzp" (OuterVolumeSpecName: "kube-api-access-xqgzp") pod "fb527ede-f5dc-477f-8ac1-f12a60bb628d" (UID: "fb527ede-f5dc-477f-8ac1-f12a60bb628d"). InnerVolumeSpecName "kube-api-access-xqgzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:48:13.963273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.963180    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fb527ede-f5dc-477f-8ac1-f12a60bb628d" (UID: "fb527ede-f5dc-477f-8ac1-f12a60bb628d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:13.963672 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.963653    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fb527ede-f5dc-477f-8ac1-f12a60bb628d" (UID: "fb527ede-f5dc-477f-8ac1-f12a60bb628d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:48:13.963742 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:13.963655    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-token" (OuterVolumeSpecName: "istio-token") pod "fb527ede-f5dc-477f-8ac1-f12a60bb628d" (UID: "fb527ede-f5dc-477f-8ac1-f12a60bb628d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:48:14.062983 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.062951    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:14.062983 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.062978    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:14.062983 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.062987    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:14.063221 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.062995    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqgzp\" (UniqueName: \"kubernetes.io/projected/fb527ede-f5dc-477f-8ac1-f12a60bb628d-kube-api-access-xqgzp\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:14.063221 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.063005    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb527ede-f5dc-477f-8ac1-f12a60bb628d-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:14.669377 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.669341    2579 generic.go:356] "Generic (PLEG): container finished" podID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerID="9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133" exitCode=0
Sep 10 14:48:14.669843 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.669388    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"
Sep 10 14:48:14.669843 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.669421    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" event={"ID":"fb527ede-f5dc-477f-8ac1-f12a60bb628d","Type":"ContainerDied","Data":"9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133"}
Sep 10 14:48:14.669843 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.669478    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6" event={"ID":"fb527ede-f5dc-477f-8ac1-f12a60bb628d","Type":"ContainerDied","Data":"acceabbe51a5e0ef8a5a1530d6aab9ce1fc613669ec6bba428e155e9e1a13b53"}
Sep 10 14:48:14.669843 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.669508    2579 scope.go:117] "RemoveContainer" containerID="9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133"
Sep 10 14:48:14.679031 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.679013    2579 scope.go:117] "RemoveContainer" containerID="3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc"
Sep 10 14:48:14.687901 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.687877    2579 scope.go:117] "RemoveContainer" containerID="9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133"
Sep 10 14:48:14.688200 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:48:14.688177    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133\": container with ID starting with 9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133 not found: ID does not exist" containerID="9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133"
Sep 10 14:48:14.688261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.688210    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133"} err="failed to get container status \"9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133\": rpc error: code = NotFound desc = could not find container \"9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133\": container with ID starting with 9fdfcba024a87c0c710f77d9fa700e4cfc28d4f45fca71cbeabb53e27b07c133 not found: ID does not exist"
Sep 10 14:48:14.688261 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.688230    2579 scope.go:117] "RemoveContainer" containerID="3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc"
Sep 10 14:48:14.688570 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:48:14.688542    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc\": container with ID starting with 3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc not found: ID does not exist" containerID="3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc"
Sep 10 14:48:14.688628 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.688579    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc"} err="failed to get container status \"3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc\": rpc error: code = NotFound desc = could not find container \"3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc\": container with ID starting with 3752326e8a6df1f62fccf6a600d90d0eaaf92d5446e1b46244f2816b30baaffc not found: ID does not exist"
Sep 10 14:48:14.692101 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.692077    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"]
Sep 10 14:48:14.695599 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:14.695574    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-5c43af-openshift-default-7b76f6b85b-wk7j6"]
Sep 10 14:48:15.912956 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:15.912923    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" path="/var/lib/kubelet/pods/fb527ede-f5dc-477f-8ac1-f12a60bb628d/volumes"
Sep 10 14:48:19.374733 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.374697    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"]
Sep 10 14:48:19.375376 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.375318    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp" podUID="d10cf3b6-4756-485e-803f-0b41a0faa671" containerName="payload-pre-processing" containerID="cri-o://655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011" gracePeriod=30
Sep 10 14:48:19.642183 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.642157    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:48:19.701659 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.701623    2579 generic.go:356] "Generic (PLEG): container finished" podID="d10cf3b6-4756-485e-803f-0b41a0faa671" containerID="655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011" exitCode=0
Sep 10 14:48:19.701899 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.701698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp" event={"ID":"d10cf3b6-4756-485e-803f-0b41a0faa671","Type":"ContainerDied","Data":"655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011"}
Sep 10 14:48:19.701899 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.701704    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"
Sep 10 14:48:19.701899 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.701752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp" event={"ID":"d10cf3b6-4756-485e-803f-0b41a0faa671","Type":"ContainerDied","Data":"2b1753ad2f93cabcfdda6e6e18e88ef92db4b8c40e62e855e4deacfefb0b4630"}
Sep 10 14:48:19.701899 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.701814    2579 scope.go:117] "RemoveContainer" containerID="655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011"
Sep 10 14:48:19.712967 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.712911    2579 scope.go:117] "RemoveContainer" containerID="655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011"
Sep 10 14:48:19.713475 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:48:19.713434    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011\": container with ID starting with 655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011 not found: ID does not exist" containerID="655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011"
Sep 10 14:48:19.713586 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.713497    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011"} err="failed to get container status \"655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011\": rpc error: code = NotFound desc = could not find container \"655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011\": container with ID starting with 655d6e2b149db0ba519efd7ecca3ab25ecf116a598fec2a08045e1c7cf193011 not found: ID does not exist"
Sep 10 14:48:19.814039 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.814001    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d10cf3b6-4756-485e-803f-0b41a0faa671-plugins-config-volume\") pod \"d10cf3b6-4756-485e-803f-0b41a0faa671\" (UID: \"d10cf3b6-4756-485e-803f-0b41a0faa671\") "
Sep 10 14:48:19.814039 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.814039    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv9l7\" (UniqueName: \"kubernetes.io/projected/d10cf3b6-4756-485e-803f-0b41a0faa671-kube-api-access-zv9l7\") pod \"d10cf3b6-4756-485e-803f-0b41a0faa671\" (UID: \"d10cf3b6-4756-485e-803f-0b41a0faa671\") "
Sep 10 14:48:19.814415 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.814391    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d10cf3b6-4756-485e-803f-0b41a0faa671-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d10cf3b6-4756-485e-803f-0b41a0faa671" (UID: "d10cf3b6-4756-485e-803f-0b41a0faa671"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:48:19.816269 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.816244    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d10cf3b6-4756-485e-803f-0b41a0faa671-kube-api-access-zv9l7" (OuterVolumeSpecName: "kube-api-access-zv9l7") pod "d10cf3b6-4756-485e-803f-0b41a0faa671" (UID: "d10cf3b6-4756-485e-803f-0b41a0faa671"). InnerVolumeSpecName "kube-api-access-zv9l7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:48:19.914994 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.914911    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d10cf3b6-4756-485e-803f-0b41a0faa671-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:19.914994 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:19.914938    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv9l7\" (UniqueName: \"kubernetes.io/projected/d10cf3b6-4756-485e-803f-0b41a0faa671-kube-api-access-zv9l7\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:20.018964 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:20.018930    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"]
Sep 10 14:48:20.022771 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:20.022742    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-7bf16f-7bd5896978-hngjp"]
Sep 10 14:48:21.912361 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:21.912325    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d10cf3b6-4756-485e-803f-0b41a0faa671" path="/var/lib/kubelet/pods/d10cf3b6-4756-485e-803f-0b41a0faa671/volumes"
Sep 10 14:48:26.126635 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:26.126597    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"]
Sep 10 14:48:26.127175 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:26.126840    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy" containerID="cri-o://b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4" gracePeriod=30
Sep 10 14:48:31.376749 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.376720    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:48:31.407390 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.407305    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fd4t2\" (UniqueName: \"kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-kube-api-access-fd4t2\") pod \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") "
Sep 10 14:48:31.407390 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.407366    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-data\") pod \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") "
Sep 10 14:48:31.407616 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.407398    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-token\") pod \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") "
Sep 10 14:48:31.407616 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.407434    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-envoy\") pod \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") "
Sep 10 14:48:31.407616 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.407501    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-podinfo\") pod \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") "
Sep 10 14:48:31.407616 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.407544    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-credential-socket\") pod \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") "
Sep 10 14:48:31.407616 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.407568    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-socket\") pod \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") "
Sep 10 14:48:31.407906 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.407620    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istiod-ca-cert\") pod \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") "
Sep 10 14:48:31.407906 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.407661    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-certs\") pod \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\" (UID: \"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b\") "
Sep 10 14:48:31.407906 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.407659    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-data" (OuterVolumeSpecName: "istio-data") pod "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" (UID: "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:31.408071 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.408034    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" (UID: "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:48:31.408134 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.408041    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:31.408308 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.408256    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" (UID: "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:31.408308 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.408287    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" (UID: "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:31.408460 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.408432    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" (UID: "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:31.409750 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.409727    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-kube-api-access-fd4t2" (OuterVolumeSpecName: "kube-api-access-fd4t2") pod "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" (UID: "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b"). InnerVolumeSpecName "kube-api-access-fd4t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:48:31.410112 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.410088    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" (UID: "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:48:31.410323 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.410300    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-token" (OuterVolumeSpecName: "istio-token") pod "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" (UID: "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:48:31.410382 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.410355    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" (UID: "5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:31.509052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.509013    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fd4t2\" (UniqueName: \"kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-kube-api-access-fd4t2\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:31.509052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.509046    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:31.509052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.509056    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:31.509052 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.509063    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:31.509336 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.509071    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:31.509336 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.509080    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:31.509336 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.509088    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:31.509336 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.509095    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:31.767834 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.767769    2579 generic.go:356] "Generic (PLEG): container finished" podID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerID="b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4" exitCode=0
Sep 10 14:48:31.767834 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.767815    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" event={"ID":"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b","Type":"ContainerDied","Data":"b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4"}
Sep 10 14:48:31.768048 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.767848    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"
Sep 10 14:48:31.768048 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.767871    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk" event={"ID":"5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b","Type":"ContainerDied","Data":"9717e9db5493b8e063c05f183ae6467599a62d48ee277a7d4ba7ede947c0a858"}
Sep 10 14:48:31.768048 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.767895    2579 scope.go:117] "RemoveContainer" containerID="b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4"
Sep 10 14:48:31.777541 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.777521    2579 scope.go:117] "RemoveContainer" containerID="7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83"
Sep 10 14:48:31.786317 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.786291    2579 scope.go:117] "RemoveContainer" containerID="b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4"
Sep 10 14:48:31.786609 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:48:31.786588    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4\": container with ID starting with b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4 not found: ID does not exist" containerID="b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4"
Sep 10 14:48:31.786660 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.786619    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4"} err="failed to get container status \"b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4\": rpc error: code = NotFound desc = could not find container \"b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4\": container with ID starting with b936d007dbb1e0819c0ca48b02e246edd5c4802a92529ecf4cc0abefed3ceeb4 not found: ID does not exist"
Sep 10 14:48:31.786660 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.786638    2579 scope.go:117] "RemoveContainer" containerID="7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83"
Sep 10 14:48:31.786997 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:48:31.786971    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83\": container with ID starting with 7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83 not found: ID does not exist" containerID="7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83"
Sep 10 14:48:31.787105 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.787006    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83"} err="failed to get container status \"7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83\": rpc error: code = NotFound desc = could not find container \"7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83\": container with ID starting with 7f298e3ccbb57f2d9e5f940c507139e549dd158d57f74640be0b553bf923de83 not found: ID does not exist"
Sep 10 14:48:31.790363 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.790338    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"]
Sep 10 14:48:31.797439 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.797413    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-7bf16f-openshift-default-5c7b5f8fc6-pwssk"]
Sep 10 14:48:31.912109 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:31.912074    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" path="/var/lib/kubelet/pods/5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b/volumes"
Sep 10 14:48:36.946173 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:36.946138    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"]
Sep 10 14:48:36.946598 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:36.946381    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx" podUID="e6de9741-867e-4e71-83d1-4c3f90d79894" containerName="payload-pre-processing" containerID="cri-o://81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c" gracePeriod=30
Sep 10 14:48:37.207441 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.207373    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:48:37.255411 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.255373    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6de9741-867e-4e71-83d1-4c3f90d79894-plugins-config-volume\") pod \"e6de9741-867e-4e71-83d1-4c3f90d79894\" (UID: \"e6de9741-867e-4e71-83d1-4c3f90d79894\") "
Sep 10 14:48:37.255582 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.255443    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s62st\" (UniqueName: \"kubernetes.io/projected/e6de9741-867e-4e71-83d1-4c3f90d79894-kube-api-access-s62st\") pod \"e6de9741-867e-4e71-83d1-4c3f90d79894\" (UID: \"e6de9741-867e-4e71-83d1-4c3f90d79894\") "
Sep 10 14:48:37.255796 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.255757    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6de9741-867e-4e71-83d1-4c3f90d79894-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e6de9741-867e-4e71-83d1-4c3f90d79894" (UID: "e6de9741-867e-4e71-83d1-4c3f90d79894"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:48:37.257694 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.257665    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6de9741-867e-4e71-83d1-4c3f90d79894-kube-api-access-s62st" (OuterVolumeSpecName: "kube-api-access-s62st") pod "e6de9741-867e-4e71-83d1-4c3f90d79894" (UID: "e6de9741-867e-4e71-83d1-4c3f90d79894"). InnerVolumeSpecName "kube-api-access-s62st". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:48:37.356268 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.356233    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e6de9741-867e-4e71-83d1-4c3f90d79894-plugins-config-volume\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:37.356268 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.356265    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s62st\" (UniqueName: \"kubernetes.io/projected/e6de9741-867e-4e71-83d1-4c3f90d79894-kube-api-access-s62st\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:37.802602 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.802565    2579 generic.go:356] "Generic (PLEG): container finished" podID="e6de9741-867e-4e71-83d1-4c3f90d79894" containerID="81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c" exitCode=0
Sep 10 14:48:37.802833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.802631    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"
Sep 10 14:48:37.802833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.802644    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx" event={"ID":"e6de9741-867e-4e71-83d1-4c3f90d79894","Type":"ContainerDied","Data":"81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c"}
Sep 10 14:48:37.802833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.802690    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx" event={"ID":"e6de9741-867e-4e71-83d1-4c3f90d79894","Type":"ContainerDied","Data":"b372abfbd172d32e272e48418bd5e4d59deeafbf8aab59e03271bc33ddc444e9"}
Sep 10 14:48:37.802833 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.802716    2579 scope.go:117] "RemoveContainer" containerID="81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c"
Sep 10 14:48:37.812922 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.812901    2579 scope.go:117] "RemoveContainer" containerID="81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c"
Sep 10 14:48:37.813238 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:48:37.813218    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c\": container with ID starting with 81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c not found: ID does not exist" containerID="81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c"
Sep 10 14:48:37.813328 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.813246    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c"} err="failed to get container status \"81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c\": rpc error: code = NotFound desc = could not find container \"81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c\": container with ID starting with 81065b0bc413f7cb2c3b0ec90e3bf5fd7d4199d304a2a62e700bd001fb486b8c not found: ID does not exist"
Sep 10 14:48:37.824412 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.824383    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"]
Sep 10 14:48:37.828877 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.828852    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-59dc59-dccf565d6-tcqjx"]
Sep 10 14:48:37.912453 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:37.912420    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6de9741-867e-4e71-83d1-4c3f90d79894" path="/var/lib/kubelet/pods/e6de9741-867e-4e71-83d1-4c3f90d79894/volumes"
Sep 10 14:48:43.686416 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:43.686381    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"]
Sep 10 14:48:43.686861 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:43.686627    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy" containerID="cri-o://4b4a60144ec1e9418e05760514297f03a7426ef017e79123ece89823911867be" gracePeriod=30
Sep 10 14:48:48.875136 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:48.875100    2579 generic.go:356] "Generic (PLEG): container finished" podID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerID="4b4a60144ec1e9418e05760514297f03a7426ef017e79123ece89823911867be" exitCode=0
Sep 10 14:48:48.875608 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:48.875176    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" event={"ID":"394d8fb4-8d73-4698-9795-70523b4c3ee0","Type":"ContainerDied","Data":"4b4a60144ec1e9418e05760514297f03a7426ef017e79123ece89823911867be"}
Sep 10 14:48:48.875608 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:48.875253    2579 scope.go:117] "RemoveContainer" containerID="c2c2e0b3b6bb3c46d24a577071949f86ecdb26a8ab56f48ea20d5e676bd82a7a"
Sep 10 14:48:48.955424 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:48.955361    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:48:49.062296 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.062250    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-envoy\") pod \"394d8fb4-8d73-4698-9795-70523b4c3ee0\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") "
Sep 10 14:48:49.062465 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.062375    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-data\") pod \"394d8fb4-8d73-4698-9795-70523b4c3ee0\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") "
Sep 10 14:48:49.062465 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.062413    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-podinfo\") pod \"394d8fb4-8d73-4698-9795-70523b4c3ee0\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") "
Sep 10 14:48:49.062465 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.062439    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-credential-socket\") pod \"394d8fb4-8d73-4698-9795-70523b4c3ee0\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") "
Sep 10 14:48:49.062465 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.062463    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-certs\") pod \"394d8fb4-8d73-4698-9795-70523b4c3ee0\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") "
Sep 10 14:48:49.062680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.062532    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-socket\") pod \"394d8fb4-8d73-4698-9795-70523b4c3ee0\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") "
Sep 10 14:48:49.062680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.062561    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6jxn\" (UniqueName: \"kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-kube-api-access-x6jxn\") pod \"394d8fb4-8d73-4698-9795-70523b4c3ee0\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") "
Sep 10 14:48:49.062680 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.062626    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/394d8fb4-8d73-4698-9795-70523b4c3ee0-istiod-ca-cert\") pod \"394d8fb4-8d73-4698-9795-70523b4c3ee0\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") "
Sep 10 14:48:49.062812 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.062706    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-data" (OuterVolumeSpecName: "istio-data") pod "394d8fb4-8d73-4698-9795-70523b4c3ee0" (UID: "394d8fb4-8d73-4698-9795-70523b4c3ee0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:49.063401 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.063325    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "394d8fb4-8d73-4698-9795-70523b4c3ee0" (UID: "394d8fb4-8d73-4698-9795-70523b4c3ee0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:49.063609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.063538    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "394d8fb4-8d73-4698-9795-70523b4c3ee0" (UID: "394d8fb4-8d73-4698-9795-70523b4c3ee0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:49.063609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.063563    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "394d8fb4-8d73-4698-9795-70523b4c3ee0" (UID: "394d8fb4-8d73-4698-9795-70523b4c3ee0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:49.063609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.062677    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-token\") pod \"394d8fb4-8d73-4698-9795-70523b4c3ee0\" (UID: \"394d8fb4-8d73-4698-9795-70523b4c3ee0\") "
Sep 10 14:48:49.064127 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.064089    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/394d8fb4-8d73-4698-9795-70523b4c3ee0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "394d8fb4-8d73-4698-9795-70523b4c3ee0" (UID: "394d8fb4-8d73-4698-9795-70523b4c3ee0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:48:49.066816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.064495    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/394d8fb4-8d73-4698-9795-70523b4c3ee0-istiod-ca-cert\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:49.066816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.064536    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-data\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:49.066816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.064553    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-credential-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:49.066816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.064569    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:49.066816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.064584    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-workload-socket\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:49.066816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.065154    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "394d8fb4-8d73-4698-9795-70523b4c3ee0" (UID: "394d8fb4-8d73-4698-9795-70523b4c3ee0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 14:48:49.066816 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.066719    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-token" (OuterVolumeSpecName: "istio-token") pod "394d8fb4-8d73-4698-9795-70523b4c3ee0" (UID: "394d8fb4-8d73-4698-9795-70523b4c3ee0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:48:49.067926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.067899    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-kube-api-access-x6jxn" (OuterVolumeSpecName: "kube-api-access-x6jxn") pod "394d8fb4-8d73-4698-9795-70523b4c3ee0" (UID: "394d8fb4-8d73-4698-9795-70523b4c3ee0"). InnerVolumeSpecName "kube-api-access-x6jxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:48:49.074031 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.073997    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "394d8fb4-8d73-4698-9795-70523b4c3ee0" (UID: "394d8fb4-8d73-4698-9795-70523b4c3ee0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 14:48:49.165997 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.165962    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6jxn\" (UniqueName: \"kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-kube-api-access-x6jxn\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:49.165997 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.165994    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-token\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:49.165997 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.166005    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-envoy\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:49.166236 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.166014    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/394d8fb4-8d73-4698-9795-70523b4c3ee0-istio-podinfo\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:48:49.881493 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.881456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg" event={"ID":"394d8fb4-8d73-4698-9795-70523b4c3ee0","Type":"ContainerDied","Data":"bc36150deda5e48c12823fc633bf7583c034554a210435ea715e931207b2bd52"}
Sep 10 14:48:49.881961 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.881500    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"
Sep 10 14:48:49.881961 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.881555    2579 scope.go:117] "RemoveContainer" containerID="4b4a60144ec1e9418e05760514297f03a7426ef017e79123ece89823911867be"
Sep 10 14:48:49.903151 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.903118    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"]
Sep 10 14:48:49.912290 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:49.912267    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-59dc59-openshift-default-7f8744ddb4-mhjvg"]
Sep 10 14:48:51.912296 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:48:51.912249    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" path="/var/lib/kubelet/pods/394d8fb4-8d73-4698-9795-70523b4c3ee0/volumes"
Sep 10 14:49:14.024306 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:49:14.024277    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:49:14.025434 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:49:14.025413    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:49:14.031515 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:49:14.031490    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:49:14.032656 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:49:14.032633    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:50:14.288522 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:50:14.288482    2579 scope.go:117] "RemoveContainer" containerID="5ab6047d15ef5cf6dc5946a0cde99af2cfaaf206fcaae939faf92e3266f28d66"
Sep 10 14:51:14.309120 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:51:14.309086    2579 scope.go:117] "RemoveContainer" containerID="f10dd62b5d53517ae8ea2769bffa777ad4a8a5aacf349dd2502ea3cf980cffa8"
Sep 10 14:54:14.065521 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:14.065496    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:54:14.068086 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:14.068060    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:54:14.072679 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:14.072655    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:54:14.075123 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:14.075101    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:54:29.808521 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808478    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"]
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808869    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808882    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808892    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808897    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808904    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="197810f8-d1f9-4e0a-9903-19bc005c766d" containerName="payload-pre-processing"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808909    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="197810f8-d1f9-4e0a-9903-19bc005c766d" containerName="payload-pre-processing"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808915    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808920    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808927    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808935    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808940    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808945    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808955    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8015d05f-4d7a-47eb-9162-b39991a1da91" containerName="payload-pre-processing"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808960    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8015d05f-4d7a-47eb-9162-b39991a1da91" containerName="payload-pre-processing"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808966    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808971    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808982    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808987    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.808995    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809000    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809012    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d10cf3b6-4756-485e-803f-0b41a0faa671" containerName="payload-pre-processing"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809017    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d10cf3b6-4756-485e-803f-0b41a0faa671" containerName="payload-pre-processing"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809023    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6de9741-867e-4e71-83d1-4c3f90d79894" containerName="payload-pre-processing"
Sep 10 14:54:29.809037 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809028    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6de9741-867e-4e71-83d1-4c3f90d79894" containerName="payload-pre-processing"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809092    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809099    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809106    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809112    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809119    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809127    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6de9741-867e-4e71-83d1-4c3f90d79894" containerName="payload-pre-processing"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809141    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8015d05f-4d7a-47eb-9162-b39991a1da91" containerName="payload-pre-processing"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809147    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fcf7760-0d7a-4c95-bfa9-53f9b30f7a7b" containerName="istio-proxy"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809155    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809161    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d10cf3b6-4756-485e-803f-0b41a0faa671" containerName="payload-pre-processing"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809166    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="197810f8-d1f9-4e0a-9903-19bc005c766d" containerName="payload-pre-processing"
Sep 10 14:54:29.810003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.809171    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb527ede-f5dc-477f-8ac1-f12a60bb628d" containerName="istio-proxy"
Sep 10 14:54:29.812205 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.812184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:29.816089 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.816061    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 14:54:29.816270 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.816142    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 14:54:29.816270 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.816233    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-vgr2z\""
Sep 10 14:54:29.822897 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.822858    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"]
Sep 10 14:54:29.906427 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.906390    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-metrics-certs\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:29.906609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.906435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8ljg\" (UniqueName: \"kubernetes.io/projected/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-kube-api-access-m8ljg\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:29.906609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.906541    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-maas-api-tls\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:29.906609 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:29.906600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-openshift-service-ca\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:30.007110 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.007073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-metrics-certs\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:30.007283 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.007119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8ljg\" (UniqueName: \"kubernetes.io/projected/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-kube-api-access-m8ljg\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:30.007283 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.007179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-maas-api-tls\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:30.007283 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.007231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-openshift-service-ca\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:30.007916 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.007892    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-openshift-service-ca\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:30.009857 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.009834    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-maas-api-tls\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:30.009960 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.009905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-metrics-certs\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:30.015763 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.015733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8ljg\" (UniqueName: \"kubernetes.io/projected/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-kube-api-access-m8ljg\") pod \"maas-api-f96f74b55-7nhpj\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") " pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:30.125954 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.125870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:30.398858 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.398706    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"]
Sep 10 14:54:30.401174 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:54:30.401146    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d22f90e_00e5_4e56_9e7d_1d8b389425a0.slice/crio-e27e5195b44145cb9c4bf1c6d56bc5f0e991a5acd0eb666b98b34e9a95ae181d WatchSource:0}: Error finding container e27e5195b44145cb9c4bf1c6d56bc5f0e991a5acd0eb666b98b34e9a95ae181d: Status 404 returned error can't find the container with id e27e5195b44145cb9c4bf1c6d56bc5f0e991a5acd0eb666b98b34e9a95ae181d
Sep 10 14:54:30.402531 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.402513    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 14:54:30.624436 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:30.624400    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj" event={"ID":"5d22f90e-00e5-4e56-9e7d-1d8b389425a0","Type":"ContainerStarted","Data":"e27e5195b44145cb9c4bf1c6d56bc5f0e991a5acd0eb666b98b34e9a95ae181d"}
Sep 10 14:54:33.643295 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:33.643262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj" event={"ID":"5d22f90e-00e5-4e56-9e7d-1d8b389425a0","Type":"ContainerStarted","Data":"ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9"}
Sep 10 14:54:33.643714 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:33.643407    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:33.663393 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:33.663338    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj" podStartSLOduration=2.319131099 podStartE2EDuration="4.663322206s" totalImagesPullingTime="2.344191107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:54:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:54:33.661107019 +0000 UTC m=+2120.253311795" watchObservedRunningTime="2026-09-10 14:54:33.663322206 +0000 UTC m=+2120.255526975"
Sep 10 14:54:37.965735 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:37.965696    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"]
Sep 10 14:54:37.966254 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:37.965951    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj" podUID="5d22f90e-00e5-4e56-9e7d-1d8b389425a0" containerName="maas-api" containerID="cri-o://ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9" gracePeriod=30
Sep 10 14:54:37.971959 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:37.971931    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:37.995995 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:37.995965    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"]
Sep 10 14:54:37.996605 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:37.996585    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy"
Sep 10 14:54:37.996663 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:37.996612    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a57bca0-1ada-49f0-a05d-f9006c4bc62d" containerName="istio-proxy"
Sep 10 14:54:37.996663 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:37.996629    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy"
Sep 10 14:54:37.996663 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:37.996638    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy"
Sep 10 14:54:37.996768 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:37.996756    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="89ea06ff-ba5d-4974-aa65-8bc7c2e71cb4" containerName="istio-proxy"
Sep 10 14:54:37.996832 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:37.996795    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="394d8fb4-8d73-4698-9795-70523b4c3ee0" containerName="istio-proxy"
Sep 10 14:54:38.000322 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.000302    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.013975 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.013948    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"]
Sep 10 14:54:38.081414 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.081370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b3ba049-69ba-4652-b24e-10180170f37d-openshift-service-ca\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.081603 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.081438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b3ba049-69ba-4652-b24e-10180170f37d-maas-api-tls\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.081603 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.081486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z7hx\" (UniqueName: \"kubernetes.io/projected/8b3ba049-69ba-4652-b24e-10180170f37d-kube-api-access-4z7hx\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.081730 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.081605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b3ba049-69ba-4652-b24e-10180170f37d-metrics-certs\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.182911 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.182878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b3ba049-69ba-4652-b24e-10180170f37d-metrics-certs\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.183088 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.182927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b3ba049-69ba-4652-b24e-10180170f37d-openshift-service-ca\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.183088 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.182959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b3ba049-69ba-4652-b24e-10180170f37d-maas-api-tls\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.183088 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.182997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z7hx\" (UniqueName: \"kubernetes.io/projected/8b3ba049-69ba-4652-b24e-10180170f37d-kube-api-access-4z7hx\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.184186 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.184154    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b3ba049-69ba-4652-b24e-10180170f37d-openshift-service-ca\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.185880 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.185853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b3ba049-69ba-4652-b24e-10180170f37d-metrics-certs\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.186402 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.186380    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b3ba049-69ba-4652-b24e-10180170f37d-maas-api-tls\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.191376 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.191350    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z7hx\" (UniqueName: \"kubernetes.io/projected/8b3ba049-69ba-4652-b24e-10180170f37d-kube-api-access-4z7hx\") pod \"maas-api-54bf7886c5-5v5cq\" (UID: \"8b3ba049-69ba-4652-b24e-10180170f37d\") " pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.236360 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.236325    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:38.283762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.283335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-maas-api-tls\") pod \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") "
Sep 10 14:54:38.283762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.283401    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8ljg\" (UniqueName: \"kubernetes.io/projected/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-kube-api-access-m8ljg\") pod \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") "
Sep 10 14:54:38.283762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.283437    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-metrics-certs\") pod \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") "
Sep 10 14:54:38.283762 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.283512    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-openshift-service-ca\") pod \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\" (UID: \"5d22f90e-00e5-4e56-9e7d-1d8b389425a0\") "
Sep 10 14:54:38.285137 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.284139    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d22f90e-00e5-4e56-9e7d-1d8b389425a0" (UID: "5d22f90e-00e5-4e56-9e7d-1d8b389425a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 14:54:38.286926 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.286886    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5d22f90e-00e5-4e56-9e7d-1d8b389425a0" (UID: "5d22f90e-00e5-4e56-9e7d-1d8b389425a0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:54:38.287047 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.286981    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-kube-api-access-m8ljg" (OuterVolumeSpecName: "kube-api-access-m8ljg") pod "5d22f90e-00e5-4e56-9e7d-1d8b389425a0" (UID: "5d22f90e-00e5-4e56-9e7d-1d8b389425a0"). InnerVolumeSpecName "kube-api-access-m8ljg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 14:54:38.287651 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.287633    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d22f90e-00e5-4e56-9e7d-1d8b389425a0" (UID: "5d22f90e-00e5-4e56-9e7d-1d8b389425a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 14:54:38.344267 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.344217    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:38.385982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.385943    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-openshift-service-ca\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:54:38.385982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.385982    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-maas-api-tls\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:54:38.385982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.385993    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8ljg\" (UniqueName: \"kubernetes.io/projected/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-kube-api-access-m8ljg\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:54:38.386273 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.386001    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d22f90e-00e5-4e56-9e7d-1d8b389425a0-metrics-certs\") on node \"ip-10-0-128-234.ec2.internal\" DevicePath \"\""
Sep 10 14:54:38.625178 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.625150    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"]
Sep 10 14:54:38.627581 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:54:38.627550    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b3ba049_69ba_4652_b24e_10180170f37d.slice/crio-caee2cf262cfda9ae60730507c987cda86387e52dd8c0aadce9f82d6199a7a8e WatchSource:0}: Error finding container caee2cf262cfda9ae60730507c987cda86387e52dd8c0aadce9f82d6199a7a8e: Status 404 returned error can't find the container with id caee2cf262cfda9ae60730507c987cda86387e52dd8c0aadce9f82d6199a7a8e
Sep 10 14:54:38.668959 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.668925    2579 generic.go:356] "Generic (PLEG): container finished" podID="5d22f90e-00e5-4e56-9e7d-1d8b389425a0" containerID="ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9" exitCode=0
Sep 10 14:54:38.669138 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.668970    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"
Sep 10 14:54:38.669138 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.669007    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj" event={"ID":"5d22f90e-00e5-4e56-9e7d-1d8b389425a0","Type":"ContainerDied","Data":"ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9"}
Sep 10 14:54:38.669138 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.669058    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj" event={"ID":"5d22f90e-00e5-4e56-9e7d-1d8b389425a0","Type":"ContainerDied","Data":"e27e5195b44145cb9c4bf1c6d56bc5f0e991a5acd0eb666b98b34e9a95ae181d"}
Sep 10 14:54:38.669138 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.669080    2579 scope.go:117] "RemoveContainer" containerID="ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9"
Sep 10 14:54:38.670555 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.670533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq" event={"ID":"8b3ba049-69ba-4652-b24e-10180170f37d","Type":"ContainerStarted","Data":"caee2cf262cfda9ae60730507c987cda86387e52dd8c0aadce9f82d6199a7a8e"}
Sep 10 14:54:38.678767 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.678744    2579 scope.go:117] "RemoveContainer" containerID="ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9"
Sep 10 14:54:38.679101 ip-10-0-128-234 kubenswrapper[2579]: E0910 14:54:38.679082    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9\": container with ID starting with ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9 not found: ID does not exist" containerID="ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9"
Sep 10 14:54:38.679170 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.679114    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9"} err="failed to get container status \"ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9\": rpc error: code = NotFound desc = could not find container \"ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9\": container with ID starting with ae663c7b039f2ee5f66630ce0b5cdbe4a1d7d89e81f29d327031191abc95a0d9 not found: ID does not exist"
Sep 10 14:54:38.691244 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.691215    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"]
Sep 10 14:54:38.693686 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:38.693662    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-f96f74b55-7nhpj"]
Sep 10 14:54:39.677708 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:39.677668    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq" event={"ID":"8b3ba049-69ba-4652-b24e-10180170f37d","Type":"ContainerStarted","Data":"7b60985938277e2b0bb3d48e6bd26af36c9fc5b14c5d466345f5f3fee3da9cdc"}
Sep 10 14:54:39.678158 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:39.677731    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:54:39.697720 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:39.697659    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq" podStartSLOduration=2.163917961 podStartE2EDuration="2.697643305s" totalImagesPullingTime="533.725344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 14:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:54:39.695433831 +0000 UTC m=+2126.287638600" watchObservedRunningTime="2026-09-10 14:54:39.697643305 +0000 UTC m=+2126.289848075"
Sep 10 14:54:39.912110 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:39.912073    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d22f90e-00e5-4e56-9e7d-1d8b389425a0" path="/var/lib/kubelet/pods/5d22f90e-00e5-4e56-9e7d-1d8b389425a0/volumes"
Sep 10 14:54:45.690032 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:54:45.689995    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-54bf7886c5-5v5cq"
Sep 10 14:55:05.126987 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:05.126908    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-plks6_df522869-cf63-447b-a6dc-66419f23e2a6/manager/0.log"
Sep 10 14:55:05.345516 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:05.345489    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c47c8c9b-s5fd5_35846642-5bc2-4163-9215-ffcdb453de8c/copy-manifests/0.log"
Sep 10 14:55:05.352073 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:05.352045    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c47c8c9b-s5fd5_35846642-5bc2-4163-9215-ffcdb453de8c/manager/0.log"
Sep 10 14:55:15.824128 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:15.824095    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-54bf7886c5-5v5cq_8b3ba049-69ba-4652-b24e-10180170f37d/maas-api/0.log"
Sep 10 14:55:16.051528 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:16.051501    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817510-n8xkb_a2598a15-13a6-41f4-bfee-663e5d642ac7/cleanup/0.log"
Sep 10 14:55:16.166774 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:16.166685    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29817525-tznbt_2acb96a7-6fd9-4f1b-a67b-b3474e043bbe/cleanup/0.log"
Sep 10 14:55:26.277016 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:26.276987    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-z8wzc_ca9f00d6-438b-4527-b763-5bac44945905/postgres/0.log"
Sep 10 14:55:38.267854 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:38.267813    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jz98w_036eb260-51a4-430b-98cf-6dc9435cf7b0/discovery/0.log"
Sep 10 14:55:38.605003 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:38.604922    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b42t5_925f958d-3adb-4f93-ab09-1d510e1cdad0/istio-proxy/1.log"
Sep 10 14:55:38.719021 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:38.718987    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-45qrv_192699cd-bd0a-4468-817b-fadd320e305e/payload-pre-processing/0.log"
Sep 10 14:55:38.840419 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:38.840388    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pnm4r_838ce0c1-d8c7-4937-8923-5e52c2e29115/payload-processing/0.log"
Sep 10 14:55:38.954331 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:38.954244    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56968c8f6-wb7q7_3d0eff48-1682-45f1-a3c4-2f2f0a8f4732/router/0.log"
Sep 10 14:55:39.729172 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:55:39.729137    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fthqnk_2416c181-4386-49f2-8cef-88f5184fb18b/main/0.log"
Sep 10 14:56:07.812894 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:07.812864    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6mxcc_1b37115a-c43a-48ef-a1dc-165c5db50d22/global-pull-secret-syncer/0.log"
Sep 10 14:56:07.981930 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:07.981899    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xtcfw_192fda0e-5194-4acb-b418-b9438ce1c6d4/konnectivity-agent/0.log"
Sep 10 14:56:08.000190 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:08.000152    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-234.ec2.internal_8ff62f84e60801540483596fbfafdb74/haproxy/0.log"
Sep 10 14:56:14.641705 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:14.641672    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-jhpqg_6d08be70-1756-4f7d-9f95-d387672ceea0/cluster-monitoring-operator/0.log"
Sep 10 14:56:14.665889 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:14.665855    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-l7bvm_535fe263-5e53-46b0-9b73-9cbbed34a1b4/kube-state-metrics/0.log"
Sep 10 14:56:14.683070 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:14.683044    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-l7bvm_535fe263-5e53-46b0-9b73-9cbbed34a1b4/kube-rbac-proxy-main/0.log"
Sep 10 14:56:14.704707 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:14.704681    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-l7bvm_535fe263-5e53-46b0-9b73-9cbbed34a1b4/kube-rbac-proxy-self/0.log"
Sep 10 14:56:14.791133 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:14.791100    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tzcr_f3ffab79-8933-46ce-9496-15055479e49f/node-exporter/0.log"
Sep 10 14:56:14.809566 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:14.809522    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tzcr_f3ffab79-8933-46ce-9496-15055479e49f/kube-rbac-proxy/0.log"
Sep 10 14:56:14.825840 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:14.825813    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tzcr_f3ffab79-8933-46ce-9496-15055479e49f/init-textfile/0.log"
Sep 10 14:56:15.108190 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:15.108161    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6ce5f1d-9a66-4903-8553-5cabfbbd56e1/prometheus/0.log"
Sep 10 14:56:15.135069 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:15.135040    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6ce5f1d-9a66-4903-8553-5cabfbbd56e1/config-reloader/0.log"
Sep 10 14:56:15.154740 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:15.154711    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6ce5f1d-9a66-4903-8553-5cabfbbd56e1/thanos-sidecar/0.log"
Sep 10 14:56:15.177479 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:15.177449    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6ce5f1d-9a66-4903-8553-5cabfbbd56e1/kube-rbac-proxy-web/0.log"
Sep 10 14:56:15.193821 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:15.193774    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6ce5f1d-9a66-4903-8553-5cabfbbd56e1/kube-rbac-proxy/0.log"
Sep 10 14:56:15.213476 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:15.213448    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6ce5f1d-9a66-4903-8553-5cabfbbd56e1/kube-rbac-proxy-thanos/0.log"
Sep 10 14:56:15.231068 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:15.231048    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e6ce5f1d-9a66-4903-8553-5cabfbbd56e1/init-config-reloader/0.log"
Sep 10 14:56:15.309118 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:15.309058    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-kfqtm_2326e8e8-1494-441a-bf3a-e0a4d51d19d3/prometheus-operator-admission-webhook/0.log"
Sep 10 14:56:16.917829 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:16.917804    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-sc5ml_979ab872-4173-4dd3-846f-9e1a53f155b6/networking-console-plugin/0.log"
Sep 10 14:56:17.528429 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:17.528397    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/2.log"
Sep 10 14:56:17.533185 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:17.533158    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-ktd97_d2ce7bd1-dd3e-4318-b1dd-61c1862e0aca/console-operator/3.log"
Sep 10 14:56:18.121948 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.121915    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-r4bvz_f2a5fa75-ef93-42d4-973c-f57f5bad88ea/download-server/0.log"
Sep 10 14:56:18.239991 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.239957    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"]
Sep 10 14:56:18.240595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.240560    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d22f90e-00e5-4e56-9e7d-1d8b389425a0" containerName="maas-api"
Sep 10 14:56:18.240595 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.240587    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d22f90e-00e5-4e56-9e7d-1d8b389425a0" containerName="maas-api"
Sep 10 14:56:18.240837 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.240712    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d22f90e-00e5-4e56-9e7d-1d8b389425a0" containerName="maas-api"
Sep 10 14:56:18.243879 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.243856    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.246560 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.246539    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4xhnq\"/\"default-dockercfg-24sbf\""
Sep 10 14:56:18.246560 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.246551    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4xhnq\"/\"kube-root-ca.crt\""
Sep 10 14:56:18.246750 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.246614    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4xhnq\"/\"openshift-service-ca.crt\""
Sep 10 14:56:18.252686 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.252661    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"]
Sep 10 14:56:18.306502 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.306460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-sys\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.306502 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.306508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-lib-modules\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.306713 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.306637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-podres\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.306713 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.306667    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-proc\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.306823 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.306751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmfnb\" (UniqueName: \"kubernetes.io/projected/f6a83135-f792-477c-a6c5-92e5b98db0d3-kube-api-access-qmfnb\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.408352 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.408254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-podres\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.408352 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.408294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-proc\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.408589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.408415    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmfnb\" (UniqueName: \"kubernetes.io/projected/f6a83135-f792-477c-a6c5-92e5b98db0d3-kube-api-access-qmfnb\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.408589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.408435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-sys\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.408589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.408453    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-podres\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.408589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.408453    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-proc\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.408589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.408460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-lib-modules\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.408589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.408543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-sys\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.408589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.408559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6a83135-f792-477c-a6c5-92e5b98db0d3-lib-modules\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.417081 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.417047    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmfnb\" (UniqueName: \"kubernetes.io/projected/f6a83135-f792-477c-a6c5-92e5b98db0d3-kube-api-access-qmfnb\") pod \"perf-node-gather-daemonset-cwfxd\" (UID: \"f6a83135-f792-477c-a6c5-92e5b98db0d3\") " pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.556021 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.555986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:18.826199 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.826168    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-pgtlm_d4109b1b-3105-4cc8-a5a2-b25d67f53b88/volume-data-source-validator/0.log"
Sep 10 14:56:18.839229 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:18.839199    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"]
Sep 10 14:56:18.844721 ip-10-0-128-234 kubenswrapper[2579]: W0910 14:56:18.844690    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf6a83135_f792_477c_a6c5_92e5b98db0d3.slice/crio-4a50b72dc6344e4c7cbe6b8fc910a3507598f07b591fd30b6b4505fad3b6065d WatchSource:0}: Error finding container 4a50b72dc6344e4c7cbe6b8fc910a3507598f07b591fd30b6b4505fad3b6065d: Status 404 returned error can't find the container with id 4a50b72dc6344e4c7cbe6b8fc910a3507598f07b591fd30b6b4505fad3b6065d
Sep 10 14:56:19.197389 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:19.197281    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd" event={"ID":"f6a83135-f792-477c-a6c5-92e5b98db0d3","Type":"ContainerStarted","Data":"b5751440580afdf15797b0b7b648366d65aebbdf64b2bb6fd7df8d55f13c1b95"}
Sep 10 14:56:19.197389 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:19.197345    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd" event={"ID":"f6a83135-f792-477c-a6c5-92e5b98db0d3","Type":"ContainerStarted","Data":"4a50b72dc6344e4c7cbe6b8fc910a3507598f07b591fd30b6b4505fad3b6065d"}
Sep 10 14:56:19.197389 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:19.197368    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:19.215460 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:19.215401    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd" podStartSLOduration=1.215383582 podStartE2EDuration="1.215383582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 14:56:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 14:56:19.213142503 +0000 UTC m=+2225.805347267" watchObservedRunningTime="2026-09-10 14:56:19.215383582 +0000 UTC m=+2225.807588350"
Sep 10 14:56:20.082085 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:20.082061    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9w8m7_989f9a38-9519-496d-a488-3febe9badc7a/dns/0.log"
Sep 10 14:56:20.100611 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:20.100585    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9w8m7_989f9a38-9519-496d-a488-3febe9badc7a/kube-rbac-proxy/0.log"
Sep 10 14:56:20.167730 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:20.167703    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-67gs2_0fce03b0-6f05-4349-9b98-a5598a3ccf49/dns-node-resolver/0.log"
Sep 10 14:56:20.810180 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:20.810150    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7nftt_782ecfa1-a54e-4937-8e35-0af8b48c5706/node-ca/0.log"
Sep 10 14:56:21.917665 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:21.917634    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jz98w_036eb260-51a4-430b-98cf-6dc9435cf7b0/discovery/0.log"
Sep 10 14:56:21.989150 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:21.989117    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b42t5_925f958d-3adb-4f93-ab09-1d510e1cdad0/istio-proxy/0.log"
Sep 10 14:56:21.996411 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:21.996384    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b42t5_925f958d-3adb-4f93-ab09-1d510e1cdad0/istio-proxy/1.log"
Sep 10 14:56:22.034074 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:22.034044    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-45qrv_192699cd-bd0a-4468-817b-fadd320e305e/payload-pre-processing/0.log"
Sep 10 14:56:22.067358 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:22.067319    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pnm4r_838ce0c1-d8c7-4937-8923-5e52c2e29115/payload-processing/0.log"
Sep 10 14:56:22.095521 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:22.095495    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56968c8f6-wb7q7_3d0eff48-1682-45f1-a3c4-2f2f0a8f4732/router/0.log"
Sep 10 14:56:22.989462 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:22.989410    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f5nfm_fb89e2d9-8063-41da-a44c-7fb3ab0ae983/serve-healthcheck-canary/0.log"
Sep 10 14:56:23.449463 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:23.449432    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-z58wp_b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a/insights-operator/0.log"
Sep 10 14:56:23.449982 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:23.449966    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-z58wp_b6eab2d4-3c13-4cd4-9a7b-654912e5fa5a/insights-operator/1.log"
Sep 10 14:56:23.467420 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:23.467400    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4sbrm_2c3d57b6-e775-4ccf-819d-50396ceb2283/kube-rbac-proxy/0.log"
Sep 10 14:56:23.484153 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:23.484128    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4sbrm_2c3d57b6-e775-4ccf-819d-50396ceb2283/exporter/0.log"
Sep 10 14:56:23.501132 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:23.501107    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4sbrm_2c3d57b6-e775-4ccf-819d-50396ceb2283/extractor/0.log"
Sep 10 14:56:25.213244 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:25.213214    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4xhnq/perf-node-gather-daemonset-cwfxd"
Sep 10 14:56:25.998078 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:25.998044    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-plks6_df522869-cf63-447b-a6dc-66419f23e2a6/manager/0.log"
Sep 10 14:56:26.062232 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:26.062198    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c47c8c9b-s5fd5_35846642-5bc2-4163-9215-ffcdb453de8c/manager/0.log"
Sep 10 14:56:26.077589 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:26.077561    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c47c8c9b-s5fd5_35846642-5bc2-4163-9215-ffcdb453de8c/copy-manifests/0.log"
Sep 10 14:56:27.271230 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:27.271189    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-759b87488b-bcnnm_7c98bc03-655b-4ea7-a858-f85f4648e29a/manager/0.log"
Sep 10 14:56:27.316217 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:27.316185    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-vmk6c_ba296418-aa56-4ae0-a224-2678b6233d58/openshift-lws-operator/0.log"
Sep 10 14:56:28.467441 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:28.467412    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jz98w_036eb260-51a4-430b-98cf-6dc9435cf7b0/discovery/0.log"
Sep 10 14:56:28.515183 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:28.515154    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b42t5_925f958d-3adb-4f93-ab09-1d510e1cdad0/istio-proxy/0.log"
Sep 10 14:56:28.524006 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:28.523981    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b42t5_925f958d-3adb-4f93-ab09-1d510e1cdad0/istio-proxy/1.log"
Sep 10 14:56:28.567769 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:28.567734    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-45qrv_192699cd-bd0a-4468-817b-fadd320e305e/payload-pre-processing/0.log"
Sep 10 14:56:28.594868 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:28.594841    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pnm4r_838ce0c1-d8c7-4937-8923-5e52c2e29115/payload-processing/0.log"
Sep 10 14:56:28.610384 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:28.610352    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56968c8f6-wb7q7_3d0eff48-1682-45f1-a3c4-2f2f0a8f4732/router/0.log"
Sep 10 14:56:30.415683 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:30.415643    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-jz98w_036eb260-51a4-430b-98cf-6dc9435cf7b0/discovery/0.log"
Sep 10 14:56:30.467811 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:30.467759    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b42t5_925f958d-3adb-4f93-ab09-1d510e1cdad0/istio-proxy/0.log"
Sep 10 14:56:30.476029 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:30.476005    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-b42t5_925f958d-3adb-4f93-ab09-1d510e1cdad0/istio-proxy/1.log"
Sep 10 14:56:30.500658 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:30.500625    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-45qrv_192699cd-bd0a-4468-817b-fadd320e305e/payload-pre-processing/0.log"
Sep 10 14:56:30.527748 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:30.527719    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pnm4r_838ce0c1-d8c7-4937-8923-5e52c2e29115/payload-processing/0.log"
Sep 10 14:56:30.546328 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:30.546303    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56968c8f6-wb7q7_3d0eff48-1682-45f1-a3c4-2f2f0a8f4732/router/0.log"
Sep 10 14:56:32.876715 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:32.876681    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-z8pn5_e1d3db75-b02d-428b-8cb6-9a6577b51a42/kube-storage-version-migrator-operator/1.log"
Sep 10 14:56:32.877991 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:32.877966    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-z8pn5_e1d3db75-b02d-428b-8cb6-9a6577b51a42/kube-storage-version-migrator-operator/0.log"
Sep 10 14:56:33.934633 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:33.934597    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7dwqj_0628e16c-8aaa-4392-a640-946a3a9cfa3a/kube-multus/0.log"
Sep 10 14:56:34.227735 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:34.227658    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sd44h_29aba2b8-d986-4a26-bfd9-0816e2d4261a/kube-multus-additional-cni-plugins/0.log"
Sep 10 14:56:34.245190 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:34.245169    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sd44h_29aba2b8-d986-4a26-bfd9-0816e2d4261a/egress-router-binary-copy/0.log"
Sep 10 14:56:34.263367 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:34.263343    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sd44h_29aba2b8-d986-4a26-bfd9-0816e2d4261a/cni-plugins/0.log"
Sep 10 14:56:34.279974 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:34.279945    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sd44h_29aba2b8-d986-4a26-bfd9-0816e2d4261a/bond-cni-plugin/0.log"
Sep 10 14:56:34.296314 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:34.296291    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sd44h_29aba2b8-d986-4a26-bfd9-0816e2d4261a/routeoverride-cni/0.log"
Sep 10 14:56:34.312126 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:34.312094    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sd44h_29aba2b8-d986-4a26-bfd9-0816e2d4261a/whereabouts-cni-bincopy/0.log"
Sep 10 14:56:34.328347 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:34.328314    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sd44h_29aba2b8-d986-4a26-bfd9-0816e2d4261a/whereabouts-cni/0.log"
Sep 10 14:56:34.385502 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:34.385467    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fdw6t_cf0343b6-f96b-4aa5-8b81-31a1c4183142/network-metrics-daemon/0.log"
Sep 10 14:56:34.398388 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:34.398360    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fdw6t_cf0343b6-f96b-4aa5-8b81-31a1c4183142/kube-rbac-proxy/0.log"
Sep 10 14:56:35.367676 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:35.367595    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-controller/0.log"
Sep 10 14:56:35.382181 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:35.382154    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/1.log"
Sep 10 14:56:35.382181 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:35.382170    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovn-acl-logging/0.log"
Sep 10 14:56:35.397152 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:35.397127    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/kube-rbac-proxy-node/0.log"
Sep 10 14:56:35.415962 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:35.415934    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/kube-rbac-proxy-ovn-metrics/0.log"
Sep 10 14:56:35.435697 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:35.435669    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/northd/0.log"
Sep 10 14:56:35.452026 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:35.452004    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/nbdb/0.log"
Sep 10 14:56:35.468167 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:35.468146    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/sbdb/0.log"
Sep 10 14:56:35.519718 ip-10-0-128-234 kubenswrapper[2579]: I0910 14:56:35.519685    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ng6v4_ce90b427-583b-43b5-8c33-f8c4be7b7674/ovnkube-controller/0.log"