Sep 16 04:47:03.645871 ip-10-0-134-147 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 16 04:47:03.645884 ip-10-0-134-147 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 16 04:47:03.645892 ip-10-0-134-147 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 16 04:47:03.646164 ip-10-0-134-147 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 16 04:47:13.805541 ip-10-0-134-147 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 16 04:47:13.805558 ip-10-0-134-147 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bf8a6799b7714cf890dc3683713d450c --
Sep 16 04:49:06.185751 ip-10-0-134-147 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 04:49:06.600019 ip-10-0-134-147 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 04:49:06.600019 ip-10-0-134-147 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 04:49:06.600019 ip-10-0-134-147 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 04:49:06.600019 ip-10-0-134-147 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 04:49:06.600019 ip-10-0-134-147 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 04:49:06.600920 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.600844    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 04:49:06.607048 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607027    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 04:49:06.607048 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607045    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 04:49:06.607048 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607049    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 04:49:06.607048 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607052    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607057    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607060    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607063    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607066    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607068    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607072    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607075    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607077    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607080    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607082    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607085    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607087    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607090    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607093    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607095    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607098    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607101    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607103    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607105    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 04:49:06.607215 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607108    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607110    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607113    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607116    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607118    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607121    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607123    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607125    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607129    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607131    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607134    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607136    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607139    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607142    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607146    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607150    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607154    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607159    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607164    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 04:49:06.607714 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607167    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607170    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607173    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607176    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607179    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607182    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607184    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607188    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607191    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607194    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607197    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607200    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607202    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607205    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607207    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607210    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607212    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607216    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607219    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 04:49:06.608169 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607221    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607224    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607227    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607230    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607232    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607235    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607237    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607240    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607250    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607253    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607255    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607258    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607261    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607263    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607265    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607268    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607270    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607273    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607275    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607278    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 04:49:06.608633 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607280    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607283    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607286    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607290    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607294    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607297    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607300    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607303    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607305    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607308    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607310    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607313    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607315    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607318    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607320    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607323    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607325    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.607328    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608817    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 04:49:06.609124 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608826    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608831    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608836    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608839    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608841    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608844    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608846    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608849    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608851    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608854    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608856    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608867    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608870    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608872    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608875    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608878    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608882    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608885    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608888    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608890    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 04:49:06.609613 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608893    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608895    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608898    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608900    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608903    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608906    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608908    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608911    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608914    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608916    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608918    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608921    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608924    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608926    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608929    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608931    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608934    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608936    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608939    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608941    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 04:49:06.610114 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608946    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608948    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608951    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608954    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608957    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608960    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608962    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608965    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608967    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608971    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608973    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608976    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608979    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608981    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608983    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608986    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608989    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608991    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608994    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608996    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 04:49:06.610620 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.608999    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609001    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609004    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609007    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609009    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609012    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609014    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609016    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609020    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609023    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609025    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609027    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609031    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609034    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609036    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609039    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609041    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609044    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609046    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609049    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 04:49:06.611113 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609051    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609054    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609057    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609059    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609062    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609064    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609067    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609069    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609073    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609077    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609079    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609082    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609086    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609089    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609091    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609094    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609096    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609099    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609470    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 04:49:06.611616 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609491    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609494    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609497    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609499    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609502    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609505    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609508    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609511    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609513    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609516    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609518    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609521    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609523    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609526    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609528    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609531    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609534    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609537    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609539    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609542    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 04:49:06.612073 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609544    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609547    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609549    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609551    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609554    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609556    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609559    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609561    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609564    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609567    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609569    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609571    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609576    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609578    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609581    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609584    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609587    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609589    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609592    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 04:49:06.612610 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609594    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609597    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609599    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609602    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609606    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609609    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609612    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609615    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609618    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609621    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609624    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609627    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609630    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609632    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609635    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609637    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609640    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609642    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609644    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 04:49:06.613096 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609647    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609651    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609654    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609657    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609660    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609662    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609665    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609668    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609672    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609676    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609679    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609681    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609684    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609686    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609689    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609691    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609694    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609696    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609698    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 04:49:06.613588 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609701    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609703    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609706    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609708    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609711    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609713    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609715    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609718    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609720    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609723    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609725    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609727    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609730    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609732    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609734    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609737    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609739    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609741    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609744    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609747    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 04:49:06.614120 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.609750    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609820    2559 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609851    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609857    2559 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609862    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609866    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609869    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609873    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609877    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609880    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609883    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609887    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609890    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609893    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609896    2559 flags.go:64] FLAG: --cgroup-root=""
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609899    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609901    2559 flags.go:64] FLAG: --client-ca-file=""
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609905    2559 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609910    2559 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609913    2559 flags.go:64] FLAG: --cluster-domain=""
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609916    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609920    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609923    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609926    2559 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 04:49:06.614634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609929    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609932    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609935    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609939    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609941    2559 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609944    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609947    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609950    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609953    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609957    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609960    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609963    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609966    2559 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609969    2559 flags.go:64] FLAG: --enable-server="true"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609971    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609975    2559 flags.go:64] FLAG: --event-burst="100"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609977    2559 flags.go:64] FLAG: --event-qps="50"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609980    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609983    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609986    2559 flags.go:64] FLAG: --eviction-hard=""
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609989    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609992    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609994    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.609997    2559 flags.go:64] FLAG: --eviction-soft=""
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610000    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 04:49:06.615216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610003    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610007    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610010    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610013    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610017    2559 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610019    2559 flags.go:64] FLAG: --feature-gates=""
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610023    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610026    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610029    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610031    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610034    2559 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610037    2559 flags.go:64] FLAG: --help="false"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610040    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610043    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610046    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610049    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610052    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610055    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610058    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610061    2559 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610064    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610067    2559 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610070    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610072    2559 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 04:49:06.615841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610075    2559 flags.go:64] FLAG: --kube-reserved=""
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610078    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610081    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610083    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610086    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610089    2559 flags.go:64] FLAG: --lock-file=""
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610091    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610094    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610097    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610103    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610106    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610109    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610112    2559 flags.go:64] FLAG: --logging-format="text"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610114    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610119    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610121    2559 flags.go:64] FLAG: --manifest-url=""
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610124    2559 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610128    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610131    2559 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610135    2559 flags.go:64] FLAG: --max-pods="110"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610138    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610141    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610145    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610148    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610151    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 04:49:06.616451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610154    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610157    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610164    2559 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610166    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610169    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610172    2559 flags.go:64] FLAG: --pod-cidr=""
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610175    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610180    2559 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610183    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610186    2559 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610189    2559 flags.go:64] FLAG: --port="10250"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610192    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610195    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06c3012694314a0eb"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610197    2559 flags.go:64] FLAG: --qos-reserved=""
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610200    2559 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610203    2559 flags.go:64] FLAG: --register-node="true"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610208    2559 flags.go:64] FLAG: --register-with-taints=""
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610211    2559 flags.go:64] FLAG: --registry-burst="10"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610221    2559 flags.go:64] FLAG: --registry-qps="5"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610224    2559 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610227    2559 flags.go:64] FLAG: --reserved-memory=""
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610235    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610237    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610240    2559 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610243    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 04:49:06.617073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610246    2559 flags.go:64] FLAG: --runonce="false"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610248    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610251    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610254    2559 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610257    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610263    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610266    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610269    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610272    2559 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610274    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610277    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610280    2559 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610283    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610286    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610288    2559 flags.go:64] FLAG: --system-cgroups=""
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610291    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610297    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610299    2559 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610302    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610306    2559 flags.go:64] FLAG: --tls-min-version=""
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610308    2559 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610311    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610314    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610318    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610321    2559 flags.go:64] FLAG: --v="2"
Sep 16 04:49:06.617739 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610324    2559 flags.go:64] FLAG: --version="false"
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610328    2559 flags.go:64] FLAG: --vmodule=""
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610332    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.610335    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610460    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610464    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610468    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610470    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610473    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610490    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610493    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610496    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610500    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610504    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610506    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610509    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610513    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610517    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610520    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610523    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 04:49:06.618349 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610526    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610528    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610531    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610534    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610536    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610539    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610541    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610544    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610546    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610549    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610552    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610555    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610558    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610560    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610563    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610566    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610568    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610571    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610574    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610576    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 04:49:06.618849 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610579    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610581    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610583    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610586    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610590    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610593    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610595    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610597    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610600    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610603    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610605    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610616    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610619    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610621    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610624    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610627    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610629    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610632    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610636    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 04:49:06.619322 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610639    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610642    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610645    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610650    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610653    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610657    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610660    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610663    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610667    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610670    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610672    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610675    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610678    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610680    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610683    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610685    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610688    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610692    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610694    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 04:49:06.619793 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610697    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610699    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610702    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610705    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610707    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610710    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610712    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610715    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610717    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610720    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610722    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610725    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610727    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610730    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610732    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610735    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610738    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610741    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610743    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610746    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 04:49:06.620256 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610748    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610751    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610754    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610756    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.610759    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.611227    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.617770    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.617790    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.618410    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.618417    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618490    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618496    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618499    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618502    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618505    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 04:49:06.620756 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618508    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618511    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618514    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618517    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618519    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618522    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618525    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618527    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618530    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618533    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618536    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618538    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618541    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618543    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618546    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618548    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618551    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618553    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618556    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618558    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 04:49:06.621176 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618561    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618564    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618566    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618569    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618573    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618575    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618578    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618580    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618583    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618586    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618588    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618591    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618595    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618599    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618602    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618605    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618608    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618611    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618614    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 04:49:06.621659 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618616    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618619    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618621    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618624    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618626    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618629    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618631    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618634    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618636    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618639    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618641    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618644    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618646    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618649    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618652    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618655    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618657    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618660    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618664    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 04:49:06.622119 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618668    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618672    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618674    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618677    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618680    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618682    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618685    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618687    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618690    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618692    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618695    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618697    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618699    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618702    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618705    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618707    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618709    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618712    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618714    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618716    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 04:49:06.622656 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618719    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618721    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618724    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618726    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618729    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618731    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618734    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618736    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618739    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618741    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618744    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618747    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618750    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618752    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618755    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 04:49:06.623144 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618757    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.618762    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618887    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618891    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618894    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618897    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618900    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618903    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618905    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618907    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618910    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618913    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618915    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618917    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618920    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 04:49:06.623513 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618923    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618925    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618927    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618930    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618932    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618935    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618937    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618940    2559 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618943    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618945    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618947    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618950    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618953    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618956    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618958    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618961    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618964    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618966    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618969    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618971    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 04:49:06.623889 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618974    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618976    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618979    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.618996    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619000    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619003    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619006    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619009    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619012    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619014    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619017    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619020    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619023    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619025    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619028    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619031    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619034    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619036    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619039    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 04:49:06.624370 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619041    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619044    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619046    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619048    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619051    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619055    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619059    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619062    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619065    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619069    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619072    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619075    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619077    2559 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619080    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619082    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619085    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619087    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619090    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619092    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619095    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 04:49:06.624847 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619097    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619100    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619102    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619104    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619107    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619109    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619112    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619115    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619117    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619120    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619122    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619124    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619127    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619130    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619132    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619136    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619139    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619141    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619144    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 04:49:06.625373 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619147    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619150    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619152    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619155    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619158    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619162    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619165    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:06.619167    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.619171    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.619277    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.621233    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.622062    2559 server.go:1019] "Starting client certificate rotation"
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.622159    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 04:49:06.625869 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.622190    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 04:49:06.626205 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.624356    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 04:49:06.626205 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.625704    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 04:49:06.635850 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.635833    2559 log.go:25] "Validated CRI v1 runtime API"
Sep 16 04:49:06.638761 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.638747    2559 log.go:25] "Validated CRI v1 image API"
Sep 16 04:49:06.642743 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.642729    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 04:49:06.646236 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.646214    2559 fs.go:135] Filesystem UUIDs: map[57302e25-0da8-4e8d-a0a7-bded7d9a472f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dad109a7-79da-4376-856a-060bb5afd3dc:/dev/nvme0n1p4]
Sep 16 04:49:06.646288 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.646231    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 04:49:06.650994 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.650882    2559 manager.go:216] Machine: {Timestamp:2026-09-16 04:49:06.649677185 +0000 UTC m=+0.310856353 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106260 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c0c3c9a8eeb90af4ef1dd48429300 SystemUUID:ec2c0c3c-9a8e-eb90-af4e-f1dd48429300 BootID:bf8a6799-b771-4cf8-90dc-3683713d450c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:eb:9c:5d:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:eb:9c:5d:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:ab:cc:30:23:df Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 04:49:06.650994 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.650985    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 04:49:06.651099 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.651067    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 04:49:06.653841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.653814    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 04:49:06.653967 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.653844    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-147.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 04:49:06.654550 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.654541    2559 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 04:49:06.654581 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.654552    2559 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 04:49:06.654581 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.654559    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 04:49:06.655121 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.655106    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 04:49:06.655169 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.655154    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 04:49:06.656272 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.656260    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 04:49:06.659714 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.659704    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 04:49:06.659845 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.659835    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 04:49:06.659877 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.659864    2559 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 04:49:06.659905 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.659881    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 04:49:06.659905 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.659899    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 04:49:06.659957 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.659917    2559 kubelet.go:398] "Adding apiserver pod source"
Sep 16 04:49:06.659957 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.659927    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 04:49:06.660319 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.660307    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 04:49:06.660355 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.660326    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 04:49:06.662280 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.662260    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 04:49:06.664006 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.663992    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 04:49:06.664046 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.664024    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 04:49:06.665632 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665619    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 04:49:06.665692 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665635    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 04:49:06.665692 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665641    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 04:49:06.665692 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665651    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 04:49:06.665692 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665660    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 04:49:06.665692 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665665    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 04:49:06.665692 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665679    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 04:49:06.665692 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665684    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 04:49:06.665692 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665692    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 04:49:06.665692 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665697    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 04:49:06.665925 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665706    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 04:49:06.665925 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.665711    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 04:49:06.666272 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.666262    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 04:49:06.666300 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.666273    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 04:49:06.667950 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.667932    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-147.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 04:49:06.668014 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.667945    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 04:49:06.668014 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.667943    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 04:49:06.669971 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.669958    2559 server.go:1268] "Started kubelet"
Sep 16 04:49:06.670063 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.670035    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 04:49:06.670124 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.670085    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 04:49:06.673281 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.670071    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 04:49:06.673933 ip-10-0-134-147 systemd[1]: Started Kubernetes Kubelet.
Sep 16 04:49:06.674558 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.674395    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hbbgx"
Sep 16 04:49:06.676076 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.675628    2559 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 04:49:06.677868 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.677851    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 04:49:06.678918 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.678055    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-147.ec2.internal.18d5b3d335b15ecc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-147.ec2.internal,UID:ip-10-0-134-147.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-147.ec2.internal,},FirstTimestamp:2026-09-16 04:49:06.66992814 +0000 UTC m=+0.331107308,LastTimestamp:2026-09-16 04:49:06.66992814 +0000 UTC m=+0.331107308,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-147.ec2.internal,}"
Sep 16 04:49:06.680256 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.680237    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 04:49:06.681173 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.681156    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 04:49:06.681646 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.681629    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 04:49:06.681813 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.681782    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 16 04:49:06.682261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.682245    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 04:49:06.682323 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.682246    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 04:49:06.682323 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.682291    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 04:49:06.682416 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.682386    2559 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 04:49:06.682416 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.682396    2559 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 04:49:06.683079 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.683029    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hbbgx"
Sep 16 04:49:06.683729 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.683713    2559 factory.go:55] Registering systemd factory
Sep 16 04:49:06.683729 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.683731    2559 factory.go:223] Registration of the systemd container factory successfully
Sep 16 04:49:06.683971 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.683954    2559 factory.go:153] Registering CRI-O factory
Sep 16 04:49:06.683971 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.683971    2559 factory.go:223] Registration of the crio container factory successfully
Sep 16 04:49:06.684106 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.684015    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 04:49:06.684106 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.684032    2559 factory.go:103] Registering Raw factory
Sep 16 04:49:06.684106 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.684047    2559 manager.go:1196] Started watching for new ooms in manager
Sep 16 04:49:06.684393 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.684381    2559 manager.go:349] Starting recovery of all containers
Sep 16 04:49:06.692375 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.692342    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 04:49:06.692375 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.692359    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-147.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 04:49:06.694719 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.694657    2559 manager.go:354] Recovery completed
Sep 16 04:49:06.698444 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.698432    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 04:49:06.700489 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.700460    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 04:49:06.700532 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.700504    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 04:49:06.700532 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.700516    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 16 04:49:06.701058 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.701038    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 04:49:06.701058 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.701053    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 04:49:06.701194 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.701054    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 04:49:06.701194 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.701149    2559 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 04:49:06.701717 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.701703    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 04:49:06.701761 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.701727    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 04:49:06.701761 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.701736    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 16 04:49:06.703191 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.703178    2559 policy_none.go:49] "None policy: Start"
Sep 16 04:49:06.703191 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.703193    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 04:49:06.703277 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.703202    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 04:49:06.705139 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.705128    2559 policy_none.go:47] "Start"
Sep 16 04:49:06.764554 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.742543    2559 manager.go:337] "Starting Device Plugin manager"
Sep 16 04:49:06.764554 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.742573    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 04:49:06.764554 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.742582    2559 server.go:87] "Starting device plugin registration server"
Sep 16 04:49:06.764554 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.742835    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 04:49:06.764554 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.742844    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 04:49:06.764554 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.742929    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 04:49:06.764554 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.742993    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 04:49:06.764554 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.743004    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 04:49:06.764554 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.743407    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 04:49:06.764554 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.743445    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 16 04:49:06.777271 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.777244    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 04:49:06.778470 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.778457    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 04:49:06.778544 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.778517    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 04:49:06.778544 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.778538    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 04:49:06.778632 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.778570    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 04:49:06.781242 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.781225    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 04:49:06.843438 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.843421    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 04:49:06.844212 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.844198    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 04:49:06.844268 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.844225    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 04:49:06.844268 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.844235    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 16 04:49:06.844268 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.844254    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.852908 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.852843    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.852908 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.852873    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-147.ec2.internal\": node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 16 04:49:06.868767 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.868749    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 16 04:49:06.878832 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.878813    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"]
Sep 16 04:49:06.878890 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.878868    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 04:49:06.880115 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.880100    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 04:49:06.880193 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.880126    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 04:49:06.880193 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.880136    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 16 04:49:06.882321 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.882309    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 04:49:06.882461 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.882446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.882515 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.882495    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 04:49:06.882972 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.882956    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 04:49:06.883070 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.882978    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 04:49:06.883070 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.882988    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 16 04:49:06.883070 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.882961    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 04:49:06.883070 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.883055    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 04:49:06.883070 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.883072    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 16 04:49:06.883354 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.883339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8224a64d43e895e97be8d0e3b2f0f656-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"8224a64d43e895e97be8d0e3b2f0f656\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.883402 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.883361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8224a64d43e895e97be8d0e3b2f0f656-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"8224a64d43e895e97be8d0e3b2f0f656\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.883402 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.883378    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6796712b5facba899f960a43b24969ec-config\") pod \"kube-apiserver-proxy-ip-10-0-134-147.ec2.internal\" (UID: \"6796712b5facba899f960a43b24969ec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.885176 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.885163    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.885244 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.885185    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 04:49:06.885806 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.885792    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 04:49:06.885908 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.885812    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 04:49:06.885908 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.885822    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeHasSufficientPID"
Sep 16 04:49:06.897001 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.896986    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-147.ec2.internal\" not found" node="ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.901312 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.901299    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-147.ec2.internal\" not found" node="ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.969086 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:06.969069    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 16 04:49:06.983921 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.983899    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6796712b5facba899f960a43b24969ec-config\") pod \"kube-apiserver-proxy-ip-10-0-134-147.ec2.internal\" (UID: \"6796712b5facba899f960a43b24969ec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.983970 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.983928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8224a64d43e895e97be8d0e3b2f0f656-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"8224a64d43e895e97be8d0e3b2f0f656\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.983970 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.983944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8224a64d43e895e97be8d0e3b2f0f656-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"8224a64d43e895e97be8d0e3b2f0f656\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.984036 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.984007    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8224a64d43e895e97be8d0e3b2f0f656-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"8224a64d43e895e97be8d0e3b2f0f656\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.984036 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.984006    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6796712b5facba899f960a43b24969ec-config\") pod \"kube-apiserver-proxy-ip-10-0-134-147.ec2.internal\" (UID: \"6796712b5facba899f960a43b24969ec\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:06.984095 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:06.984007    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8224a64d43e895e97be8d0e3b2f0f656-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal\" (UID: \"8224a64d43e895e97be8d0e3b2f0f656\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:07.069749 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.069728    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 16 04:49:07.170450 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.170395    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 16 04:49:07.202153 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.202130    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:07.204678 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.204661    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:07.270524 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.270500    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 16 04:49:07.370983 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.370955    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 16 04:49:07.471545 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.471475    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-147.ec2.internal\" not found"
Sep 16 04:49:07.505348 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.505326    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 04:49:07.531172 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.531150    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 04:49:07.582599 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.582581    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:07.593124 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.593108    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 04:49:07.594032 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.594020    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal"
Sep 16 04:49:07.603404 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.603386    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 04:49:07.622549 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.622531    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 04:49:07.622672 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.622655    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 04:49:07.622735 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.622667    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 04:49:07.622735 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.622679    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 04:49:07.660869 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.660832    2559 apiserver.go:52] "Watching apiserver"
Sep 16 04:49:07.673316 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.673295    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 04:49:07.674906 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.674881    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-dnkdn","kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal","openshift-dns/node-resolver-7h8cj","openshift-image-registry/node-ca-42m6b","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal","openshift-multus/multus-885bn","openshift-multus/network-metrics-daemon-zp4zd","kube-system/global-pull-secret-syncer-nb8bf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9","openshift-cluster-node-tuning-operator/tuned-cfv5q","openshift-multus/multus-additional-cni-plugins-w967k","openshift-network-diagnostics/network-check-target-xk8c5","openshift-network-operator/iptables-alerter-7rj77","openshift-ovn-kubernetes/ovnkube-node-wtldw"]
Sep 16 04:49:07.677188 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.677166    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:07.677267 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.677246    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:07.679193 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.679177    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.680721 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.680701    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 04:49:07.680933 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.680914    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 04:49:07.681109 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.681092    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 04:49:07.681183 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.681123    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hg57j\""
Sep 16 04:49:07.681183 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.681147    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 04:49:07.681291 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.681093    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 04:49:07.681291 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.681277    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 04:49:07.681934 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.681919    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7h8cj"
Sep 16 04:49:07.683342 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.683325    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 04:49:07.683431 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.683347    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 04:49:07.683431 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.683347    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rwdhj\""
Sep 16 04:49:07.684128 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.684113    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-42m6b"
Sep 16 04:49:07.685521 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.685503    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 04:49:07.685597 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.685578    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6w2sw\""
Sep 16 04:49:07.685646 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.685595    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 04:49:07.685702 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.685655    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 04:49:07.686245 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.686234    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.687887 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.687871    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-46qtf\""
Sep 16 04:49:07.687967 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.687871    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e70a14e2-5e55-49de-809f-fec8c0dba5e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.687967 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.687913    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc4bc\" (UniqueName: \"kubernetes.io/projected/e70a14e2-5e55-49de-809f-fec8c0dba5e1-kube-api-access-bc4bc\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.687967 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.687932    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5a33096-52cf-4c3d-972d-8d3859c715c1-hosts-file\") pod \"node-resolver-7h8cj\" (UID: \"c5a33096-52cf-4c3d-972d-8d3859c715c1\") " pod="openshift-dns/node-resolver-7h8cj"
Sep 16 04:49:07.688121 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688001    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5a33096-52cf-4c3d-972d-8d3859c715c1-tmp-dir\") pod \"node-resolver-7h8cj\" (UID: \"c5a33096-52cf-4c3d-972d-8d3859c715c1\") " pod="openshift-dns/node-resolver-7h8cj"
Sep 16 04:49:07.688121 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688032    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 04:49:07.688121 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688037    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:07.688121 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688057    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 04:49:07.688121 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688066    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj7qt\" (UniqueName: \"kubernetes.io/projected/238121a1-1a61-4833-8f18-4e02b9a5d58a-kube-api-access-nj7qt\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:07.688121 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688091    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e70a14e2-5e55-49de-809f-fec8c0dba5e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.688121 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688113    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 04:49:07.688121 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e70a14e2-5e55-49de-809f-fec8c0dba5e1-system-cni-dir\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.688446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688137    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e70a14e2-5e55-49de-809f-fec8c0dba5e1-cnibin\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.688446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688180    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e70a14e2-5e55-49de-809f-fec8c0dba5e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.688446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688215    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxpb\" (UniqueName: \"kubernetes.io/projected/c5a33096-52cf-4c3d-972d-8d3859c715c1-kube-api-access-8cxpb\") pod \"node-resolver-7h8cj\" (UID: \"c5a33096-52cf-4c3d-972d-8d3859c715c1\") " pod="openshift-dns/node-resolver-7h8cj"
Sep 16 04:49:07.688446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04054e53-0882-4028-9e81-5bcf959c1cf6-host\") pod \"node-ca-42m6b\" (UID: \"04054e53-0882-4028-9e81-5bcf959c1cf6\") " pod="openshift-image-registry/node-ca-42m6b"
Sep 16 04:49:07.688446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688291    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 04:49:07.688446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688305    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 04:49:07.688446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04054e53-0882-4028-9e81-5bcf959c1cf6-serviceca\") pod \"node-ca-42m6b\" (UID: \"04054e53-0882-4028-9e81-5bcf959c1cf6\") " pod="openshift-image-registry/node-ca-42m6b"
Sep 16 04:49:07.688446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688416    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht5jq\" (UniqueName: \"kubernetes.io/projected/04054e53-0882-4028-9e81-5bcf959c1cf6-kube-api-access-ht5jq\") pod \"node-ca-42m6b\" (UID: \"04054e53-0882-4028-9e81-5bcf959c1cf6\") " pod="openshift-image-registry/node-ca-42m6b"
Sep 16 04:49:07.688446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e70a14e2-5e55-49de-809f-fec8c0dba5e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.688840 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688336    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 04:49:07.688840 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.688522    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.690194 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.690176    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 04:49:07.690279 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.690178    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4gxvp\""
Sep 16 04:49:07.690812 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.690798    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.692595 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.692574    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 04:49:07.692689 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.692629    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 04:49:07.692689 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.692640    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 04:49:07.692907 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.692878    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 04:49:07.692988 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.692956    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rj77"
Sep 16 04:49:07.693042 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.692975    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 04:44:07 +0000 UTC" deadline="2028-07-03 10:53:02.745198672 +0000 UTC"
Sep 16 04:49:07.693096 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.693046    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15750h3m55.052159067s"
Sep 16 04:49:07.693672 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.693245    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-txr2g\""
Sep 16 04:49:07.694548 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.694532    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lxrh7\""
Sep 16 04:49:07.694686 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.694673    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 04:49:07.694812 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.694797    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 04:49:07.694878 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.694845    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 04:49:07.695672 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.695655    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:07.695757 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.695726    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:07.698939 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.698916    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.700791 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.700775    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 04:49:07.700908 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.700893    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lpz4r\""
Sep 16 04:49:07.700956 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.700893    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 04:49:07.702248 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.702232    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:07.703638 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.703623    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 04:49:07.703732 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.703641    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 04:49:07.703732 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.703658    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qprn5\""
Sep 16 04:49:07.705123 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.705106    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:07.705193 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.705156    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:07.716118 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.716104    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fpt54"
Sep 16 04:49:07.724510 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:07.724261    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8224a64d43e895e97be8d0e3b2f0f656.slice/crio-346d734e781bddc3d6e16f597152e3fc87880d73eba06210e31c190fc1f1a5ba WatchSource:0}: Error finding container 346d734e781bddc3d6e16f597152e3fc87880d73eba06210e31c190fc1f1a5ba: Status 404 returned error can't find the container with id 346d734e781bddc3d6e16f597152e3fc87880d73eba06210e31c190fc1f1a5ba
Sep 16 04:49:07.726972 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.726942    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fpt54"
Sep 16 04:49:07.728664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.728638    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 04:49:07.759540 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:07.759518    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6796712b5facba899f960a43b24969ec.slice/crio-7f323e6e85b6a7aaf6a339dfb612e81ee23811c79c9a50124b2722a523cc8b9b WatchSource:0}: Error finding container 7f323e6e85b6a7aaf6a339dfb612e81ee23811c79c9a50124b2722a523cc8b9b: Status 404 returned error can't find the container with id 7f323e6e85b6a7aaf6a339dfb612e81ee23811c79c9a50124b2722a523cc8b9b
Sep 16 04:49:07.782282 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.782238    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal" event={"ID":"6796712b5facba899f960a43b24969ec","Type":"ContainerStarted","Data":"7f323e6e85b6a7aaf6a339dfb612e81ee23811c79c9a50124b2722a523cc8b9b"}
Sep 16 04:49:07.783060 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.783046    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 04:49:07.783422 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.783403    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal" event={"ID":"8224a64d43e895e97be8d0e3b2f0f656","Type":"ContainerStarted","Data":"346d734e781bddc3d6e16f597152e3fc87880d73eba06210e31c190fc1f1a5ba"}
Sep 16 04:49:07.789201 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.789142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-slash\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.789200    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-run-ovn\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.789231    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-cni-netd\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.789963    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-ovnkube-config\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-socket-dir-parent\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790053    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-var-lib-cni-multus\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22a518fc-2ff9-4e10-94d8-8e8ea8d5e820-host-slash\") pod \"iptables-alerter-7rj77\" (UID: \"22a518fc-2ff9-4e10-94d8-8e8ea8d5e820\") " pod="openshift-network-operator/iptables-alerter-7rj77"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790137    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxpb\" (UniqueName: \"kubernetes.io/projected/c5a33096-52cf-4c3d-972d-8d3859c715c1-kube-api-access-8cxpb\") pod \"node-resolver-7h8cj\" (UID: \"c5a33096-52cf-4c3d-972d-8d3859c715c1\") " pod="openshift-dns/node-resolver-7h8cj"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cdcef12-f8d4-4169-97ee-32cad9f9ac6f-konnectivity-ca\") pod \"konnectivity-agent-dnkdn\" (UID: \"5cdcef12-f8d4-4169-97ee-32cad9f9ac6f\") " pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790251    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-kubelet-config\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790488    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e70a14e2-5e55-49de-809f-fec8c0dba5e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790585    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-lib-modules\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790640    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-tmp\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbx8m\" (UniqueName: \"kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m\") pod \"network-check-target-xk8c5\" (UID: \"03ac7562-36b4-4671-954a-9878558285c9\") " pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:07.791755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790691    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e70a14e2-5e55-49de-809f-fec8c0dba5e1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-var-lib-openvswitch\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790781    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22a518fc-2ff9-4e10-94d8-8e8ea8d5e820-iptables-alerter-script\") pod \"iptables-alerter-7rj77\" (UID: \"22a518fc-2ff9-4e10-94d8-8e8ea8d5e820\") " pod="openshift-network-operator/iptables-alerter-7rj77"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790818    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84n68\" (UniqueName: \"kubernetes.io/projected/22a518fc-2ff9-4e10-94d8-8e8ea8d5e820-kube-api-access-84n68\") pod \"iptables-alerter-7rj77\" (UID: \"22a518fc-2ff9-4e10-94d8-8e8ea8d5e820\") " pod="openshift-network-operator/iptables-alerter-7rj77"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-run\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790901    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-cni-bin\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-env-overrides\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.790971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpcnp\" (UniqueName: \"kubernetes.io/projected/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-kube-api-access-wpcnp\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791001    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-var-lib-kubelet\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-sysctl-conf\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791058    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-systemd\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791146    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e70a14e2-5e55-49de-809f-fec8c0dba5e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791175    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc4bc\" (UniqueName: \"kubernetes.io/projected/e70a14e2-5e55-49de-809f-fec8c0dba5e1-kube-api-access-bc4bc\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791214    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5a33096-52cf-4c3d-972d-8d3859c715c1-hosts-file\") pod \"node-resolver-7h8cj\" (UID: \"c5a33096-52cf-4c3d-972d-8d3859c715c1\") " pod="openshift-dns/node-resolver-7h8cj"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791246    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj7qt\" (UniqueName: \"kubernetes.io/projected/238121a1-1a61-4833-8f18-4e02b9a5d58a-kube-api-access-nj7qt\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791274    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e70a14e2-5e55-49de-809f-fec8c0dba5e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.792413 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791299    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e70a14e2-5e55-49de-809f-fec8c0dba5e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791325    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04054e53-0882-4028-9e81-5bcf959c1cf6-host\") pod \"node-ca-42m6b\" (UID: \"04054e53-0882-4028-9e81-5bcf959c1cf6\") " pod="openshift-image-registry/node-ca-42m6b"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791352    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-cnibin\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791378    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-dbus\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-log-socket\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791427    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791455    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-ovnkube-script-lib\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791503    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-daemon-config\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791532    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-sys\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-run-openvswitch\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-var-lib-cni-bin\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791670    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c5a33096-52cf-4c3d-972d-8d3859c715c1-hosts-file\") pod \"node-resolver-7h8cj\" (UID: \"c5a33096-52cf-4c3d-972d-8d3859c715c1\") " pod="openshift-dns/node-resolver-7h8cj"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791672    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/04054e53-0882-4028-9e81-5bcf959c1cf6-host\") pod \"node-ca-42m6b\" (UID: \"04054e53-0882-4028-9e81-5bcf959c1cf6\") " pod="openshift-image-registry/node-ca-42m6b"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791710    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-socket-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791884    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e70a14e2-5e55-49de-809f-fec8c0dba5e1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.791983    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-sysconfig\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792040    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04054e53-0882-4028-9e81-5bcf959c1cf6-serviceca\") pod \"node-ca-42m6b\" (UID: \"04054e53-0882-4028-9e81-5bcf959c1cf6\") " pod="openshift-image-registry/node-ca-42m6b"
Sep 16 04:49:07.793097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-systemd-units\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792595    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e70a14e2-5e55-49de-809f-fec8c0dba5e1-cni-binary-copy\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792596    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792643    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-run-netns\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792692    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-run-systemd\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792715    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdhwt\" (UniqueName: \"kubernetes.io/projected/f21830af-2af5-459a-9447-6c5b671376cb-kube-api-access-xdhwt\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792750    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-kubernetes\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-sysctl-d\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792808    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/04054e53-0882-4028-9e81-5bcf959c1cf6-serviceca\") pod \"node-ca-42m6b\" (UID: \"04054e53-0882-4028-9e81-5bcf959c1cf6\") " pod="openshift-image-registry/node-ca-42m6b"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792800    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-var-lib-kubelet\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792854    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-run-netns\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792882    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-cni-dir\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-registration-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792900    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e70a14e2-5e55-49de-809f-fec8c0dba5e1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792909    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-run-multus-certs\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.793810 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792923    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-sys-fs\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-kubelet\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792959    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-node-log\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.792981    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cdcef12-f8d4-4169-97ee-32cad9f9ac6f-agent-certs\") pod \"konnectivity-agent-dnkdn\" (UID: \"5cdcef12-f8d4-4169-97ee-32cad9f9ac6f\") " pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5a33096-52cf-4c3d-972d-8d3859c715c1-tmp-dir\") pod \"node-resolver-7h8cj\" (UID: \"c5a33096-52cf-4c3d-972d-8d3859c715c1\") " pod="openshift-dns/node-resolver-7h8cj"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e70a14e2-5e55-49de-809f-fec8c0dba5e1-system-cni-dir\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e70a14e2-5e55-49de-809f-fec8c0dba5e1-system-cni-dir\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793135    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e70a14e2-5e55-49de-809f-fec8c0dba5e1-cnibin\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793158    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e70a14e2-5e55-49de-809f-fec8c0dba5e1-cnibin\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-system-cni-dir\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793197    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht5jq\" (UniqueName: \"kubernetes.io/projected/04054e53-0882-4028-9e81-5bcf959c1cf6-kube-api-access-ht5jq\") pod \"node-ca-42m6b\" (UID: \"04054e53-0882-4028-9e81-5bcf959c1cf6\") " pod="openshift-image-registry/node-ca-42m6b"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793218    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-host\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793240    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-device-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-modprobe-d\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793272    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5a33096-52cf-4c3d-972d-8d3859c715c1-tmp-dir\") pod \"node-resolver-7h8cj\" (UID: \"c5a33096-52cf-4c3d-972d-8d3859c715c1\") " pod="openshift-dns/node-resolver-7h8cj"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-tuned\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqlcw\" (UniqueName: \"kubernetes.io/projected/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-kube-api-access-qqlcw\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.794261 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793325    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-ovn-node-metrics-cert\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.794755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793339    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55bd99bc-f1a4-4208-9326-76f14296bfaf-cni-binary-copy\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.794755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-hostroot\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.794755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793385    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-conf-dir\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.794755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl5qz\" (UniqueName: \"kubernetes.io/projected/55bd99bc-f1a4-4208-9326-76f14296bfaf-kube-api-access-pl5qz\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.794755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-etc-openvswitch\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.794755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-run-k8s-cni-cncf-io\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.794755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-etc-kubernetes\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.794755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.793497    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:07.794755 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.793582    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:07.794755 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.793627    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs podName:238121a1-1a61-4833-8f18-4e02b9a5d58a nodeName:}" failed. No retries permitted until 2026-09-16 04:49:08.29361388 +0000 UTC m=+1.954793056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs") pod "network-metrics-daemon-zp4zd" (UID: "238121a1-1a61-4833-8f18-4e02b9a5d58a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:07.797811 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.797794    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 04:49:07.801422 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.801396    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc4bc\" (UniqueName: \"kubernetes.io/projected/e70a14e2-5e55-49de-809f-fec8c0dba5e1-kube-api-access-bc4bc\") pod \"multus-additional-cni-plugins-w967k\" (UID: \"e70a14e2-5e55-49de-809f-fec8c0dba5e1\") " pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:07.801525 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.801403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxpb\" (UniqueName: \"kubernetes.io/projected/c5a33096-52cf-4c3d-972d-8d3859c715c1-kube-api-access-8cxpb\") pod \"node-resolver-7h8cj\" (UID: \"c5a33096-52cf-4c3d-972d-8d3859c715c1\") " pod="openshift-dns/node-resolver-7h8cj"
Sep 16 04:49:07.801567 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.801512    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht5jq\" (UniqueName: \"kubernetes.io/projected/04054e53-0882-4028-9e81-5bcf959c1cf6-kube-api-access-ht5jq\") pod \"node-ca-42m6b\" (UID: \"04054e53-0882-4028-9e81-5bcf959c1cf6\") " pod="openshift-image-registry/node-ca-42m6b"
Sep 16 04:49:07.801567 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.801537    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj7qt\" (UniqueName: \"kubernetes.io/projected/238121a1-1a61-4833-8f18-4e02b9a5d58a-kube-api-access-nj7qt\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:07.894402 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894379    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-run-systemd\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.894508 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdhwt\" (UniqueName: \"kubernetes.io/projected/f21830af-2af5-459a-9447-6c5b671376cb-kube-api-access-xdhwt\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.894508 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894420    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-kubernetes\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.894508 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894437    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-sysctl-d\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.894508 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894459    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-var-lib-kubelet\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894518    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-run-netns\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894533    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-run-systemd\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894543    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-kubernetes\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894545    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-cni-dir\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894581    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-run-netns\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894655    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-var-lib-kubelet\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-registration-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894683    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-cni-dir\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894689    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-sysctl-d\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894698    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-registration-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894692    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-run-multus-certs\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.894725 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894728    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-run-multus-certs\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894755    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-sys-fs\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894773    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-kubelet\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894787    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-node-log\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894809    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cdcef12-f8d4-4169-97ee-32cad9f9ac6f-agent-certs\") pod \"konnectivity-agent-dnkdn\" (UID: \"5cdcef12-f8d4-4169-97ee-32cad9f9ac6f\") " pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894822    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-kubelet\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894857    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-system-cni-dir\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894861    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-node-log\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894826    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-system-cni-dir\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-host\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894890    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-sys-fs\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894929    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-host\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-device-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.894985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-modprobe-d\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895007    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-tuned\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895054    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlcw\" (UniqueName: \"kubernetes.io/projected/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-kube-api-access-qqlcw\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895040    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-device-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895098    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-modprobe-d\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.895209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-ovn-node-metrics-cert\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55bd99bc-f1a4-4208-9326-76f14296bfaf-cni-binary-copy\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895162    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-hostroot\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895184    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-conf-dir\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl5qz\" (UniqueName: \"kubernetes.io/projected/55bd99bc-f1a4-4208-9326-76f14296bfaf-kube-api-access-pl5qz\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895230    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-etc-openvswitch\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895264    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-conf-dir\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-run-k8s-cni-cncf-io\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895285    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-hostroot\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-run-k8s-cni-cncf-io\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895357    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-etc-openvswitch\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-etc-kubernetes\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-slash\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-run-ovn\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895534    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-etc-kubernetes\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895576    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-cni-netd\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895605    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-run-ovn\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895650    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-ovnkube-config\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.895946 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895661    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-slash\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-socket-dir-parent\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895696    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-cni-netd\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-var-lib-cni-multus\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895721    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-socket-dir-parent\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895732    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22a518fc-2ff9-4e10-94d8-8e8ea8d5e820-host-slash\") pod \"iptables-alerter-7rj77\" (UID: \"22a518fc-2ff9-4e10-94d8-8e8ea8d5e820\") " pod="openshift-network-operator/iptables-alerter-7rj77"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895758    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cdcef12-f8d4-4169-97ee-32cad9f9ac6f-konnectivity-ca\") pod \"konnectivity-agent-dnkdn\" (UID: \"5cdcef12-f8d4-4169-97ee-32cad9f9ac6f\") " pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895759    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-var-lib-cni-multus\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895814    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-kubelet-config\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895838    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895866    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-lib-modules\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-tmp\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895912    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbx8m\" (UniqueName: \"kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m\") pod \"network-check-target-xk8c5\" (UID: \"03ac7562-36b4-4671-954a-9878558285c9\") " pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895926    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55bd99bc-f1a4-4208-9326-76f14296bfaf-cni-binary-copy\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895938    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-var-lib-openvswitch\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22a518fc-2ff9-4e10-94d8-8e8ea8d5e820-iptables-alerter-script\") pod \"iptables-alerter-7rj77\" (UID: \"22a518fc-2ff9-4e10-94d8-8e8ea8d5e820\") " pod="openshift-network-operator/iptables-alerter-7rj77"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896031    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84n68\" (UniqueName: \"kubernetes.io/projected/22a518fc-2ff9-4e10-94d8-8e8ea8d5e820-kube-api-access-84n68\") pod \"iptables-alerter-7rj77\" (UID: \"22a518fc-2ff9-4e10-94d8-8e8ea8d5e820\") " pod="openshift-network-operator/iptables-alerter-7rj77"
Sep 16 04:49:07.896808 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.896044    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896054    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-run\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896079    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-cni-bin\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.896105    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret podName:c5d07b8d-2dc6-467d-99b3-a505e342f2fc nodeName:}" failed. No retries permitted until 2026-09-16 04:49:08.396087394 +0000 UTC m=+2.057266564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret") pod "global-pull-secret-syncer-nb8bf" (UID: "c5d07b8d-2dc6-467d-99b3-a505e342f2fc") : object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896125    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-cni-bin\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-env-overrides\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896165    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpcnp\" (UniqueName: \"kubernetes.io/projected/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-kube-api-access-wpcnp\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-var-lib-kubelet\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896216    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-sysctl-conf\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-lib-modules\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-systemd\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-cnibin\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896288    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-systemd\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.895761    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/22a518fc-2ff9-4e10-94d8-8e8ea8d5e820-host-slash\") pod \"iptables-alerter-7rj77\" (UID: \"22a518fc-2ff9-4e10-94d8-8e8ea8d5e820\") " pod="openshift-network-operator/iptables-alerter-7rj77"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896303    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-dbus\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896321    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5cdcef12-f8d4-4169-97ee-32cad9f9ac6f-konnectivity-ca\") pod \"konnectivity-agent-dnkdn\" (UID: \"5cdcef12-f8d4-4169-97ee-32cad9f9ac6f\") " pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896331    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-log-socket\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.897661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896358    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-ovnkube-script-lib\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896391    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-ovnkube-config\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896406    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-daemon-config\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896495    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-sys\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896529    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-run-openvswitch\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-var-lib-cni-bin\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-socket-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896612    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-sysconfig\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896646    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-systemd-units\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896671    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896684    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-sys\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-run-netns\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896723    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-run-openvswitch\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896724    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896801    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.898209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-dbus\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896879    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/22a518fc-2ff9-4e10-94d8-8e8ea8d5e820-iptables-alerter-script\") pod \"iptables-alerter-7rj77\" (UID: \"22a518fc-2ff9-4e10-94d8-8e8ea8d5e820\") " pod="openshift-network-operator/iptables-alerter-7rj77"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896919    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f21830af-2af5-459a-9447-6c5b671376cb-socket-dir\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55bd99bc-f1a4-4208-9326-76f14296bfaf-multus-daemon-config\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896971    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-sysconfig\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896612    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-var-lib-openvswitch\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897010    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-log-socket\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897039    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-systemd-units\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897054    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-cnibin\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897056    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897089    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-run\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.896647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-var-lib-cni-bin\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897145    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-run-netns\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897249    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55bd99bc-f1a4-4208-9326-76f14296bfaf-host-var-lib-kubelet\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897511    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-tuned\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897530    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-ovnkube-script-lib\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897537    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-kubelet-config\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:07.898699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5cdcef12-f8d4-4169-97ee-32cad9f9ac6f-agent-certs\") pod \"konnectivity-agent-dnkdn\" (UID: \"5cdcef12-f8d4-4169-97ee-32cad9f9ac6f\") " pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:07.899169 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897622    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-etc-sysctl-conf\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.899169 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897782    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-ovn-node-metrics-cert\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.899169 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.897789    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-env-overrides\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.899169 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.898825    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-tmp\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.901602 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.901582    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 04:49:07.901670 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.901605    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 04:49:07.901670 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.901618    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qbx8m for pod openshift-network-diagnostics/network-check-target-xk8c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:07.901784 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:07.901682    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m podName:03ac7562-36b4-4671-954a-9878558285c9 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:08.401667268 +0000 UTC m=+2.062846429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qbx8m" (UniqueName: "kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m") pod "network-check-target-xk8c5" (UID: "03ac7562-36b4-4671-954a-9878558285c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:07.902661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.902640    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqlcw\" (UniqueName: \"kubernetes.io/projected/e236122d-9a6e-4ecd-ad4b-11e4e6054de5-kube-api-access-qqlcw\") pod \"tuned-cfv5q\" (UID: \"e236122d-9a6e-4ecd-ad4b-11e4e6054de5\") " pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:07.902661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.902654    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl5qz\" (UniqueName: \"kubernetes.io/projected/55bd99bc-f1a4-4208-9326-76f14296bfaf-kube-api-access-pl5qz\") pod \"multus-885bn\" (UID: \"55bd99bc-f1a4-4208-9326-76f14296bfaf\") " pod="openshift-multus/multus-885bn"
Sep 16 04:49:07.903030 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.903012    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdhwt\" (UniqueName: \"kubernetes.io/projected/f21830af-2af5-459a-9447-6c5b671376cb-kube-api-access-xdhwt\") pod \"aws-ebs-csi-driver-node-nzbq9\" (UID: \"f21830af-2af5-459a-9447-6c5b671376cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:07.903875 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.903850    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84n68\" (UniqueName: \"kubernetes.io/projected/22a518fc-2ff9-4e10-94d8-8e8ea8d5e820-kube-api-access-84n68\") pod \"iptables-alerter-7rj77\" (UID: \"22a518fc-2ff9-4e10-94d8-8e8ea8d5e820\") " pod="openshift-network-operator/iptables-alerter-7rj77"
Sep 16 04:49:07.904440 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.904425    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpcnp\" (UniqueName: \"kubernetes.io/projected/9694e8fb-065a-4beb-ad2a-223aa2c2b6cf-kube-api-access-wpcnp\") pod \"ovnkube-node-wtldw\" (UID: \"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:07.937397 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:07.937377    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 04:49:08.004839 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.004795    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w967k"
Sep 16 04:49:08.014892 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:08.014875    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70a14e2_5e55_49de_809f_fec8c0dba5e1.slice/crio-4264383f1fa1fc904d5aca19e082adb5c2ff3af6706a230af20dbfa90a5a22ff WatchSource:0}: Error finding container 4264383f1fa1fc904d5aca19e082adb5c2ff3af6706a230af20dbfa90a5a22ff: Status 404 returned error can't find the container with id 4264383f1fa1fc904d5aca19e082adb5c2ff3af6706a230af20dbfa90a5a22ff
Sep 16 04:49:08.019869 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.019856    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7h8cj"
Sep 16 04:49:08.028722 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:08.028703    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5a33096_52cf_4c3d_972d_8d3859c715c1.slice/crio-3f1a89113fe99a8a386a5ee177e07a1bfdb9bcf4969a758d2698c94cdf7aa63a WatchSource:0}: Error finding container 3f1a89113fe99a8a386a5ee177e07a1bfdb9bcf4969a758d2698c94cdf7aa63a: Status 404 returned error can't find the container with id 3f1a89113fe99a8a386a5ee177e07a1bfdb9bcf4969a758d2698c94cdf7aa63a
Sep 16 04:49:08.031727 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.031714    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-42m6b"
Sep 16 04:49:08.035555 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.035529    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:08.040436 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.040417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-885bn"
Sep 16 04:49:08.040751 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:08.040730    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04054e53_0882_4028_9e81_5bcf959c1cf6.slice/crio-dd2d43fee5a80a4134dfbe5a7efaa7d9aea8d074279e1ff87f375f47ab18b078 WatchSource:0}: Error finding container dd2d43fee5a80a4134dfbe5a7efaa7d9aea8d074279e1ff87f375f47ab18b078: Status 404 returned error can't find the container with id dd2d43fee5a80a4134dfbe5a7efaa7d9aea8d074279e1ff87f375f47ab18b078
Sep 16 04:49:08.046121 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.046101    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9"
Sep 16 04:49:08.046290 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:08.046274    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9694e8fb_065a_4beb_ad2a_223aa2c2b6cf.slice/crio-49eb0adb114d1c3dca66e15822c4850f48fa90c65b7122148be49383bd0a9950 WatchSource:0}: Error finding container 49eb0adb114d1c3dca66e15822c4850f48fa90c65b7122148be49383bd0a9950: Status 404 returned error can't find the container with id 49eb0adb114d1c3dca66e15822c4850f48fa90c65b7122148be49383bd0a9950
Sep 16 04:49:08.049082 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:08.049066    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55bd99bc_f1a4_4208_9326_76f14296bfaf.slice/crio-87c5e6f705ae0e48ab97cdd931e92694a52c0cd84d60ecf94007321eccbc71d6 WatchSource:0}: Error finding container 87c5e6f705ae0e48ab97cdd931e92694a52c0cd84d60ecf94007321eccbc71d6: Status 404 returned error can't find the container with id 87c5e6f705ae0e48ab97cdd931e92694a52c0cd84d60ecf94007321eccbc71d6
Sep 16 04:49:08.052157 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.052139    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7rj77"
Sep 16 04:49:08.055336 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:08.055308    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf21830af_2af5_459a_9447_6c5b671376cb.slice/crio-80c56549b1ac247b240819493ea06149f710e34c03d884f94ae38ff8456710b3 WatchSource:0}: Error finding container 80c56549b1ac247b240819493ea06149f710e34c03d884f94ae38ff8456710b3: Status 404 returned error can't find the container with id 80c56549b1ac247b240819493ea06149f710e34c03d884f94ae38ff8456710b3
Sep 16 04:49:08.057733 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.057714    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cfv5q"
Sep 16 04:49:08.061081 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:08.061060    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a518fc_2ff9_4e10_94d8_8e8ea8d5e820.slice/crio-c81704d6fd2b392d0fcb2eb7009a4524ef7052f7d49ca6dd1d278f8bb893c1cc WatchSource:0}: Error finding container c81704d6fd2b392d0fcb2eb7009a4524ef7052f7d49ca6dd1d278f8bb893c1cc: Status 404 returned error can't find the container with id c81704d6fd2b392d0fcb2eb7009a4524ef7052f7d49ca6dd1d278f8bb893c1cc
Sep 16 04:49:08.067205 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:08.067187    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode236122d_9a6e_4ecd_ad4b_11e4e6054de5.slice/crio-f079eb62a781e76c1edeb930c50d197d491a4096af00bf8310d477ebbccd4e3f WatchSource:0}: Error finding container f079eb62a781e76c1edeb930c50d197d491a4096af00bf8310d477ebbccd4e3f: Status 404 returned error can't find the container with id f079eb62a781e76c1edeb930c50d197d491a4096af00bf8310d477ebbccd4e3f
Sep 16 04:49:08.067697 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.067683    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:08.076431 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:08.076414    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cdcef12_f8d4_4169_97ee_32cad9f9ac6f.slice/crio-678188ff65079f978f5eae7dd760d6343dc4105e56289506730d1f9cb03711fe WatchSource:0}: Error finding container 678188ff65079f978f5eae7dd760d6343dc4105e56289506730d1f9cb03711fe: Status 404 returned error can't find the container with id 678188ff65079f978f5eae7dd760d6343dc4105e56289506730d1f9cb03711fe
Sep 16 04:49:08.300386 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.300316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:08.300540 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:08.300407    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:08.300540 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:08.300454    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs podName:238121a1-1a61-4833-8f18-4e02b9a5d58a nodeName:}" failed. No retries permitted until 2026-09-16 04:49:09.300441721 +0000 UTC m=+2.961620882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs") pod "network-metrics-daemon-zp4zd" (UID: "238121a1-1a61-4833-8f18-4e02b9a5d58a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:08.401137 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.401104    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:08.401287 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:08.401243    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:08.401341 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:08.401298    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret podName:c5d07b8d-2dc6-467d-99b3-a505e342f2fc nodeName:}" failed. No retries permitted until 2026-09-16 04:49:09.401282024 +0000 UTC m=+3.062461195 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret") pod "global-pull-secret-syncer-nb8bf" (UID: "c5d07b8d-2dc6-467d-99b3-a505e342f2fc") : object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:08.501890 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.501824    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbx8m\" (UniqueName: \"kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m\") pod \"network-check-target-xk8c5\" (UID: \"03ac7562-36b4-4671-954a-9878558285c9\") " pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:08.502059 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:08.501983    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 04:49:08.502059 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:08.502007    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 04:49:08.502059 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:08.502020    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qbx8m for pod openshift-network-diagnostics/network-check-target-xk8c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:08.502243 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:08.502074    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m podName:03ac7562-36b4-4671-954a-9878558285c9 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:09.502055521 +0000 UTC m=+3.163234677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbx8m" (UniqueName: "kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m") pod "network-check-target-xk8c5" (UID: "03ac7562-36b4-4671-954a-9878558285c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:08.732034 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.731990    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 04:44:08 +0000 UTC" deadline="2028-06-28 00:43:21.125545608 +0000 UTC"
Sep 16 04:49:08.732034 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.732032    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15619h54m12.393518246s"
Sep 16 04:49:08.780145 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.779922    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:08.780145 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:08.780096    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:08.815771 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.815728    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7h8cj" event={"ID":"c5a33096-52cf-4c3d-972d-8d3859c715c1","Type":"ContainerStarted","Data":"3f1a89113fe99a8a386a5ee177e07a1bfdb9bcf4969a758d2698c94cdf7aa63a"}
Sep 16 04:49:08.849502 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.849459    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dnkdn" event={"ID":"5cdcef12-f8d4-4169-97ee-32cad9f9ac6f","Type":"ContainerStarted","Data":"678188ff65079f978f5eae7dd760d6343dc4105e56289506730d1f9cb03711fe"}
Sep 16 04:49:08.866724 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.866546    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cfv5q" event={"ID":"e236122d-9a6e-4ecd-ad4b-11e4e6054de5","Type":"ContainerStarted","Data":"f079eb62a781e76c1edeb930c50d197d491a4096af00bf8310d477ebbccd4e3f"}
Sep 16 04:49:08.880330 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.880296    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9" event={"ID":"f21830af-2af5-459a-9447-6c5b671376cb","Type":"ContainerStarted","Data":"80c56549b1ac247b240819493ea06149f710e34c03d884f94ae38ff8456710b3"}
Sep 16 04:49:08.907660 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.907624    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw" event={"ID":"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf","Type":"ContainerStarted","Data":"49eb0adb114d1c3dca66e15822c4850f48fa90c65b7122148be49383bd0a9950"}
Sep 16 04:49:08.924155 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.924118    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 04:49:08.930629 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.926191    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w967k" event={"ID":"e70a14e2-5e55-49de-809f-fec8c0dba5e1","Type":"ContainerStarted","Data":"4264383f1fa1fc904d5aca19e082adb5c2ff3af6706a230af20dbfa90a5a22ff"}
Sep 16 04:49:08.957595 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.957541    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rj77" event={"ID":"22a518fc-2ff9-4e10-94d8-8e8ea8d5e820","Type":"ContainerStarted","Data":"c81704d6fd2b392d0fcb2eb7009a4524ef7052f7d49ca6dd1d278f8bb893c1cc"}
Sep 16 04:49:08.963316 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.963289    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-885bn" event={"ID":"55bd99bc-f1a4-4208-9326-76f14296bfaf","Type":"ContainerStarted","Data":"87c5e6f705ae0e48ab97cdd931e92694a52c0cd84d60ecf94007321eccbc71d6"}
Sep 16 04:49:08.974131 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:08.974051    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-42m6b" event={"ID":"04054e53-0882-4028-9e81-5bcf959c1cf6","Type":"ContainerStarted","Data":"dd2d43fee5a80a4134dfbe5a7efaa7d9aea8d074279e1ff87f375f47ab18b078"}
Sep 16 04:49:09.309353 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:09.308727    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:09.309353 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:09.308914    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:09.309353 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:09.308984    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs podName:238121a1-1a61-4833-8f18-4e02b9a5d58a nodeName:}" failed. No retries permitted until 2026-09-16 04:49:11.308964714 +0000 UTC m=+4.970143875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs") pod "network-metrics-daemon-zp4zd" (UID: "238121a1-1a61-4833-8f18-4e02b9a5d58a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:09.409994 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:09.409961    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:09.410183 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:09.410122    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:09.410246 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:09.410184    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret podName:c5d07b8d-2dc6-467d-99b3-a505e342f2fc nodeName:}" failed. No retries permitted until 2026-09-16 04:49:11.410167062 +0000 UTC m=+5.071346225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret") pod "global-pull-secret-syncer-nb8bf" (UID: "c5d07b8d-2dc6-467d-99b3-a505e342f2fc") : object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:09.510832 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:09.510796    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbx8m\" (UniqueName: \"kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m\") pod \"network-check-target-xk8c5\" (UID: \"03ac7562-36b4-4671-954a-9878558285c9\") " pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:09.511011 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:09.510961    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 04:49:09.511011 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:09.510984    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 04:49:09.511011 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:09.510996    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qbx8m for pod openshift-network-diagnostics/network-check-target-xk8c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:09.511193 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:09.511055    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m podName:03ac7562-36b4-4671-954a-9878558285c9 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:11.511035884 +0000 UTC m=+5.172215067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbx8m" (UniqueName: "kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m") pod "network-check-target-xk8c5" (UID: "03ac7562-36b4-4671-954a-9878558285c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:09.733133 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:09.733070    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 04:44:08 +0000 UTC" deadline="2028-06-04 07:23:09.848425282 +0000 UTC"
Sep 16 04:49:09.733133 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:09.733133    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15050h34m0.115296875s"
Sep 16 04:49:09.779729 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:09.779697    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:09.779907 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:09.779838    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:09.780266 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:09.780244    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:09.780389 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:09.780369    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:09.915601 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:09.915352    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 04:49:10.612494 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:10.612462    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 04:49:10.779433 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:10.779399    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:10.780055 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:10.779547    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:11.325216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:11.325180    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:11.325417 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:11.325362    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:11.325480 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:11.325425    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs podName:238121a1-1a61-4833-8f18-4e02b9a5d58a nodeName:}" failed. No retries permitted until 2026-09-16 04:49:15.325406427 +0000 UTC m=+8.986585602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs") pod "network-metrics-daemon-zp4zd" (UID: "238121a1-1a61-4833-8f18-4e02b9a5d58a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:11.426154 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:11.426118    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:11.426320 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:11.426255    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:11.426320 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:11.426317    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret podName:c5d07b8d-2dc6-467d-99b3-a505e342f2fc nodeName:}" failed. No retries permitted until 2026-09-16 04:49:15.426298128 +0000 UTC m=+9.087477304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret") pod "global-pull-secret-syncer-nb8bf" (UID: "c5d07b8d-2dc6-467d-99b3-a505e342f2fc") : object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:11.526706 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:11.526670    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbx8m\" (UniqueName: \"kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m\") pod \"network-check-target-xk8c5\" (UID: \"03ac7562-36b4-4671-954a-9878558285c9\") " pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:11.526908 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:11.526889    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 04:49:11.526971 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:11.526919    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 04:49:11.526971 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:11.526933    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qbx8m for pod openshift-network-diagnostics/network-check-target-xk8c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:11.527080 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:11.526990    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m podName:03ac7562-36b4-4671-954a-9878558285c9 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:15.526971851 +0000 UTC m=+9.188151028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbx8m" (UniqueName: "kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m") pod "network-check-target-xk8c5" (UID: "03ac7562-36b4-4671-954a-9878558285c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:11.778773 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:11.778738    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:11.778963 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:11.778876    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:11.779213 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:11.779194    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:11.779309 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:11.779293    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:12.782373 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:12.782309    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:12.782871 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:12.782439    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:13.779537 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:13.779482    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:13.779735 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:13.779651    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:13.780084 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:13.780060    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:13.780281 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:13.780257    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:14.779440 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:14.779409    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:14.779923 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:14.779622    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:15.360457 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:15.360411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:15.360775 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:15.360752    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:15.360915 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:15.360825    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs podName:238121a1-1a61-4833-8f18-4e02b9a5d58a nodeName:}" failed. No retries permitted until 2026-09-16 04:49:23.360807372 +0000 UTC m=+17.021986551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs") pod "network-metrics-daemon-zp4zd" (UID: "238121a1-1a61-4833-8f18-4e02b9a5d58a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:15.461068 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:15.461027    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:15.461249 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:15.461229    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:15.461327 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:15.461298    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret podName:c5d07b8d-2dc6-467d-99b3-a505e342f2fc nodeName:}" failed. No retries permitted until 2026-09-16 04:49:23.461280647 +0000 UTC m=+17.122459831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret") pod "global-pull-secret-syncer-nb8bf" (UID: "c5d07b8d-2dc6-467d-99b3-a505e342f2fc") : object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:15.561627 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:15.561517    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbx8m\" (UniqueName: \"kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m\") pod \"network-check-target-xk8c5\" (UID: \"03ac7562-36b4-4671-954a-9878558285c9\") " pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:15.561758 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:15.561702    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 04:49:15.561758 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:15.561733    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 04:49:15.561758 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:15.561747    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qbx8m for pod openshift-network-diagnostics/network-check-target-xk8c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:15.561859 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:15.561807    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m podName:03ac7562-36b4-4671-954a-9878558285c9 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:23.561787644 +0000 UTC m=+17.222966818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbx8m" (UniqueName: "kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m") pod "network-check-target-xk8c5" (UID: "03ac7562-36b4-4671-954a-9878558285c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:15.779780 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:15.779736    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:15.780271 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:15.779884    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:15.780325 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:15.780289    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:15.780406 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:15.780385    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:16.779980 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:16.779946    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:16.780468 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:16.780053    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:17.779713 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:17.779669    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:17.779877 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:17.779812    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:17.780302 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:17.780161    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:17.780302 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:17.780260    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:18.779780 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:18.779740    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:18.779960 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:18.779869    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:19.779569 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:19.779541    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:19.780134 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:19.779661    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:19.780134 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:19.779711    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:19.780134 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:19.779812    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:20.779275 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:20.779197    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:20.779431 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:20.779311    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:21.779414 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:21.779369    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:21.779843 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:21.779419    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:21.779843 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:21.779536    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:21.779843 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:21.779647    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:22.779761 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:22.779728    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:22.780251 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:22.779829    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:23.422630 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:23.422600    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:23.422843 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:23.422777    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:23.422887 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:23.422856    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs podName:238121a1-1a61-4833-8f18-4e02b9a5d58a nodeName:}" failed. No retries permitted until 2026-09-16 04:49:39.422835156 +0000 UTC m=+33.084014327 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs") pod "network-metrics-daemon-zp4zd" (UID: "238121a1-1a61-4833-8f18-4e02b9a5d58a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:23.523910 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:23.523876    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:23.524071 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:23.524050    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:23.524142 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:23.524131    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret podName:c5d07b8d-2dc6-467d-99b3-a505e342f2fc nodeName:}" failed. No retries permitted until 2026-09-16 04:49:39.524112196 +0000 UTC m=+33.185291367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret") pod "global-pull-secret-syncer-nb8bf" (UID: "c5d07b8d-2dc6-467d-99b3-a505e342f2fc") : object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:23.624534 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:23.624503    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbx8m\" (UniqueName: \"kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m\") pod \"network-check-target-xk8c5\" (UID: \"03ac7562-36b4-4671-954a-9878558285c9\") " pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:23.624702 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:23.624674    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 04:49:23.624702 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:23.624688    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 04:49:23.624702 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:23.624697    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qbx8m for pod openshift-network-diagnostics/network-check-target-xk8c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:23.624863 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:23.624754    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m podName:03ac7562-36b4-4671-954a-9878558285c9 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:39.624735995 +0000 UTC m=+33.285915154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbx8m" (UniqueName: "kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m") pod "network-check-target-xk8c5" (UID: "03ac7562-36b4-4671-954a-9878558285c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:23.778932 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:23.778894    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:23.778932 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:23.778926    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:23.779141 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:23.779037    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:23.779207 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:23.779174    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:24.778901 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:24.778869    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:24.779288 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:24.779009    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:25.778691 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:25.778663    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:25.778875 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:25.778778    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:25.778875 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:25.778846    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:25.779257 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:25.778937    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:26.779473 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:26.779443    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:26.779879 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:26.779552    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:27.778721 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:27.778692    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:27.778891 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:27.778692    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:27.778891 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:27.778792    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:27.778891 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:27.778866    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:28.780320 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:28.779998    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:28.780708 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:28.780437    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:29.022445 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.022419    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal" event={"ID":"6796712b5facba899f960a43b24969ec","Type":"ContainerStarted","Data":"868604ab96b5125e0bb024eff946b8f63291320cd68035dcc4639bd6589227ff"}
Sep 16 04:49:29.023847 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.023820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-885bn" event={"ID":"55bd99bc-f1a4-4208-9326-76f14296bfaf","Type":"ContainerStarted","Data":"678769f47f602da987d6cc8c1b949117e3361405748976503f08f38837bca5c4"}
Sep 16 04:49:29.025222 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.025198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-42m6b" event={"ID":"04054e53-0882-4028-9e81-5bcf959c1cf6","Type":"ContainerStarted","Data":"841b6c0424a9066dae020c481dc451bf5c4a2cfa81c35257e94823345b87e1a4"}
Sep 16 04:49:29.026689 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.026667    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7h8cj" event={"ID":"c5a33096-52cf-4c3d-972d-8d3859c715c1","Type":"ContainerStarted","Data":"54d6df2e85510b88b38a07fb94e534e932cfb54fbbb9dd6fad15365238202391"}
Sep 16 04:49:29.028138 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.028115    2559 generic.go:356] "Generic (PLEG): container finished" podID="8224a64d43e895e97be8d0e3b2f0f656" containerID="cda89fdd472f90847f7763167c09548bc70aa3e18c3db0c978cd62230424f684" exitCode=0
Sep 16 04:49:29.028217 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.028182    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal" event={"ID":"8224a64d43e895e97be8d0e3b2f0f656","Type":"ContainerDied","Data":"cda89fdd472f90847f7763167c09548bc70aa3e18c3db0c978cd62230424f684"}
Sep 16 04:49:29.029533 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.029510    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dnkdn" event={"ID":"5cdcef12-f8d4-4169-97ee-32cad9f9ac6f","Type":"ContainerStarted","Data":"edd482dcd8c53cd89d6f20eb6f80eb25429e2dd04408d99d4920de2b95ab1440"}
Sep 16 04:49:29.030855 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.030837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cfv5q" event={"ID":"e236122d-9a6e-4ecd-ad4b-11e4e6054de5","Type":"ContainerStarted","Data":"e1f8e5e4373cf168cb3994ecc4d6563e7c4db2a463455d99173ff0946f0c619f"}
Sep 16 04:49:29.032141 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.032123    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9" event={"ID":"f21830af-2af5-459a-9447-6c5b671376cb","Type":"ContainerStarted","Data":"364f2a59c61f18ab678758933998c0df5f57421586d1444a8d78d05ba072af8d"}
Sep 16 04:49:29.034565 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.034545    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw" event={"ID":"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf","Type":"ContainerStarted","Data":"72fd693e81ea9ebd374dc126c47bf0515f53e345fae19348e1b7541d21af71a5"}
Sep 16 04:49:29.034661 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.034614    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw" event={"ID":"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf","Type":"ContainerStarted","Data":"48c4e5168ac931133aff577c206c5b4dd7ae222f4140e89b3d2d85ba1d2df30a"}
Sep 16 04:49:29.034722 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.034667    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw" event={"ID":"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf","Type":"ContainerStarted","Data":"3c21156c0a963ee480f820e888aa74affaaa80eb7f5a7d6721234441da9c741d"}
Sep 16 04:49:29.034722 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.034716    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw" event={"ID":"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf","Type":"ContainerStarted","Data":"9cb6736fddadc4b7680c6e32687bcbddf92e1035354faea57d55b4c96b115cf8"}
Sep 16 04:49:29.034819 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.034765    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw" event={"ID":"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf","Type":"ContainerStarted","Data":"92e49bb26864453973821d83943fd81e13732c284a6c20a4e52995f3998c8f33"}
Sep 16 04:49:29.036111 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.036093    2559 generic.go:356] "Generic (PLEG): container finished" podID="e70a14e2-5e55-49de-809f-fec8c0dba5e1" containerID="494f92b587865e3dffbdf792b9d3d68cdf53979f26d4f9a42caedc4f16ac9cdd" exitCode=0
Sep 16 04:49:29.036185 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.036120    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w967k" event={"ID":"e70a14e2-5e55-49de-809f-fec8c0dba5e1","Type":"ContainerDied","Data":"494f92b587865e3dffbdf792b9d3d68cdf53979f26d4f9a42caedc4f16ac9cdd"}
Sep 16 04:49:29.037219 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.037177    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-147.ec2.internal" podStartSLOduration=21.037166353 podStartE2EDuration="21.037166353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:29.036860871 +0000 UTC m=+22.698040049" watchObservedRunningTime="2026-09-16 04:49:29.037166353 +0000 UTC m=+22.698345532"
Sep 16 04:49:29.054572 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.054534    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cfv5q" podStartSLOduration=1.8949544619999998 podStartE2EDuration="22.054521975s" totalImagesPullingTime="20.159567513s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:29.053957822 +0000 UTC m=+22.715137000" watchObservedRunningTime="2026-09-16 04:49:29.054521975 +0000 UTC m=+22.715701153"
Sep 16 04:49:29.094678 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.094639    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-885bn" podStartSLOduration=1.767171523 podStartE2EDuration="22.094627742s" totalImagesPullingTime="20.327456219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:29.094174835 +0000 UTC m=+22.755354013" watchObservedRunningTime="2026-09-16 04:49:29.094627742 +0000 UTC m=+22.755806920"
Sep 16 04:49:29.107841 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.107779    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dnkdn" podStartSLOduration=1.988266866 podStartE2EDuration="22.107767191s" totalImagesPullingTime="20.119500325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:29.107358842 +0000 UTC m=+22.768538020" watchObservedRunningTime="2026-09-16 04:49:29.107767191 +0000 UTC m=+22.768946369"
Sep 16 04:49:29.121333 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.121297    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7h8cj" podStartSLOduration=1.976440589 podStartE2EDuration="22.121286737s" totalImagesPullingTime="20.144846148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:29.121159802 +0000 UTC m=+22.782338981" watchObservedRunningTime="2026-09-16 04:49:29.121286737 +0000 UTC m=+22.782465912"
Sep 16 04:49:29.778953 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.778926    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:29.779132 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:29.779060    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:29.779199 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:29.779127    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:29.779270 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:29.779250    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:30.043564 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:30.043532    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw" event={"ID":"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf","Type":"ContainerStarted","Data":"39d3311ad8d4c256b60ce1356454f14667a9c949ae01b7aeba83a19d43ae2d06"}
Sep 16 04:49:30.046251 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:30.046227    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7rj77" event={"ID":"22a518fc-2ff9-4e10-94d8-8e8ea8d5e820","Type":"ContainerStarted","Data":"cc68ae30ad8877347d364af5594443c6449c53da5d98db1bf46f540dbdb968c9"}
Sep 16 04:49:30.061332 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:30.061289    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-42m6b" podStartSLOduration=2.8802558510000003 podStartE2EDuration="23.061277156s" totalImagesPullingTime="20.181021305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:29.133074693 +0000 UTC m=+22.794253871" watchObservedRunningTime="2026-09-16 04:49:30.061277156 +0000 UTC m=+23.722456334"
Sep 16 04:49:30.076688 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:30.076630    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7rj77" podStartSLOduration=2.9109520719999997 podStartE2EDuration="23.076612118s" totalImagesPullingTime="20.165660046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:30.076547134 +0000 UTC m=+23.737726320" watchObservedRunningTime="2026-09-16 04:49:30.076612118 +0000 UTC m=+23.737791297"
Sep 16 04:49:30.147389 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:30.147361    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 04:49:30.762868 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:30.762545    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T04:49:30.147375674Z","UUID":"f24e6a24-c503-4c6c-be82-9080d34f3223","Handler":null,"Name":"","Endpoint":""}
Sep 16 04:49:30.764306 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:30.764104    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 04:49:30.764306 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:30.764138    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 04:49:30.779495 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:30.779455    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:30.779627 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:30.779574    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:31.051976 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:31.051873    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal" event={"ID":"8224a64d43e895e97be8d0e3b2f0f656","Type":"ContainerStarted","Data":"791f048cd87a3621daad817b004a33cc1d4b89071d855159545efaccb53f686f"}
Sep 16 04:49:31.054252 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:31.054223    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9" event={"ID":"f21830af-2af5-459a-9447-6c5b671376cb","Type":"ContainerStarted","Data":"a7ccc807943e738e9929e33512469fd932e74a320338ed77c0ef2050cdf651b1"}
Sep 16 04:49:31.068150 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:31.068090    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-147.ec2.internal" podStartSLOduration=23.068071346 podStartE2EDuration="23.068071346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:31.067502032 +0000 UTC m=+24.728681210" watchObservedRunningTime="2026-09-16 04:49:31.068071346 +0000 UTC m=+24.729250524"
Sep 16 04:49:31.779298 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:31.779271    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:31.779298 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:31.779304    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:31.779521 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:31.779392    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:31.779560 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:31.779520    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:32.059254 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:32.059171    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9" event={"ID":"f21830af-2af5-459a-9447-6c5b671376cb","Type":"ContainerStarted","Data":"2d1019a3f7c5cf0ab60501d0e013b1c3dcdd61d3a0b47338051268101ddc2230"}
Sep 16 04:49:32.063116 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:32.063089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw" event={"ID":"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf","Type":"ContainerStarted","Data":"88aaa8e6eb6dc2a41c51b41baea03ecc40687edb0c66b31847fcf60d17d66a34"}
Sep 16 04:49:32.075453 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:32.075414    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nzbq9" podStartSLOduration=2.453385648 podStartE2EDuration="25.075399338s" totalImagesPullingTime="22.62201369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:32.075266516 +0000 UTC m=+25.736445693" watchObservedRunningTime="2026-09-16 04:49:32.075399338 +0000 UTC m=+25.736578515"
Sep 16 04:49:32.352573 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:32.352500    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:32.353270 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:32.353246    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:32.779272 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:32.779247    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:32.779447 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:32.779346    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:33.065308 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:33.065238    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:33.065676 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:33.065658    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dnkdn"
Sep 16 04:49:33.779218 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:33.779189    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:33.779345 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:33.779190    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:33.779345 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:33.779325    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:33.779429 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:33.779352    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:34.071392 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:34.071105    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw" event={"ID":"9694e8fb-065a-4beb-ad2a-223aa2c2b6cf","Type":"ContainerStarted","Data":"fe6f40f8358a47c1d178a39df619e07f400ca73a9f2bb9c63c2c9c1daca41f5f"}
Sep 16 04:49:34.072343 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:34.071414    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:34.072343 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:34.071464    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:34.072343 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:34.071553    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:34.073723 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:34.073693    2559 generic.go:356] "Generic (PLEG): container finished" podID="e70a14e2-5e55-49de-809f-fec8c0dba5e1" containerID="66120b9c34e5a8878a34bf1396921ae21f5a3cd168cf22af5aaf48aef82f2339" exitCode=0
Sep 16 04:49:34.073847 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:34.073779    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w967k" event={"ID":"e70a14e2-5e55-49de-809f-fec8c0dba5e1","Type":"ContainerDied","Data":"66120b9c34e5a8878a34bf1396921ae21f5a3cd168cf22af5aaf48aef82f2339"}
Sep 16 04:49:34.088861 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:34.088835    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:34.089006 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:34.088981    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:49:34.097144 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:34.097103    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw" podStartSLOduration=6.9134985570000005 podStartE2EDuration="27.097089741s" totalImagesPullingTime="20.183591184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:34.096632368 +0000 UTC m=+27.757811548" watchObservedRunningTime="2026-09-16 04:49:34.097089741 +0000 UTC m=+27.758268918"
Sep 16 04:49:34.779013 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:34.778970    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:34.779234 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:34.779115    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:35.316403 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:35.316322    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nb8bf"]
Sep 16 04:49:35.317028 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:35.316435    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:35.317028 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:35.316544    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:35.320078 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:35.320051    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xk8c5"]
Sep 16 04:49:35.320197 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:35.320131    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:35.320251 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:35.320206    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:35.320695 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:35.320672    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zp4zd"]
Sep 16 04:49:35.320799 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:35.320785    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:35.320881 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:35.320862    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:36.080703 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:36.080667    2559 generic.go:356] "Generic (PLEG): container finished" podID="e70a14e2-5e55-49de-809f-fec8c0dba5e1" containerID="a2b77532c400b258442d982b1834fff33b9d5a6942a31156f4f50a2b17315ba2" exitCode=0
Sep 16 04:49:36.080893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:36.080751    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w967k" event={"ID":"e70a14e2-5e55-49de-809f-fec8c0dba5e1","Type":"ContainerDied","Data":"a2b77532c400b258442d982b1834fff33b9d5a6942a31156f4f50a2b17315ba2"}
Sep 16 04:49:36.780491 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:36.780313    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:36.780938 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:36.780602    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:37.778737 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:37.778716    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:37.778915 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:37.778748    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:37.778915 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:37.778828    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:37.779032 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:37.778933    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:38.087817 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:38.087746    2559 generic.go:356] "Generic (PLEG): container finished" podID="e70a14e2-5e55-49de-809f-fec8c0dba5e1" containerID="ee3ced6e169b701d55056f4b0af093351fd21e3aba15b88740140582a1b4d263" exitCode=0
Sep 16 04:49:38.087817 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:38.087805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w967k" event={"ID":"e70a14e2-5e55-49de-809f-fec8c0dba5e1","Type":"ContainerDied","Data":"ee3ced6e169b701d55056f4b0af093351fd21e3aba15b88740140582a1b4d263"}
Sep 16 04:49:38.779272 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:38.779241    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:38.779419 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:38.779377    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:39.449962 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:39.449924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:39.450395 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:39.450096    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:39.450395 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:39.450169    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs podName:238121a1-1a61-4833-8f18-4e02b9a5d58a nodeName:}" failed. No retries permitted until 2026-09-16 04:50:11.450148712 +0000 UTC m=+65.111327872 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs") pod "network-metrics-daemon-zp4zd" (UID: "238121a1-1a61-4833-8f18-4e02b9a5d58a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 04:49:39.550788 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:39.550757    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:39.550930 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:39.550898    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:39.550971 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:39.550958    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret podName:c5d07b8d-2dc6-467d-99b3-a505e342f2fc nodeName:}" failed. No retries permitted until 2026-09-16 04:50:11.550943889 +0000 UTC m=+65.212123050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret") pod "global-pull-secret-syncer-nb8bf" (UID: "c5d07b8d-2dc6-467d-99b3-a505e342f2fc") : object "kube-system"/"original-pull-secret" not registered
Sep 16 04:49:39.651704 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:39.651672    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbx8m\" (UniqueName: \"kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m\") pod \"network-check-target-xk8c5\" (UID: \"03ac7562-36b4-4671-954a-9878558285c9\") " pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:39.651855 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:39.651829    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 04:49:39.651855 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:39.651845    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 04:49:39.651963 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:39.651858    2559 projected.go:196] Error preparing data for projected volume kube-api-access-qbx8m for pod openshift-network-diagnostics/network-check-target-xk8c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:39.651963 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:39.651919    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m podName:03ac7562-36b4-4671-954a-9878558285c9 nodeName:}" failed. No retries permitted until 2026-09-16 04:50:11.651903152 +0000 UTC m=+65.313082308 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qbx8m" (UniqueName: "kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m") pod "network-check-target-xk8c5" (UID: "03ac7562-36b4-4671-954a-9878558285c9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 04:49:39.779004 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:39.778978    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:39.779129 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:39.779066    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xk8c5" podUID="03ac7562-36b4-4671-954a-9878558285c9"
Sep 16 04:49:39.779129 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:39.779118    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:39.779222 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:39.779206    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nb8bf" podUID="c5d07b8d-2dc6-467d-99b3-a505e342f2fc"
Sep 16 04:49:40.779247 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:40.779219    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:40.779812 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:40.779370    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zp4zd" podUID="238121a1-1a61-4833-8f18-4e02b9a5d58a"
Sep 16 04:49:41.093446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.093368    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-147.ec2.internal" event="NodeReady"
Sep 16 04:49:41.093614 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.093521    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 04:49:41.141537 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.141506    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4vxh6"]
Sep 16 04:49:41.143976 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.143947    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.145066 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.144438    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fmh8r"]
Sep 16 04:49:41.145895 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.145874    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmh8r"
Sep 16 04:49:41.146722 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.146696    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 04:49:41.147046 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.147021    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgbjt\""
Sep 16 04:49:41.147126 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.147048    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 04:49:41.148050 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.148027    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 04:49:41.148050 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.148048    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 04:49:41.148278 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.148262    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cl5jq\""
Sep 16 04:49:41.149336 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.149317    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 04:49:41.153163 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.153141    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4vxh6"]
Sep 16 04:49:41.157237 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.157202    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmh8r"]
Sep 16 04:49:41.165578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.165561    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8cjvr"]
Sep 16 04:49:41.167583 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.167563    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.169695 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.169380    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 04:49:41.169695 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.169419    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 04:49:41.169695 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.169460    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 04:49:41.169695 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.169469    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jkwpt\""
Sep 16 04:49:41.169695 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.169533    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 04:49:41.182338 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.182319    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8cjvr"]
Sep 16 04:49:41.263318 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.263291    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b15b9dbd-c63b-4123-a436-31f81bc75729-crio-socket\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.263437 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.263334    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-config-volume\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.263437 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.263361    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.263571 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.263435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2qxv\" (UniqueName: \"kubernetes.io/projected/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-api-access-z2qxv\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.263571 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.263463    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbcqx\" (UniqueName: \"kubernetes.io/projected/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-kube-api-access-fbcqx\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.263571 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.263504    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/315d95fb-3972-4e60-93b8-a5280e0466ec-cert\") pod \"ingress-canary-fmh8r\" (UID: \"315d95fb-3972-4e60-93b8-a5280e0466ec\") " pod="openshift-ingress-canary/ingress-canary-fmh8r"
Sep 16 04:49:41.263571 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.263531    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15b9dbd-c63b-4123-a436-31f81bc75729-data-volume\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.263571 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.263551    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.263795 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.263610    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-tmp-dir\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.263795 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.263683    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.263795 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.263719    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx7zw\" (UniqueName: \"kubernetes.io/projected/315d95fb-3972-4e60-93b8-a5280e0466ec-kube-api-access-vx7zw\") pod \"ingress-canary-fmh8r\" (UID: \"315d95fb-3972-4e60-93b8-a5280e0466ec\") " pod="openshift-ingress-canary/ingress-canary-fmh8r"
Sep 16 04:49:41.364630 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364604    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-tmp-dir\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.364742 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.364742 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364669    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx7zw\" (UniqueName: \"kubernetes.io/projected/315d95fb-3972-4e60-93b8-a5280e0466ec-kube-api-access-vx7zw\") pod \"ingress-canary-fmh8r\" (UID: \"315d95fb-3972-4e60-93b8-a5280e0466ec\") " pod="openshift-ingress-canary/ingress-canary-fmh8r"
Sep 16 04:49:41.364742 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b15b9dbd-c63b-4123-a436-31f81bc75729-crio-socket\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.364742 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364708    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-config-volume\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.364742 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364731    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.364963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364774    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2qxv\" (UniqueName: \"kubernetes.io/projected/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-api-access-z2qxv\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.364963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364807    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbcqx\" (UniqueName: \"kubernetes.io/projected/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-kube-api-access-fbcqx\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.364963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/315d95fb-3972-4e60-93b8-a5280e0466ec-cert\") pod \"ingress-canary-fmh8r\" (UID: \"315d95fb-3972-4e60-93b8-a5280e0466ec\") " pod="openshift-ingress-canary/ingress-canary-fmh8r"
Sep 16 04:49:41.364963 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.364830    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 04:49:41.364963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364847    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15b9dbd-c63b-4123-a436-31f81bc75729-data-volume\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.364963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.364963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364910    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b15b9dbd-c63b-4123-a436-31f81bc75729-crio-socket\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.364963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.364937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-tmp-dir\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.364963 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.364958    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls podName:c3c8bb0f-3119-4407-9a06-d3f0466ffe5f nodeName:}" failed. No retries permitted until 2026-09-16 04:49:41.864941441 +0000 UTC m=+35.526120605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls") pod "dns-default-4vxh6" (UID: "c3c8bb0f-3119-4407-9a06-d3f0466ffe5f") : secret "dns-default-metrics-tls" not found
Sep 16 04:49:41.365336 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.365048    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 04:49:41.365336 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.365091    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls podName:b15b9dbd-c63b-4123-a436-31f81bc75729 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:41.865077868 +0000 UTC m=+35.526257051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cjvr" (UID: "b15b9dbd-c63b-4123-a436-31f81bc75729") : secret "insights-runtime-extractor-tls" not found
Sep 16 04:49:41.365336 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.365113    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 04:49:41.365336 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.365193    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm podName:b15b9dbd-c63b-4123-a436-31f81bc75729 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:41.865166214 +0000 UTC m=+35.526345393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cjvr" (UID: "b15b9dbd-c63b-4123-a436-31f81bc75729") : configmap "kube-rbac-proxy" not found
Sep 16 04:49:41.365465 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.365363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b15b9dbd-c63b-4123-a436-31f81bc75729-data-volume\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.365905 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.365890    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-config-volume\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.370155 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.370127    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/315d95fb-3972-4e60-93b8-a5280e0466ec-cert\") pod \"ingress-canary-fmh8r\" (UID: \"315d95fb-3972-4e60-93b8-a5280e0466ec\") " pod="openshift-ingress-canary/ingress-canary-fmh8r"
Sep 16 04:49:41.373119 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.373090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx7zw\" (UniqueName: \"kubernetes.io/projected/315d95fb-3972-4e60-93b8-a5280e0466ec-kube-api-access-vx7zw\") pod \"ingress-canary-fmh8r\" (UID: \"315d95fb-3972-4e60-93b8-a5280e0466ec\") " pod="openshift-ingress-canary/ingress-canary-fmh8r"
Sep 16 04:49:41.373248 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.373229    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbcqx\" (UniqueName: \"kubernetes.io/projected/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-kube-api-access-fbcqx\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.373324 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.373285    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2qxv\" (UniqueName: \"kubernetes.io/projected/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-api-access-z2qxv\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.466133 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.466108    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmh8r"
Sep 16 04:49:41.779537 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.779507    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:49:41.779971 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.779509    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:49:41.781720 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.781698    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 04:49:41.781851 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.781748    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 04:49:41.782316 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.782110    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gbd6v\""
Sep 16 04:49:41.782316 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.782145    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 04:49:41.855802 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.855778    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7h8cj_c5a33096-52cf-4c3d-972d-8d3859c715c1/dns-node-resolver/0.log"
Sep 16 04:49:41.869116 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.869093    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:41.869251 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.869133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.869251 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:41.869198    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:41.869360 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.869262    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 04:49:41.869360 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.869321    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls podName:c3c8bb0f-3119-4407-9a06-d3f0466ffe5f nodeName:}" failed. No retries permitted until 2026-09-16 04:49:42.869304227 +0000 UTC m=+36.530483430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls") pod "dns-default-4vxh6" (UID: "c3c8bb0f-3119-4407-9a06-d3f0466ffe5f") : secret "dns-default-metrics-tls" not found
Sep 16 04:49:41.869360 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.869337    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 04:49:41.869535 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.869393    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls podName:b15b9dbd-c63b-4123-a436-31f81bc75729 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:42.869377719 +0000 UTC m=+36.530556875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cjvr" (UID: "b15b9dbd-c63b-4123-a436-31f81bc75729") : secret "insights-runtime-extractor-tls" not found
Sep 16 04:49:41.869535 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.869441    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 04:49:41.869535 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:41.869495    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm podName:b15b9dbd-c63b-4123-a436-31f81bc75729 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:42.869465572 +0000 UTC m=+36.530644729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cjvr" (UID: "b15b9dbd-c63b-4123-a436-31f81bc75729") : configmap "kube-rbac-proxy" not found
Sep 16 04:49:42.524941 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.524755    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmh8r"]
Sep 16 04:49:42.532313 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:42.532286    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315d95fb_3972_4e60_93b8_a5280e0466ec.slice/crio-0513674b83adfe1c9c83e0436d1e9c55aaf5364fc172c01b49dc3063f8ce4f74 WatchSource:0}: Error finding container 0513674b83adfe1c9c83e0436d1e9c55aaf5364fc172c01b49dc3063f8ce4f74: Status 404 returned error can't find the container with id 0513674b83adfe1c9c83e0436d1e9c55aaf5364fc172c01b49dc3063f8ce4f74
Sep 16 04:49:42.642849 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.642828    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-42m6b_04054e53-0882-4028-9e81-5bcf959c1cf6/node-ca/0.log"
Sep 16 04:49:42.779648 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.779595    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:49:42.781672 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.781646    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 04:49:42.781776 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.781714    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mpw9m\""
Sep 16 04:49:42.877429 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.877408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:42.877549 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.877440    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:42.877549 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.877470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:42.877651 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:42.877548    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 04:49:42.877651 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:42.877566    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 04:49:42.877651 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:42.877603    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm podName:b15b9dbd-c63b-4123-a436-31f81bc75729 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:44.87758716 +0000 UTC m=+38.538766340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cjvr" (UID: "b15b9dbd-c63b-4123-a436-31f81bc75729") : configmap "kube-rbac-proxy" not found
Sep 16 04:49:42.877651 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:42.877617    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls podName:b15b9dbd-c63b-4123-a436-31f81bc75729 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:44.877610959 +0000 UTC m=+38.538790115 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cjvr" (UID: "b15b9dbd-c63b-4123-a436-31f81bc75729") : secret "insights-runtime-extractor-tls" not found
Sep 16 04:49:42.877828 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:42.877666    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 04:49:42.877828 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:42.877730    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls podName:c3c8bb0f-3119-4407-9a06-d3f0466ffe5f nodeName:}" failed. No retries permitted until 2026-09-16 04:49:44.877711196 +0000 UTC m=+38.538890370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls") pod "dns-default-4vxh6" (UID: "c3c8bb0f-3119-4407-9a06-d3f0466ffe5f") : secret "dns-default-metrics-tls" not found
Sep 16 04:49:42.918984 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.918958    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-tjhzl"]
Sep 16 04:49:42.922632 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.921852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-tjhzl"
Sep 16 04:49:42.923769 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.923753    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nvtvk\""
Sep 16 04:49:42.923958 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.923946    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 16 04:49:42.924451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.924434    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 16 04:49:42.924562 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.924456    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 16 04:49:42.924562 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.924456    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 16 04:49:42.929262 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:42.929243    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-tjhzl"]
Sep 16 04:49:43.078307 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.078234    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f69cb7c5-d8b9-4fd2-adcd-cd1573197ada-signing-key\") pod \"service-ca-568869fdc5-tjhzl\" (UID: \"f69cb7c5-d8b9-4fd2-adcd-cd1573197ada\") " pod="openshift-service-ca/service-ca-568869fdc5-tjhzl"
Sep 16 04:49:43.078446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.078308    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f69cb7c5-d8b9-4fd2-adcd-cd1573197ada-signing-cabundle\") pod \"service-ca-568869fdc5-tjhzl\" (UID: \"f69cb7c5-d8b9-4fd2-adcd-cd1573197ada\") " pod="openshift-service-ca/service-ca-568869fdc5-tjhzl"
Sep 16 04:49:43.078535 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.078450    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqb97\" (UniqueName: \"kubernetes.io/projected/f69cb7c5-d8b9-4fd2-adcd-cd1573197ada-kube-api-access-vqb97\") pod \"service-ca-568869fdc5-tjhzl\" (UID: \"f69cb7c5-d8b9-4fd2-adcd-cd1573197ada\") " pod="openshift-service-ca/service-ca-568869fdc5-tjhzl"
Sep 16 04:49:43.102823 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.102787    2559 generic.go:356] "Generic (PLEG): container finished" podID="e70a14e2-5e55-49de-809f-fec8c0dba5e1" containerID="2164a111ce816d5ace5968c4f33720f5337f26c571179e472d29d0a8931b1760" exitCode=0
Sep 16 04:49:43.102944 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.102880    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w967k" event={"ID":"e70a14e2-5e55-49de-809f-fec8c0dba5e1","Type":"ContainerDied","Data":"2164a111ce816d5ace5968c4f33720f5337f26c571179e472d29d0a8931b1760"}
Sep 16 04:49:43.104311 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.104284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmh8r" event={"ID":"315d95fb-3972-4e60-93b8-a5280e0466ec","Type":"ContainerStarted","Data":"0513674b83adfe1c9c83e0436d1e9c55aaf5364fc172c01b49dc3063f8ce4f74"}
Sep 16 04:49:43.179064 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.179038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqb97\" (UniqueName: \"kubernetes.io/projected/f69cb7c5-d8b9-4fd2-adcd-cd1573197ada-kube-api-access-vqb97\") pod \"service-ca-568869fdc5-tjhzl\" (UID: \"f69cb7c5-d8b9-4fd2-adcd-cd1573197ada\") " pod="openshift-service-ca/service-ca-568869fdc5-tjhzl"
Sep 16 04:49:43.179187 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.179085    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f69cb7c5-d8b9-4fd2-adcd-cd1573197ada-signing-key\") pod \"service-ca-568869fdc5-tjhzl\" (UID: \"f69cb7c5-d8b9-4fd2-adcd-cd1573197ada\") " pod="openshift-service-ca/service-ca-568869fdc5-tjhzl"
Sep 16 04:49:43.179277 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.179255    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f69cb7c5-d8b9-4fd2-adcd-cd1573197ada-signing-cabundle\") pod \"service-ca-568869fdc5-tjhzl\" (UID: \"f69cb7c5-d8b9-4fd2-adcd-cd1573197ada\") " pod="openshift-service-ca/service-ca-568869fdc5-tjhzl"
Sep 16 04:49:43.180000 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.179977    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f69cb7c5-d8b9-4fd2-adcd-cd1573197ada-signing-cabundle\") pod \"service-ca-568869fdc5-tjhzl\" (UID: \"f69cb7c5-d8b9-4fd2-adcd-cd1573197ada\") " pod="openshift-service-ca/service-ca-568869fdc5-tjhzl"
Sep 16 04:49:43.182926 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.182907    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f69cb7c5-d8b9-4fd2-adcd-cd1573197ada-signing-key\") pod \"service-ca-568869fdc5-tjhzl\" (UID: \"f69cb7c5-d8b9-4fd2-adcd-cd1573197ada\") " pod="openshift-service-ca/service-ca-568869fdc5-tjhzl"
Sep 16 04:49:43.186496 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.186460    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqb97\" (UniqueName: \"kubernetes.io/projected/f69cb7c5-d8b9-4fd2-adcd-cd1573197ada-kube-api-access-vqb97\") pod \"service-ca-568869fdc5-tjhzl\" (UID: \"f69cb7c5-d8b9-4fd2-adcd-cd1573197ada\") " pod="openshift-service-ca/service-ca-568869fdc5-tjhzl"
Sep 16 04:49:43.230620 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.230587    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-tjhzl"
Sep 16 04:49:43.525050 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:43.524986    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-tjhzl"]
Sep 16 04:49:43.529660 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:43.529629    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69cb7c5_d8b9_4fd2_adcd_cd1573197ada.slice/crio-135a5f8044e1915e7ce5a6a051bc0963f74e45bab11e37bdd5a85c334f2ccee4 WatchSource:0}: Error finding container 135a5f8044e1915e7ce5a6a051bc0963f74e45bab11e37bdd5a85c334f2ccee4: Status 404 returned error can't find the container with id 135a5f8044e1915e7ce5a6a051bc0963f74e45bab11e37bdd5a85c334f2ccee4
Sep 16 04:49:44.111162 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:44.111126    2559 generic.go:356] "Generic (PLEG): container finished" podID="e70a14e2-5e55-49de-809f-fec8c0dba5e1" containerID="1c8be1707b658aca316946a4a3b946b795a6e55af0ec751bdee51c1a9d5061ac" exitCode=0
Sep 16 04:49:44.111842 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:44.111216    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w967k" event={"ID":"e70a14e2-5e55-49de-809f-fec8c0dba5e1","Type":"ContainerDied","Data":"1c8be1707b658aca316946a4a3b946b795a6e55af0ec751bdee51c1a9d5061ac"}
Sep 16 04:49:44.113555 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:44.113501    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-tjhzl" event={"ID":"f69cb7c5-d8b9-4fd2-adcd-cd1573197ada","Type":"ContainerStarted","Data":"135a5f8044e1915e7ce5a6a051bc0963f74e45bab11e37bdd5a85c334f2ccee4"}
Sep 16 04:49:44.895334 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:44.895195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:44.895423 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:44.895384    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:44.895495 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:44.895468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:44.895606 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:44.895582    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 04:49:44.895685 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:44.895672    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls podName:b15b9dbd-c63b-4123-a436-31f81bc75729 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:48.895651802 +0000 UTC m=+42.556830980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cjvr" (UID: "b15b9dbd-c63b-4123-a436-31f81bc75729") : secret "insights-runtime-extractor-tls" not found
Sep 16 04:49:44.895757 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:44.895589    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 04:49:44.895757 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:44.895722    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b15b9dbd-c63b-4123-a436-31f81bc75729-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:44.895757 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:44.895747    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls podName:c3c8bb0f-3119-4407-9a06-d3f0466ffe5f nodeName:}" failed. No retries permitted until 2026-09-16 04:49:48.895727603 +0000 UTC m=+42.556906771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls") pod "dns-default-4vxh6" (UID: "c3c8bb0f-3119-4407-9a06-d3f0466ffe5f") : secret "dns-default-metrics-tls" not found
Sep 16 04:49:45.120779 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:45.120652    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w967k" event={"ID":"e70a14e2-5e55-49de-809f-fec8c0dba5e1","Type":"ContainerStarted","Data":"f11784426e76bca9ef07c23e4cc0ed93eeaa12b9c1ca53f8ba862da38bad5f83"}
Sep 16 04:49:45.149832 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:45.149779    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w967k" podStartSLOduration=7.816573684 podStartE2EDuration="38.149761824s" totalImagesPullingTime="30.33318814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:45.14174505 +0000 UTC m=+38.802924229" watchObservedRunningTime="2026-09-16 04:49:45.149761824 +0000 UTC m=+38.810941003"
Sep 16 04:49:46.124165 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:46.124089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmh8r" event={"ID":"315d95fb-3972-4e60-93b8-a5280e0466ec","Type":"ContainerStarted","Data":"f18c5bde3cfb68d76765c3c577f42bdcbef12e30d01501d34f559713b3f0a287"}
Sep 16 04:49:46.125706 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:46.125673    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-tjhzl" event={"ID":"f69cb7c5-d8b9-4fd2-adcd-cd1573197ada","Type":"ContainerStarted","Data":"79f04a17dc43f8721b991271a1c9535607723cf9605d97fd378bb30f64ab05c6"}
Sep 16 04:49:46.141706 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:46.141663    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fmh8r" podStartSLOduration=2.200320703 podStartE2EDuration="5.141648714s" totalImagesPullingTime="2.941328011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:46.140938917 +0000 UTC m=+39.802118095" watchObservedRunningTime="2026-09-16 04:49:46.141648714 +0000 UTC m=+39.802827892"
Sep 16 04:49:46.155787 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:46.155740    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-tjhzl" podStartSLOduration=1.886797337 podStartE2EDuration="4.15572487s" totalImagesPullingTime="2.268927533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:49:46.155243803 +0000 UTC m=+39.816422982" watchObservedRunningTime="2026-09-16 04:49:46.15572487 +0000 UTC m=+39.816904048"
Sep 16 04:49:48.922812 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:48.922776    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:48.923165 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:48.922829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:48.923165 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:48.922919    2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 04:49:48.923165 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:48.922935    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 04:49:48.923165 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:48.922978    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls podName:c3c8bb0f-3119-4407-9a06-d3f0466ffe5f nodeName:}" failed. No retries permitted until 2026-09-16 04:49:56.922963024 +0000 UTC m=+50.584142202 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls") pod "dns-default-4vxh6" (UID: "c3c8bb0f-3119-4407-9a06-d3f0466ffe5f") : secret "dns-default-metrics-tls" not found
Sep 16 04:49:48.923165 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:49:48.922992    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls podName:b15b9dbd-c63b-4123-a436-31f81bc75729 nodeName:}" failed. No retries permitted until 2026-09-16 04:49:56.922986676 +0000 UTC m=+50.584165832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cjvr" (UID: "b15b9dbd-c63b-4123-a436-31f81bc75729") : secret "insights-runtime-extractor-tls" not found
Sep 16 04:49:56.978597 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:56.978563    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:56.979001 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:56.978615    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:56.982354 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:56.982331    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b15b9dbd-c63b-4123-a436-31f81bc75729-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cjvr\" (UID: \"b15b9dbd-c63b-4123-a436-31f81bc75729\") " pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:56.982466 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:56.982379    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3c8bb0f-3119-4407-9a06-d3f0466ffe5f-metrics-tls\") pod \"dns-default-4vxh6\" (UID: \"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f\") " pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:57.060686 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:57.060664    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:49:57.077118 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:57.077101    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8cjvr"
Sep 16 04:49:57.354029 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:57.353918    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4vxh6"]
Sep 16 04:49:57.357523 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:57.357494    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c8bb0f_3119_4407_9a06_d3f0466ffe5f.slice/crio-5334e32f345ef66df41a2ff805cb91c2f434a1bc01ad18078e862e3de3789880 WatchSource:0}: Error finding container 5334e32f345ef66df41a2ff805cb91c2f434a1bc01ad18078e862e3de3789880: Status 404 returned error can't find the container with id 5334e32f345ef66df41a2ff805cb91c2f434a1bc01ad18078e862e3de3789880
Sep 16 04:49:57.384394 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:57.384366    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8cjvr"]
Sep 16 04:49:57.388545 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:49:57.388523    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb15b9dbd_c63b_4123_a436_31f81bc75729.slice/crio-24f2f21d1b431f20839e6d38f14fadd88fb033cdfc9c78553c7f7e837bfff76b WatchSource:0}: Error finding container 24f2f21d1b431f20839e6d38f14fadd88fb033cdfc9c78553c7f7e837bfff76b: Status 404 returned error can't find the container with id 24f2f21d1b431f20839e6d38f14fadd88fb033cdfc9c78553c7f7e837bfff76b
Sep 16 04:49:58.160346 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:58.160310    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cjvr" event={"ID":"b15b9dbd-c63b-4123-a436-31f81bc75729","Type":"ContainerStarted","Data":"211c8a1591008e5c5075753c3085691f130ec6d17c614531ee9560c2c1edfaa3"}
Sep 16 04:49:58.160777 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:58.160376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cjvr" event={"ID":"b15b9dbd-c63b-4123-a436-31f81bc75729","Type":"ContainerStarted","Data":"24f2f21d1b431f20839e6d38f14fadd88fb033cdfc9c78553c7f7e837bfff76b"}
Sep 16 04:49:58.161593 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:58.161563    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vxh6" event={"ID":"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f","Type":"ContainerStarted","Data":"5334e32f345ef66df41a2ff805cb91c2f434a1bc01ad18078e862e3de3789880"}
Sep 16 04:49:59.165821 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:49:59.165782    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cjvr" event={"ID":"b15b9dbd-c63b-4123-a436-31f81bc75729","Type":"ContainerStarted","Data":"f5c94494fa004607240ad35a7652b37c28038517605ecbb0b5e52bebd46a44b4"}
Sep 16 04:50:00.170971 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:00.170931    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vxh6" event={"ID":"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f","Type":"ContainerStarted","Data":"85057bcc70e6eac78c98608928fe7857fe52be765c97ec2b270da69fdf48f0ec"}
Sep 16 04:50:00.171516 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:00.170997    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4vxh6" event={"ID":"c3c8bb0f-3119-4407-9a06-d3f0466ffe5f","Type":"ContainerStarted","Data":"77639c9f9fbee2d2ac822f233a86bd8535fed172a2d83b6fc49415fa8233968f"}
Sep 16 04:50:00.171516 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:00.171070    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:50:00.186999 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:00.186948    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4vxh6" podStartSLOduration=17.190429991 podStartE2EDuration="19.186931576s" totalImagesPullingTime="1.996501585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:00.186054033 +0000 UTC m=+53.847233212" watchObservedRunningTime="2026-09-16 04:50:00.186931576 +0000 UTC m=+53.848110759"
Sep 16 04:50:01.176116 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:01.176079    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cjvr" event={"ID":"b15b9dbd-c63b-4123-a436-31f81bc75729","Type":"ContainerStarted","Data":"315685fcdbeddad1dfac4eaacb335a0f283737dc2807022ce0df3ec1e82fe199"}
Sep 16 04:50:01.193686 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:01.193632    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8cjvr" podStartSLOduration=17.602267741 podStartE2EDuration="20.19361627s" totalImagesPullingTime="2.591348529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:01.192567097 +0000 UTC m=+54.853746274" watchObservedRunningTime="2026-09-16 04:50:01.19361627 +0000 UTC m=+54.854795449"
Sep 16 04:50:05.570557 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.570522    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j"]
Sep 16 04:50:05.600990 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.600964    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j"]
Sep 16 04:50:05.601133 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.601050    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j"
Sep 16 04:50:05.603127 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.603107    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 04:50:05.603591 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.603570    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 04:50:05.603685 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.603601    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 04:50:05.604114 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.604100    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 16 04:50:05.617133 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.617113    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-q9h9f\""
Sep 16 04:50:05.633800 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.633780    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bt4q\" (UniqueName: \"kubernetes.io/projected/1727ec9b-670b-427e-ab8d-999d0c6a5927-kube-api-access-8bt4q\") pod \"managed-serviceaccount-addon-agent-5f59c5488b-kgb8j\" (UID: \"1727ec9b-670b-427e-ab8d-999d0c6a5927\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j"
Sep 16 04:50:05.633888 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.633816    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1727ec9b-670b-427e-ab8d-999d0c6a5927-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f59c5488b-kgb8j\" (UID: \"1727ec9b-670b-427e-ab8d-999d0c6a5927\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j"
Sep 16 04:50:05.677606 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.677584    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c4df87c7-rfpm9"]
Sep 16 04:50:05.687492 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.687466    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.689662 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.689643    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 16 04:50:05.689743 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.689674    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 16 04:50:05.690001 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.689969    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tff4l\""
Sep 16 04:50:05.690212 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.690200    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 16 04:50:05.694594 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.694575    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 16 04:50:05.696512 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.696494    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c4df87c7-rfpm9"]
Sep 16 04:50:05.734322 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.734301    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1727ec9b-670b-427e-ab8d-999d0c6a5927-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f59c5488b-kgb8j\" (UID: \"1727ec9b-670b-427e-ab8d-999d0c6a5927\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j"
Sep 16 04:50:05.734401 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.734337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-installation-pull-secrets\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.734401 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.734358    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzwqc\" (UniqueName: \"kubernetes.io/projected/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-kube-api-access-gzwqc\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.734469 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.734456    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-ca-trust-extracted\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.734561 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.734474    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-registry-certificates\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.734597 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.734582    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-image-registry-private-configuration\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.734630 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.734619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-bound-sa-token\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.734699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.734677    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bt4q\" (UniqueName: \"kubernetes.io/projected/1727ec9b-670b-427e-ab8d-999d0c6a5927-kube-api-access-8bt4q\") pod \"managed-serviceaccount-addon-agent-5f59c5488b-kgb8j\" (UID: \"1727ec9b-670b-427e-ab8d-999d0c6a5927\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j"
Sep 16 04:50:05.734747 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.734715    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-trusted-ca\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.734798 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.734748    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-registry-tls\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.737229 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.737203    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1727ec9b-670b-427e-ab8d-999d0c6a5927-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f59c5488b-kgb8j\" (UID: \"1727ec9b-670b-427e-ab8d-999d0c6a5927\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j"
Sep 16 04:50:05.743443 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.743420    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bt4q\" (UniqueName: \"kubernetes.io/projected/1727ec9b-670b-427e-ab8d-999d0c6a5927-kube-api-access-8bt4q\") pod \"managed-serviceaccount-addon-agent-5f59c5488b-kgb8j\" (UID: \"1727ec9b-670b-427e-ab8d-999d0c6a5927\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j"
Sep 16 04:50:05.835288 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.835228    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-registry-tls\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.835288 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.835271    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-installation-pull-secrets\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.835434 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.835304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzwqc\" (UniqueName: \"kubernetes.io/projected/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-kube-api-access-gzwqc\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.835434 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.835333    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-ca-trust-extracted\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.835434 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.835364    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-registry-certificates\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.835618 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.835433    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-image-registry-private-configuration\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.835618 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.835474    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-bound-sa-token\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.835716 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.835663    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-trusted-ca\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.836322 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.836299    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-registry-certificates\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.836416 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.836363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-ca-trust-extracted\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.836748 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.836727    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-trusted-ca\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.838159 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.838136    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-image-registry-private-configuration\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.838451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.838425    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-installation-pull-secrets\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.838540 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.838523    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-registry-tls\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.846591 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.846573    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzwqc\" (UniqueName: \"kubernetes.io/projected/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-kube-api-access-gzwqc\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.847617 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.847599    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a815e044-d1b1-4162-b3a5-fbc89edcf6f3-bound-sa-token\") pod \"image-registry-5c4df87c7-rfpm9\" (UID: \"a815e044-d1b1-4162-b3a5-fbc89edcf6f3\") " pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:05.919859 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.919838    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j"
Sep 16 04:50:05.995784 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:05.995752    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:06.101168 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:06.101103    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wtldw"
Sep 16 04:50:06.213002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:06.212974    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j"]
Sep 16 04:50:06.215977 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:50:06.215953    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1727ec9b_670b_427e_ab8d_999d0c6a5927.slice/crio-b054d1d862188be6276eb592e6d8c8fc50a9eb1752a7f427c4c48be44b7bb4c0 WatchSource:0}: Error finding container b054d1d862188be6276eb592e6d8c8fc50a9eb1752a7f427c4c48be44b7bb4c0: Status 404 returned error can't find the container with id b054d1d862188be6276eb592e6d8c8fc50a9eb1752a7f427c4c48be44b7bb4c0
Sep 16 04:50:06.284191 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:06.284048    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c4df87c7-rfpm9"]
Sep 16 04:50:06.286326 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:50:06.286304    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda815e044_d1b1_4162_b3a5_fbc89edcf6f3.slice/crio-f6ec96b10510d1308f9b5421f887872db713a8958c28abd1414a773b0a032d44 WatchSource:0}: Error finding container f6ec96b10510d1308f9b5421f887872db713a8958c28abd1414a773b0a032d44: Status 404 returned error can't find the container with id f6ec96b10510d1308f9b5421f887872db713a8958c28abd1414a773b0a032d44
Sep 16 04:50:07.199857 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.199807    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9" event={"ID":"a815e044-d1b1-4162-b3a5-fbc89edcf6f3","Type":"ContainerStarted","Data":"8227e9682237bffa27cf9a38735d552a0990e20fd82b6e7dde8de36492c5c168"}
Sep 16 04:50:07.200294 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.199903    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9" event={"ID":"a815e044-d1b1-4162-b3a5-fbc89edcf6f3","Type":"ContainerStarted","Data":"f6ec96b10510d1308f9b5421f887872db713a8958c28abd1414a773b0a032d44"}
Sep 16 04:50:07.200294 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.199930    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:07.201670 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.201642    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j" event={"ID":"1727ec9b-670b-427e-ab8d-999d0c6a5927","Type":"ContainerStarted","Data":"b054d1d862188be6276eb592e6d8c8fc50a9eb1752a7f427c4c48be44b7bb4c0"}
Sep 16 04:50:07.221936 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.221886    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9" podStartSLOduration=2.221869749 podStartE2EDuration="2.221869749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:07.221298731 +0000 UTC m=+60.882477910" watchObservedRunningTime="2026-09-16 04:50:07.221869749 +0000 UTC m=+60.883048930"
Sep 16 04:50:07.315499 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.315450    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"]
Sep 16 04:50:07.317622 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.317597    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"
Sep 16 04:50:07.320159 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.319541    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 16 04:50:07.320159 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.319607    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4vmvb\""
Sep 16 04:50:07.328390 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.328369    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"]
Sep 16 04:50:07.349306 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.349284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/481fcf97-62d0-4c84-b84d-fb5d4bb99e07-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-c8ww8\" (UID: \"481fcf97-62d0-4c84-b84d-fb5d4bb99e07\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"
Sep 16 04:50:07.450607 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.450543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/481fcf97-62d0-4c84-b84d-fb5d4bb99e07-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-c8ww8\" (UID: \"481fcf97-62d0-4c84-b84d-fb5d4bb99e07\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"
Sep 16 04:50:07.450750 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:50:07.450690    2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 16 04:50:07.450806 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:50:07.450760    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/481fcf97-62d0-4c84-b84d-fb5d4bb99e07-tls-certificates podName:481fcf97-62d0-4c84-b84d-fb5d4bb99e07 nodeName:}" failed. No retries permitted until 2026-09-16 04:50:07.950740924 +0000 UTC m=+61.611920079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/481fcf97-62d0-4c84-b84d-fb5d4bb99e07-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-c8ww8" (UID: "481fcf97-62d0-4c84-b84d-fb5d4bb99e07") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 16 04:50:07.557782 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.557754    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-lv9b6"]
Sep 16 04:50:07.559669 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.559651    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-lv9b6"
Sep 16 04:50:07.561497 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.561454    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-qsstj\""
Sep 16 04:50:07.561624 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.561523    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 04:50:07.561624 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.561596    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 04:50:07.572102 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.572082    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-lv9b6"]
Sep 16 04:50:07.652072 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.652043    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggmfn\" (UniqueName: \"kubernetes.io/projected/8b149c36-4928-4c9a-b7f0-460c06c0a001-kube-api-access-ggmfn\") pod \"downloads-76f99584f4-lv9b6\" (UID: \"8b149c36-4928-4c9a-b7f0-460c06c0a001\") " pod="openshift-console/downloads-76f99584f4-lv9b6"
Sep 16 04:50:07.753254 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.753227    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggmfn\" (UniqueName: \"kubernetes.io/projected/8b149c36-4928-4c9a-b7f0-460c06c0a001-kube-api-access-ggmfn\") pod \"downloads-76f99584f4-lv9b6\" (UID: \"8b149c36-4928-4c9a-b7f0-460c06c0a001\") " pod="openshift-console/downloads-76f99584f4-lv9b6"
Sep 16 04:50:07.763204 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.763177    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggmfn\" (UniqueName: \"kubernetes.io/projected/8b149c36-4928-4c9a-b7f0-460c06c0a001-kube-api-access-ggmfn\") pod \"downloads-76f99584f4-lv9b6\" (UID: \"8b149c36-4928-4c9a-b7f0-460c06c0a001\") " pod="openshift-console/downloads-76f99584f4-lv9b6"
Sep 16 04:50:07.869576 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.869542    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-lv9b6"
Sep 16 04:50:07.955337 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:07.955310    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/481fcf97-62d0-4c84-b84d-fb5d4bb99e07-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-c8ww8\" (UID: \"481fcf97-62d0-4c84-b84d-fb5d4bb99e07\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"
Sep 16 04:50:07.955506 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:50:07.955431    2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 16 04:50:07.955574 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:50:07.955509    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/481fcf97-62d0-4c84-b84d-fb5d4bb99e07-tls-certificates podName:481fcf97-62d0-4c84-b84d-fb5d4bb99e07 nodeName:}" failed. No retries permitted until 2026-09-16 04:50:08.95549043 +0000 UTC m=+62.616669604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/481fcf97-62d0-4c84-b84d-fb5d4bb99e07-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-c8ww8" (UID: "481fcf97-62d0-4c84-b84d-fb5d4bb99e07") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 16 04:50:08.829683 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:08.829611    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-lv9b6"]
Sep 16 04:50:08.834127 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:50:08.834089    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b149c36_4928_4c9a_b7f0_460c06c0a001.slice/crio-6db0ca3dd37db86edbebd264f523813d0e56be99d5c3ea3aaf52c870781996bb WatchSource:0}: Error finding container 6db0ca3dd37db86edbebd264f523813d0e56be99d5c3ea3aaf52c870781996bb: Status 404 returned error can't find the container with id 6db0ca3dd37db86edbebd264f523813d0e56be99d5c3ea3aaf52c870781996bb
Sep 16 04:50:08.961582 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:08.961553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/481fcf97-62d0-4c84-b84d-fb5d4bb99e07-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-c8ww8\" (UID: \"481fcf97-62d0-4c84-b84d-fb5d4bb99e07\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"
Sep 16 04:50:08.964016 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:08.963982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/481fcf97-62d0-4c84-b84d-fb5d4bb99e07-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-c8ww8\" (UID: \"481fcf97-62d0-4c84-b84d-fb5d4bb99e07\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"
Sep 16 04:50:09.130343 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:09.130276    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"
Sep 16 04:50:09.209813 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:09.209784    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-lv9b6" event={"ID":"8b149c36-4928-4c9a-b7f0-460c06c0a001","Type":"ContainerStarted","Data":"6db0ca3dd37db86edbebd264f523813d0e56be99d5c3ea3aaf52c870781996bb"}
Sep 16 04:50:09.211276 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:09.211244    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j" event={"ID":"1727ec9b-670b-427e-ab8d-999d0c6a5927","Type":"ContainerStarted","Data":"a6ff24ae3bececb6b6264ce84bb2f0aaa85e42428e987d9a3722c06fc524c2e5"}
Sep 16 04:50:09.224143 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:09.224100    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f59c5488b-kgb8j" podStartSLOduration=1.846449172 podStartE2EDuration="4.224084863s" totalImagesPullingTime="2.377635691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:50:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:09.223574975 +0000 UTC m=+62.884754178" watchObservedRunningTime="2026-09-16 04:50:09.224084863 +0000 UTC m=+62.885264032"
Sep 16 04:50:09.397293 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:09.397212    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"]
Sep 16 04:50:09.400813 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:50:09.400776    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod481fcf97_62d0_4c84_b84d_fb5d4bb99e07.slice/crio-bb35c84a720007089416f580f2a425ec60617cdae853cb0cd4739da873b04d04 WatchSource:0}: Error finding container bb35c84a720007089416f580f2a425ec60617cdae853cb0cd4739da873b04d04: Status 404 returned error can't find the container with id bb35c84a720007089416f580f2a425ec60617cdae853cb0cd4739da873b04d04
Sep 16 04:50:10.179191 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:10.179100    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4vxh6"
Sep 16 04:50:10.228059 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:10.228001    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8" event={"ID":"481fcf97-62d0-4c84-b84d-fb5d4bb99e07","Type":"ContainerStarted","Data":"bb35c84a720007089416f580f2a425ec60617cdae853cb0cd4739da873b04d04"}
Sep 16 04:50:11.233017 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.232978    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8" event={"ID":"481fcf97-62d0-4c84-b84d-fb5d4bb99e07","Type":"ContainerStarted","Data":"4c6c73f028d9d2e35a6e00d5e1179ee78725cb383efc393f121974caac99e92e"}
Sep 16 04:50:11.233471 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.233196    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"
Sep 16 04:50:11.238497 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.238454    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8"
Sep 16 04:50:11.247629 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.247584    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-c8ww8" podStartSLOduration=3.199664559 podStartE2EDuration="4.247566255s" totalImagesPullingTime="1.047901696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:11.24615228 +0000 UTC m=+64.907331460" watchObservedRunningTime="2026-09-16 04:50:11.247566255 +0000 UTC m=+64.908745436"
Sep 16 04:50:11.364681 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.364646    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"]
Sep 16 04:50:11.366916 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.366895    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.369587 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.368768    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 16 04:50:11.369587 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.369113    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 16 04:50:11.369587 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.369127    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 04:50:11.369587 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.369151    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 04:50:11.369587 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.369411    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-s2thk\""
Sep 16 04:50:11.369587 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.369522    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 04:50:11.378212 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.378190    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"]
Sep 16 04:50:11.481874 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.481846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a351ef0-36a7-4641-836f-cdfe1a363653-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.482006 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.481882    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a351ef0-36a7-4641-836f-cdfe1a363653-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.482006 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.481924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:50:11.482110 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.481999    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a351ef0-36a7-4641-836f-cdfe1a363653-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.482110 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.482050    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtclp\" (UniqueName: \"kubernetes.io/projected/9a351ef0-36a7-4641-836f-cdfe1a363653-kube-api-access-wtclp\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.483730 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.483660    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 04:50:11.494529 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.494509    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/238121a1-1a61-4833-8f18-4e02b9a5d58a-metrics-certs\") pod \"network-metrics-daemon-zp4zd\" (UID: \"238121a1-1a61-4833-8f18-4e02b9a5d58a\") " pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:50:11.583074 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.583046    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a351ef0-36a7-4641-836f-cdfe1a363653-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.583208 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.583082    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtclp\" (UniqueName: \"kubernetes.io/projected/9a351ef0-36a7-4641-836f-cdfe1a363653-kube-api-access-wtclp\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.583208 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.583142    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a351ef0-36a7-4641-836f-cdfe1a363653-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.583208 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.583161    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a351ef0-36a7-4641-836f-cdfe1a363653-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.583208 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.583186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:50:11.583409 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:50:11.583214    2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 16 04:50:11.583409 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:50:11.583294    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a351ef0-36a7-4641-836f-cdfe1a363653-prometheus-operator-tls podName:9a351ef0-36a7-4641-836f-cdfe1a363653 nodeName:}" failed. No retries permitted until 2026-09-16 04:50:12.083273075 +0000 UTC m=+65.744452246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9a351ef0-36a7-4641-836f-cdfe1a363653-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-5pwdr" (UID: "9a351ef0-36a7-4641-836f-cdfe1a363653") : secret "prometheus-operator-tls" not found
Sep 16 04:50:11.583975 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.583954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a351ef0-36a7-4641-836f-cdfe1a363653-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.585612 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.585593    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 04:50:11.585902 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.585881    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a351ef0-36a7-4641-836f-cdfe1a363653-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.589683 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.589666    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mpw9m\""
Sep 16 04:50:11.591952 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.591915    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtclp\" (UniqueName: \"kubernetes.io/projected/9a351ef0-36a7-4641-836f-cdfe1a363653-kube-api-access-wtclp\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:11.596540 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.596517    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5d07b8d-2dc6-467d-99b3-a505e342f2fc-original-pull-secret\") pod \"global-pull-secret-syncer-nb8bf\" (UID: \"c5d07b8d-2dc6-467d-99b3-a505e342f2fc\") " pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:50:11.598397 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.598375    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zp4zd"
Sep 16 04:50:11.684562 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.684526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbx8m\" (UniqueName: \"kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m\") pod \"network-check-target-xk8c5\" (UID: \"03ac7562-36b4-4671-954a-9878558285c9\") " pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:50:11.686633 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.686609    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 04:50:11.696972 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.696954    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 04:50:11.709032 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.709008    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbx8m\" (UniqueName: \"kubernetes.io/projected/03ac7562-36b4-4671-954a-9878558285c9-kube-api-access-qbx8m\") pod \"network-check-target-xk8c5\" (UID: \"03ac7562-36b4-4671-954a-9878558285c9\") " pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:50:11.790541 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.790454    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nb8bf"
Sep 16 04:50:11.798339 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.798319    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gbd6v\""
Sep 16 04:50:11.806874 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.806843    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:50:11.877372 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:11.877297    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zp4zd"]
Sep 16 04:50:12.069331 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:12.069260    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nb8bf"]
Sep 16 04:50:12.073152 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:50:12.073019    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d07b8d_2dc6_467d_99b3_a505e342f2fc.slice/crio-b770e4840906508b38729a7b0e56b91c90f0f423143e0210e89d2312ec41c85a WatchSource:0}: Error finding container b770e4840906508b38729a7b0e56b91c90f0f423143e0210e89d2312ec41c85a: Status 404 returned error can't find the container with id b770e4840906508b38729a7b0e56b91c90f0f423143e0210e89d2312ec41c85a
Sep 16 04:50:12.088334 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:12.088293    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a351ef0-36a7-4641-836f-cdfe1a363653-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:12.091089 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:12.091068    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a351ef0-36a7-4641-836f-cdfe1a363653-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-5pwdr\" (UID: \"9a351ef0-36a7-4641-836f-cdfe1a363653\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:12.095063 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:12.095040    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xk8c5"]
Sep 16 04:50:12.098240 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:50:12.098214    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ac7562_36b4_4671_954a_9878558285c9.slice/crio-afccff978ecdc5d173aec4be53abda6f786c75ed0622866194f3c0b5c0b98377 WatchSource:0}: Error finding container afccff978ecdc5d173aec4be53abda6f786c75ed0622866194f3c0b5c0b98377: Status 404 returned error can't find the container with id afccff978ecdc5d173aec4be53abda6f786c75ed0622866194f3c0b5c0b98377
Sep 16 04:50:12.238216 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:12.238176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nb8bf" event={"ID":"c5d07b8d-2dc6-467d-99b3-a505e342f2fc","Type":"ContainerStarted","Data":"b770e4840906508b38729a7b0e56b91c90f0f423143e0210e89d2312ec41c85a"}
Sep 16 04:50:12.239618 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:12.239580    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zp4zd" event={"ID":"238121a1-1a61-4833-8f18-4e02b9a5d58a","Type":"ContainerStarted","Data":"552cd13db650f32ef2d571776296e6d798277c5cd39426e26f3c18b52a71a1d8"}
Sep 16 04:50:12.240883 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:12.240859    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xk8c5" event={"ID":"03ac7562-36b4-4671-954a-9878558285c9","Type":"ContainerStarted","Data":"afccff978ecdc5d173aec4be53abda6f786c75ed0622866194f3c0b5c0b98377"}
Sep 16 04:50:12.279308 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:12.279285    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"
Sep 16 04:50:12.572238 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:12.572204    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr"]
Sep 16 04:50:12.581862 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:50:12.581038    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a351ef0_36a7_4641_836f_cdfe1a363653.slice/crio-532529e8a40ff729c7f6f492ba236600ad65a2019dbe65f1bf4f2b34b1311920 WatchSource:0}: Error finding container 532529e8a40ff729c7f6f492ba236600ad65a2019dbe65f1bf4f2b34b1311920: Status 404 returned error can't find the container with id 532529e8a40ff729c7f6f492ba236600ad65a2019dbe65f1bf4f2b34b1311920
Sep 16 04:50:13.266599 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:13.266557    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr" event={"ID":"9a351ef0-36a7-4641-836f-cdfe1a363653","Type":"ContainerStarted","Data":"532529e8a40ff729c7f6f492ba236600ad65a2019dbe65f1bf4f2b34b1311920"}
Sep 16 04:50:14.274688 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:14.274531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zp4zd" event={"ID":"238121a1-1a61-4833-8f18-4e02b9a5d58a","Type":"ContainerStarted","Data":"f29f7c41401d15bb553befae375a2b377508d2e23d08b7b8033d62819c4371ea"}
Sep 16 04:50:14.274688 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:14.274593    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zp4zd" event={"ID":"238121a1-1a61-4833-8f18-4e02b9a5d58a","Type":"ContainerStarted","Data":"15c6325c8aa18c68c0ccbc3b0dc2026bc30f3925c3b37ec8f225182f1f55989e"}
Sep 16 04:50:14.291426 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:14.290094    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zp4zd" podStartSLOduration=65.448600327 podStartE2EDuration="1m7.290072897s" totalImagesPullingTime="1.84147257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:14.288980214 +0000 UTC m=+67.950159393" watchObservedRunningTime="2026-09-16 04:50:14.290072897 +0000 UTC m=+67.951252075"
Sep 16 04:50:18.293629 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:18.293594    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr" event={"ID":"9a351ef0-36a7-4641-836f-cdfe1a363653","Type":"ContainerStarted","Data":"d4333e4635e6a62af31731c9016b8a48820d39371361c9a25316f37358123e5e"}
Sep 16 04:50:18.296858 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:18.296654    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xk8c5" event={"ID":"03ac7562-36b4-4671-954a-9878558285c9","Type":"ContainerStarted","Data":"5f2043ba7758e22e98dc74b2a4843cfc64b7ecbda9106d6108f30a66ed9d2615"}
Sep 16 04:50:18.298114 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:18.297379    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:50:19.302403 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:19.302360    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nb8bf" event={"ID":"c5d07b8d-2dc6-467d-99b3-a505e342f2fc","Type":"ContainerStarted","Data":"0222b6bf530ee1ac3d56972267b8148a7618476ffc8cec290dd79b8c3987f37d"}
Sep 16 04:50:19.304701 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:19.304667    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr" event={"ID":"9a351ef0-36a7-4641-836f-cdfe1a363653","Type":"ContainerStarted","Data":"e41253a1931fbbb74ede9aaff7d895a63ff1f381ab5e308f7278f0f1484c8655"}
Sep 16 04:50:19.316275 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:19.316223    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xk8c5" podStartSLOduration=66.20915907 podStartE2EDuration="1m12.316203963s" totalImagesPullingTime="6.107044893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:18.314184984 +0000 UTC m=+71.975364161" watchObservedRunningTime="2026-09-16 04:50:19.316203963 +0000 UTC m=+72.977383142"
Sep 16 04:50:19.331669 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:19.331017    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-5pwdr" podStartSLOduration=2.722524216 podStartE2EDuration="8.330998742s" totalImagesPullingTime="5.608474526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:19.330660393 +0000 UTC m=+72.991839572" watchObservedRunningTime="2026-09-16 04:50:19.330998742 +0000 UTC m=+72.992177923"
Sep 16 04:50:19.331669 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:19.331325    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nb8bf" podStartSLOduration=66.19940539 podStartE2EDuration="1m12.331316521s" totalImagesPullingTime="6.131911131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 04:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:19.316132823 +0000 UTC m=+72.977312002" watchObservedRunningTime="2026-09-16 04:50:19.331316521 +0000 UTC m=+72.992495704"
Sep 16 04:50:21.610815 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.610771    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6449bd6479-shxtg"]
Sep 16 04:50:21.613441 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.613421    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.616649 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.616350    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 04:50:21.616649 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.616392    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 04:50:21.616649 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.616392    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pkcgd\""
Sep 16 04:50:21.616649 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.616392    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 04:50:21.616649 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.616548    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 04:50:21.616649 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.616560    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 04:50:21.636400 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.636353    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6449bd6479-shxtg"]
Sep 16 04:50:21.662673 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.662647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-service-ca\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.662782 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.662704    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-config\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.662782 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.662734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-serving-cert\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.662782 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.662768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-oauth-config\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.662917 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.662806    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-oauth-serving-cert\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.662917 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.662835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mzk7\" (UniqueName: \"kubernetes.io/projected/4ad67bd7-69c2-44af-be60-39a770ea7d73-kube-api-access-4mzk7\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.764167 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.764124    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-service-ca\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.764323 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.764198    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-config\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.764323 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.764236    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-serving-cert\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.764323 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.764270    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-oauth-config\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.764323 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.764307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-oauth-serving-cert\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.764582 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.764337    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mzk7\" (UniqueName: \"kubernetes.io/projected/4ad67bd7-69c2-44af-be60-39a770ea7d73-kube-api-access-4mzk7\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.765313 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.765294    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-service-ca\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.765838 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.765811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-config\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.767298 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.767222    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-oauth-serving-cert\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.771975 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.771918    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-serving-cert\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.772069 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.772021    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-oauth-config\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.783264 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.783196    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mzk7\" (UniqueName: \"kubernetes.io/projected/4ad67bd7-69c2-44af-be60-39a770ea7d73-kube-api-access-4mzk7\") pod \"console-6449bd6479-shxtg\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") " pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.813424 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.813398    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hczd9"]
Sep 16 04:50:21.816975 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.816954    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.821908 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.821125    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 04:50:21.821908 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.821391    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 04:50:21.821908 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.821729    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k8987\""
Sep 16 04:50:21.822057 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.821922    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 04:50:21.865558 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.865494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-wtmp\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.865660 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.865581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.865660 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.865651    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhngd\" (UniqueName: \"kubernetes.io/projected/db510a42-d551-4397-a7e4-398e88e3a3ce-kube-api-access-rhngd\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.865771 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.865689    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db510a42-d551-4397-a7e4-398e88e3a3ce-root\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.865771 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.865726    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db510a42-d551-4397-a7e4-398e88e3a3ce-sys\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.865771 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.865752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-tls\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.865923 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.865777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-textfile\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.865923 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.865799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db510a42-d551-4397-a7e4-398e88e3a3ce-metrics-client-ca\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.865923 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.865825    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.925499 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.925454    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:21.966812 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.966781    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db510a42-d551-4397-a7e4-398e88e3a3ce-sys\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.966924 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.966824    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-tls\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.966924 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.966851    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-textfile\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.966924 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.966880    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db510a42-d551-4397-a7e4-398e88e3a3ce-metrics-client-ca\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.966924 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.966898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db510a42-d551-4397-a7e4-398e88e3a3ce-sys\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.966924 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.966906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.967167 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:50:21.966950    2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 16 04:50:21.967167 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:50:21.967071    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-tls podName:db510a42-d551-4397-a7e4-398e88e3a3ce nodeName:}" failed. No retries permitted until 2026-09-16 04:50:22.467047701 +0000 UTC m=+76.128226877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-tls") pod "node-exporter-hczd9" (UID: "db510a42-d551-4397-a7e4-398e88e3a3ce") : secret "node-exporter-tls" not found
Sep 16 04:50:21.967167 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.967071    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-wtmp\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.967346 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.967167    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-textfile\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.967346 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.966954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-wtmp\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.967346 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.967259    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.967346 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.967296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhngd\" (UniqueName: \"kubernetes.io/projected/db510a42-d551-4397-a7e4-398e88e3a3ce-kube-api-access-rhngd\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.967346 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.967333    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db510a42-d551-4397-a7e4-398e88e3a3ce-root\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.967665 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.967399    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db510a42-d551-4397-a7e4-398e88e3a3ce-root\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.967665 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.967630    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db510a42-d551-4397-a7e4-398e88e3a3ce-metrics-client-ca\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.967797 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.967778    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.969754 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.969736    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:21.977515 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:21.977496    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhngd\" (UniqueName: \"kubernetes.io/projected/db510a42-d551-4397-a7e4-398e88e3a3ce-kube-api-access-rhngd\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:22.472181 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.472144    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-tls\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:22.475004 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.474979    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db510a42-d551-4397-a7e4-398e88e3a3ce-node-exporter-tls\") pod \"node-exporter-hczd9\" (UID: \"db510a42-d551-4397-a7e4-398e88e3a3ce\") " pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:22.729320 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.729287    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hczd9"
Sep 16 04:50:22.776067 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.776036    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 04:50:22.778939 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.778915    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.780770 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.780744    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 16 04:50:22.780770 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.780772    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 16 04:50:22.780979 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.780958    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 16 04:50:22.782893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.781289    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 16 04:50:22.782893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.781294    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 16 04:50:22.782893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.781352    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 16 04:50:22.782893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.781371    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n76bg\""
Sep 16 04:50:22.782893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.781638    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 16 04:50:22.782893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.781784    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 16 04:50:22.782893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.781888    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 16 04:50:22.794375 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.794353    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 04:50:22.875637 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.875602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.875637 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.875636    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-config-out\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.875861 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.875669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.875861 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.875705    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhd74\" (UniqueName: \"kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-kube-api-access-dhd74\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.875861 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.875746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.875861 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.875788    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.875861 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.875837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.876108 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.875864    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.876108 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.875908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.876108 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.875937    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.876108 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.875966    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.876108 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.876010    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-web-config\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.876108 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.876042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-config-volume\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976438 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976405    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976631 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976465    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976631 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976514    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976631 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976534    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976631 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976631 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976631 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976606    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-web-config\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976631 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976635    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-config-volume\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976982 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976659    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976982 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976683    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-config-out\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976982 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976982 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhd74\" (UniqueName: \"kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-kube-api-access-dhd74\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.976982 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.976771    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.978754 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.978683    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.979379 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.979327    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.980036 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.980012    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.980142 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.980015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.980142 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.980069    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.981258 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.981223    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.981628 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.981606    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.981956 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.981913    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-web-config\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.982053 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.981977    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-config-volume\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.982231 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.982213    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.982897 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.982876    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-config-out\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.983110 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.983088    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:22.985757 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:22.985739    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhd74\" (UniqueName: \"kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-kube-api-access-dhd74\") pod \"alertmanager-main-0\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:23.091123 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.091092    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:50:23.698674 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.698625    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-869c57b67d-xr7lc"]
Sep 16 04:50:23.701688 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.701658    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.703782 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.703754    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 16 04:50:23.703782 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.703781    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 16 04:50:23.703985 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.703795    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5scakse5jp3sq\""
Sep 16 04:50:23.704104 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.704076    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 16 04:50:23.704199 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.704115    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-k7x49\""
Sep 16 04:50:23.704199 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.704130    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 16 04:50:23.704199 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.704159    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 16 04:50:23.713098 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.713075    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-869c57b67d-xr7lc"]
Sep 16 04:50:23.782402 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.782369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.782767 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.782407    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-grpc-tls\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.782767 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.782436    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.782767 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.782573    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2af2863-66d0-4273-992a-dcea43304a6f-metrics-client-ca\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.782767 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.782615    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmj7w\" (UniqueName: \"kubernetes.io/projected/c2af2863-66d0-4273-992a-dcea43304a6f-kube-api-access-zmj7w\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.782767 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.782648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.782767 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.782686    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-tls\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.782767 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.782731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.883429 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.883399    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.883429 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.883434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-grpc-tls\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.883650 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.883454    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.883650 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.883520    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2af2863-66d0-4273-992a-dcea43304a6f-metrics-client-ca\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.883650 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.883552    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmj7w\" (UniqueName: \"kubernetes.io/projected/c2af2863-66d0-4273-992a-dcea43304a6f-kube-api-access-zmj7w\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.883650 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.883589    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.883650 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.883622    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-tls\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.883897 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.883663    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.884516 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.884390    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2af2863-66d0-4273-992a-dcea43304a6f-metrics-client-ca\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.886980 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.886954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-grpc-tls\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.887105 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.887080    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.887890 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.887379    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.887890 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.887405    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.887890 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.887832    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-tls\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.888102 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.887898    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c2af2863-66d0-4273-992a-dcea43304a6f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:23.891164 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:23.891142    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmj7w\" (UniqueName: \"kubernetes.io/projected/c2af2863-66d0-4273-992a-dcea43304a6f-kube-api-access-zmj7w\") pod \"thanos-querier-869c57b67d-xr7lc\" (UID: \"c2af2863-66d0-4273-992a-dcea43304a6f\") " pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:24.013759 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:24.013726    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:26.967962 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:26.967942    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6449bd6479-shxtg"]
Sep 16 04:50:26.970910 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:26.970888    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-869c57b67d-xr7lc"]
Sep 16 04:50:26.974732 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:26.974699    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 04:50:26.979049 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:50:26.979024    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad67bd7_69c2_44af_be60_39a770ea7d73.slice/crio-dbced332011d6e4eb215f49047d22a6a5b9421f1a1c006f2fd86f0931de97c8f WatchSource:0}: Error finding container dbced332011d6e4eb215f49047d22a6a5b9421f1a1c006f2fd86f0931de97c8f: Status 404 returned error can't find the container with id dbced332011d6e4eb215f49047d22a6a5b9421f1a1c006f2fd86f0931de97c8f
Sep 16 04:50:26.980023 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:50:26.980002    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2af2863_66d0_4273_992a_dcea43304a6f.slice/crio-b42c5ec8881125e936e7d6e663d22baa410f75049acd37c01b2827e458ca18b8 WatchSource:0}: Error finding container b42c5ec8881125e936e7d6e663d22baa410f75049acd37c01b2827e458ca18b8: Status 404 returned error can't find the container with id b42c5ec8881125e936e7d6e663d22baa410f75049acd37c01b2827e458ca18b8
Sep 16 04:50:26.981078 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:50:26.981057    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89250dda_ed65_459b_a04a_c6e1650c361f.slice/crio-d5e54b60ee9c77e1c00d794fe213858d3a8a97055376fbaa5f6be8fdfd4cc339 WatchSource:0}: Error finding container d5e54b60ee9c77e1c00d794fe213858d3a8a97055376fbaa5f6be8fdfd4cc339: Status 404 returned error can't find the container with id d5e54b60ee9c77e1c00d794fe213858d3a8a97055376fbaa5f6be8fdfd4cc339
Sep 16 04:50:27.339075 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:27.339018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerStarted","Data":"d5e54b60ee9c77e1c00d794fe213858d3a8a97055376fbaa5f6be8fdfd4cc339"}
Sep 16 04:50:27.341599 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:27.341185    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-lv9b6" event={"ID":"8b149c36-4928-4c9a-b7f0-460c06c0a001","Type":"ContainerStarted","Data":"4de2812bccd9ca05641c49ee0d6725724ab12b8142df4ced98ed15753571d925"}
Sep 16 04:50:27.342026 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:27.341796    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-lv9b6"
Sep 16 04:50:27.343874 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:27.343786    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc" event={"ID":"c2af2863-66d0-4273-992a-dcea43304a6f","Type":"ContainerStarted","Data":"b42c5ec8881125e936e7d6e663d22baa410f75049acd37c01b2827e458ca18b8"}
Sep 16 04:50:27.345470 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:27.345396    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6449bd6479-shxtg" event={"ID":"4ad67bd7-69c2-44af-be60-39a770ea7d73","Type":"ContainerStarted","Data":"dbced332011d6e4eb215f49047d22a6a5b9421f1a1c006f2fd86f0931de97c8f"}
Sep 16 04:50:27.348284 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:27.348222    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hczd9" event={"ID":"db510a42-d551-4397-a7e4-398e88e3a3ce","Type":"ContainerStarted","Data":"320d7812fae9cf180bacd39bcc7a28503d1fb36132728e54557eeb173cc39702"}
Sep 16 04:50:27.349561 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:27.349530    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-lv9b6"
Sep 16 04:50:27.367268 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:27.366163    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-lv9b6" podStartSLOduration=2.107544365 podStartE2EDuration="20.366142434s" totalImagesPullingTime="18.258598069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:27.363571778 +0000 UTC m=+81.024750958" watchObservedRunningTime="2026-09-16 04:50:27.366142434 +0000 UTC m=+81.027321613"
Sep 16 04:50:28.074120 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.074048    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 04:50:28.118528 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.118469    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 04:50:28.118819 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.118626    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.134763 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.134742    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 16 04:50:28.143656 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.135003    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ll4vg\""
Sep 16 04:50:28.144012 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.135096    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 16 04:50:28.144012 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.143984    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 16 04:50:28.144163 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.135210    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 16 04:50:28.144163 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.135250    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 16 04:50:28.144264 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.135285    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 16 04:50:28.144264 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.135324    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 16 04:50:28.144365 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.135365    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 16 04:50:28.144365 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.136739    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 16 04:50:28.144472 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.136787    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 16 04:50:28.144472 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.136924    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eptut90j0faqr\""
Sep 16 04:50:28.144603 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.136961    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 16 04:50:28.144655 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.137037    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 16 04:50:28.144702 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.137074    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 16 04:50:28.144779 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.135144    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 16 04:50:28.154142 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.154120    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 16 04:50:28.220350 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.219664    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c4df87c7-rfpm9"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.224987    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225098    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhm2b\" (UniqueName: \"kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-kube-api-access-qhm2b\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225541    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-config\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225565    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225593    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225674    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225701    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225724    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225762    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225792    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.225860    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.226204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.226247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.228963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.226275    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.327648 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.327168    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.327648 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.327240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.327648 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.327292    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.327648 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.327319    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.327648 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.327349    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.327648 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.327373    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.327648 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.327428    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.327648 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.327451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.331898 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.329194    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.327473    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhm2b\" (UniqueName: \"kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-kube-api-access-qhm2b\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.332197    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-config\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.332240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.332268    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.332297    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.332327    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.332353    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.332395    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.332420    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.332506    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.332538    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.332959 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.332567    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.334596 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.334414    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.335531 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.335502    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.335688 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.335669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.339645 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.337660    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.339645 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.338005    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.339645 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.338889    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.339645 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.339181    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.339645 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.339341    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.347903 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.346281    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhm2b\" (UniqueName: \"kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-kube-api-access-qhm2b\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.356511 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.356211    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-config\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.357210 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.356890    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.357210 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.357093    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-web-config\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.357210 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.357157    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.357802 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.357763    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.357979 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.357944    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.358371 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.358351    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.358522 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.358497    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-config-out\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.361422 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.359340    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.361422 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.360547    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:28.435659 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:28.435292    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:32.288699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:32.288647    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 04:50:32.361964 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:50:32.361933    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded69115d_418a_4234_953c_175f3ae78849.slice/crio-cf08161e67bce732dde6cebe95bbf3f5b0b436a6e60d437846418bbeee24d89d WatchSource:0}: Error finding container cf08161e67bce732dde6cebe95bbf3f5b0b436a6e60d437846418bbeee24d89d: Status 404 returned error can't find the container with id cf08161e67bce732dde6cebe95bbf3f5b0b436a6e60d437846418bbeee24d89d
Sep 16 04:50:32.375205 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:32.375175    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc" event={"ID":"c2af2863-66d0-4273-992a-dcea43304a6f","Type":"ContainerStarted","Data":"bb8076659e48f2fa090d49c2018f7b566a20594c5c8db7f6c616fda8e53421e9"}
Sep 16 04:50:32.377100 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:32.377072    2559 generic.go:356] "Generic (PLEG): container finished" podID="db510a42-d551-4397-a7e4-398e88e3a3ce" containerID="9dbb67dc420c94e5fe5585badc04d5c9131eaf64d24473067d791609d9bbada5" exitCode=0
Sep 16 04:50:32.377197 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:32.377165    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hczd9" event={"ID":"db510a42-d551-4397-a7e4-398e88e3a3ce","Type":"ContainerDied","Data":"9dbb67dc420c94e5fe5585badc04d5c9131eaf64d24473067d791609d9bbada5"}
Sep 16 04:50:32.378697 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:32.378676    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerStarted","Data":"cf08161e67bce732dde6cebe95bbf3f5b0b436a6e60d437846418bbeee24d89d"}
Sep 16 04:50:32.381147 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:32.380522    2559 generic.go:356] "Generic (PLEG): container finished" podID="89250dda-ed65-459b-a04a-c6e1650c361f" containerID="7fcdf0710db4b5596532255118c24f94c1a2ee95fb910dc3456e674c4b6a5585" exitCode=0
Sep 16 04:50:32.381147 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:32.380624    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerDied","Data":"7fcdf0710db4b5596532255118c24f94c1a2ee95fb910dc3456e674c4b6a5585"}
Sep 16 04:50:33.390982 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:33.390902    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc" event={"ID":"c2af2863-66d0-4273-992a-dcea43304a6f","Type":"ContainerStarted","Data":"de75811a97f2a4c3582cbddab3d0f7c6d24f57802f671c7366ab6b6aeca922f8"}
Sep 16 04:50:33.391469 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:33.391068    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc" event={"ID":"c2af2863-66d0-4273-992a-dcea43304a6f","Type":"ContainerStarted","Data":"d4c935725842b068932a8c2e95fda0b947891f7078ab00752b06cad7f298f78c"}
Sep 16 04:50:33.393432 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:33.393345    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6449bd6479-shxtg" event={"ID":"4ad67bd7-69c2-44af-be60-39a770ea7d73","Type":"ContainerStarted","Data":"202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48"}
Sep 16 04:50:33.396260 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:33.396231    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hczd9" event={"ID":"db510a42-d551-4397-a7e4-398e88e3a3ce","Type":"ContainerStarted","Data":"65d861ff37736e676cbb31a01bd99fc9a4a9447e81817b63764b27089006080f"}
Sep 16 04:50:33.396403 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:33.396288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hczd9" event={"ID":"db510a42-d551-4397-a7e4-398e88e3a3ce","Type":"ContainerStarted","Data":"5f48fdcbbddb9fbf0da7bcb459b89dc58d7a1e76fb31048b6647bbd214d92bad"}
Sep 16 04:50:33.398046 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:33.398018    2559 generic.go:356] "Generic (PLEG): container finished" podID="ed69115d-418a-4234-953c-175f3ae78849" containerID="75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77" exitCode=0
Sep 16 04:50:33.398157 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:33.398100    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerDied","Data":"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"}
Sep 16 04:50:33.415929 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:33.415883    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6449bd6479-shxtg" podStartSLOduration=7.0057643 podStartE2EDuration="12.415869666s" totalImagesPullingTime="5.410105366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:33.414827252 +0000 UTC m=+87.076006430" watchObservedRunningTime="2026-09-16 04:50:33.415869666 +0000 UTC m=+87.077048843"
Sep 16 04:50:33.435769 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:33.435719    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hczd9" podStartSLOduration=7.05068597 podStartE2EDuration="12.435704407s" totalImagesPullingTime="5.289554491s" totalInitContainerRuntime="95.463946ms" isStatefulPod=true podCreationTimestamp="2026-09-16 04:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:33.433434931 +0000 UTC m=+87.094614114" watchObservedRunningTime="2026-09-16 04:50:33.435704407 +0000 UTC m=+87.096883586"
Sep 16 04:50:35.412555 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:35.412524    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc" event={"ID":"c2af2863-66d0-4273-992a-dcea43304a6f","Type":"ContainerStarted","Data":"592b60df15e0e3fc78745d387836e7f0197ed1fd8c337b6f52f349446579699f"}
Sep 16 04:50:35.412866 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:35.412647    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc" event={"ID":"c2af2863-66d0-4273-992a-dcea43304a6f","Type":"ContainerStarted","Data":"001df93e0412b951db652473f59a5ad026e540a9967711133cf7af429ee286d5"}
Sep 16 04:50:35.412866 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:35.412690    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc" event={"ID":"c2af2863-66d0-4273-992a-dcea43304a6f","Type":"ContainerStarted","Data":"7652e3dd8dfa16d9e20f001967c7657e3dc9cee8909230f3ac103a9d933b3044"}
Sep 16 04:50:35.412866 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:35.412758    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:35.422723 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:35.422699    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerStarted","Data":"883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a"}
Sep 16 04:50:35.422832 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:35.422761    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerStarted","Data":"a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850"}
Sep 16 04:50:35.422832 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:35.422804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerStarted","Data":"6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2"}
Sep 16 04:50:35.422948 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:35.422844    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerStarted","Data":"cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b"}
Sep 16 04:50:35.422948 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:35.422885    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerStarted","Data":"5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747"}
Sep 16 04:50:35.436135 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:35.436081    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc" podStartSLOduration=5.450929859 podStartE2EDuration="12.436061604s" totalImagesPullingTime="6.985131745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:50:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:35.434016925 +0000 UTC m=+89.095196104" watchObservedRunningTime="2026-09-16 04:50:35.436061604 +0000 UTC m=+89.097240782"
Sep 16 04:50:36.433297 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:36.433248    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerStarted","Data":"bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6"}
Sep 16 04:50:36.462497 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:36.462436    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.212355079 podStartE2EDuration="14.462419018s" totalImagesPullingTime="7.232830188s" totalInitContainerRuntime="17.233751ms" isStatefulPod=false podCreationTimestamp="2026-09-16 04:50:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:36.459951524 +0000 UTC m=+90.121130704" watchObservedRunningTime="2026-09-16 04:50:36.462419018 +0000 UTC m=+90.123598197"
Sep 16 04:50:37.447317 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:37.447280    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-869c57b67d-xr7lc"
Sep 16 04:50:38.445238 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:38.445204    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerStarted","Data":"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"}
Sep 16 04:50:38.445364 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:38.445282    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerStarted","Data":"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"}
Sep 16 04:50:38.445364 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:38.445312    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerStarted","Data":"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"}
Sep 16 04:50:38.445364 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:38.445338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerStarted","Data":"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"}
Sep 16 04:50:39.453464 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:39.453424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerStarted","Data":"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"}
Sep 16 04:50:39.454028 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:39.453533    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerStarted","Data":"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"}
Sep 16 04:50:39.481865 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:39.481813    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.912083676 podStartE2EDuration="11.481794111s" totalImagesPullingTime="4.546325801s" totalInitContainerRuntime="23.384634ms" isStatefulPod=false podCreationTimestamp="2026-09-16 04:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:50:39.480525759 +0000 UTC m=+93.141704937" watchObservedRunningTime="2026-09-16 04:50:39.481794111 +0000 UTC m=+93.142973289"
Sep 16 04:50:40.862775 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:40.862742    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6449bd6479-shxtg"]
Sep 16 04:50:41.926565 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:41.926529    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:50:43.435945 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:43.435908    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:50:50.310652 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:50:50.310615    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xk8c5"
Sep 16 04:51:05.882524 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:05.882444    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6449bd6479-shxtg" podUID="4ad67bd7-69c2-44af-be60-39a770ea7d73" containerName="console" containerID="cri-o://202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48" gracePeriod=15
Sep 16 04:51:06.155289 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.155233    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:51:06.238793 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.238770    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-service-ca\") pod \"4ad67bd7-69c2-44af-be60-39a770ea7d73\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") "
Sep 16 04:51:06.238903 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.238804    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-oauth-config\") pod \"4ad67bd7-69c2-44af-be60-39a770ea7d73\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") "
Sep 16 04:51:06.238903 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.238827    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mzk7\" (UniqueName: \"kubernetes.io/projected/4ad67bd7-69c2-44af-be60-39a770ea7d73-kube-api-access-4mzk7\") pod \"4ad67bd7-69c2-44af-be60-39a770ea7d73\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") "
Sep 16 04:51:06.238903 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.238854    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-config\") pod \"4ad67bd7-69c2-44af-be60-39a770ea7d73\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") "
Sep 16 04:51:06.239246 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.239225    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-service-ca" (OuterVolumeSpecName: "service-ca") pod "4ad67bd7-69c2-44af-be60-39a770ea7d73" (UID: "4ad67bd7-69c2-44af-be60-39a770ea7d73"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:06.239326 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.239294    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-config" (OuterVolumeSpecName: "console-config") pod "4ad67bd7-69c2-44af-be60-39a770ea7d73" (UID: "4ad67bd7-69c2-44af-be60-39a770ea7d73"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:06.241165 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.241143    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4ad67bd7-69c2-44af-be60-39a770ea7d73" (UID: "4ad67bd7-69c2-44af-be60-39a770ea7d73"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:06.241260 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.241210    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad67bd7-69c2-44af-be60-39a770ea7d73-kube-api-access-4mzk7" (OuterVolumeSpecName: "kube-api-access-4mzk7") pod "4ad67bd7-69c2-44af-be60-39a770ea7d73" (UID: "4ad67bd7-69c2-44af-be60-39a770ea7d73"). InnerVolumeSpecName "kube-api-access-4mzk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 04:51:06.339665 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.339642    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-oauth-serving-cert\") pod \"4ad67bd7-69c2-44af-be60-39a770ea7d73\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") "
Sep 16 04:51:06.339772 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.339680    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-serving-cert\") pod \"4ad67bd7-69c2-44af-be60-39a770ea7d73\" (UID: \"4ad67bd7-69c2-44af-be60-39a770ea7d73\") "
Sep 16 04:51:06.339938 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.339922    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:06.340002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.339931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4ad67bd7-69c2-44af-be60-39a770ea7d73" (UID: "4ad67bd7-69c2-44af-be60-39a770ea7d73"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:06.340002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.339946    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-oauth-config\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:06.340002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.339961    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mzk7\" (UniqueName: \"kubernetes.io/projected/4ad67bd7-69c2-44af-be60-39a770ea7d73-kube-api-access-4mzk7\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:06.340002 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.339990    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-config\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:06.341710 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.341682    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4ad67bd7-69c2-44af-be60-39a770ea7d73" (UID: "4ad67bd7-69c2-44af-be60-39a770ea7d73"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:06.441269 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.441221    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4ad67bd7-69c2-44af-be60-39a770ea7d73-oauth-serving-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:06.441269 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.441242    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4ad67bd7-69c2-44af-be60-39a770ea7d73-console-serving-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:06.565121 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.565090    2559 generic.go:356] "Generic (PLEG): container finished" podID="4ad67bd7-69c2-44af-be60-39a770ea7d73" containerID="202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48" exitCode=0
Sep 16 04:51:06.565264 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.565144    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6449bd6479-shxtg"
Sep 16 04:51:06.565264 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.565168    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6449bd6479-shxtg" event={"ID":"4ad67bd7-69c2-44af-be60-39a770ea7d73","Type":"ContainerDied","Data":"202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48"}
Sep 16 04:51:06.565264 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.565251    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6449bd6479-shxtg" event={"ID":"4ad67bd7-69c2-44af-be60-39a770ea7d73","Type":"ContainerDied","Data":"dbced332011d6e4eb215f49047d22a6a5b9421f1a1c006f2fd86f0931de97c8f"}
Sep 16 04:51:06.565415 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.565271    2559 scope.go:117] "RemoveContainer" containerID="202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48"
Sep 16 04:51:06.574327 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.574300    2559 scope.go:117] "RemoveContainer" containerID="202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48"
Sep 16 04:51:06.574630 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:06.574609    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48\": container with ID starting with 202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48 not found: ID does not exist" containerID="202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48"
Sep 16 04:51:06.574698 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.574638    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48"} err="failed to get container status \"202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48\": rpc error: code = NotFound desc = could not find container \"202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48\": container with ID starting with 202dad30756ffd65e5611c7f1f2b48987dd1ba88d9d977462d01a48cdeaa3c48 not found: ID does not exist"
Sep 16 04:51:06.584133 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.584113    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6449bd6479-shxtg"]
Sep 16 04:51:06.591094 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.591071    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6449bd6479-shxtg"]
Sep 16 04:51:06.784465 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:06.784431    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ad67bd7-69c2-44af-be60-39a770ea7d73" path="/var/lib/kubelet/pods/4ad67bd7-69c2-44af-be60-39a770ea7d73/volumes"
Sep 16 04:51:28.436072 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:28.436032    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:28.455960 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:28.455935    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:28.666072 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:28.666048    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:42.042642 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.042603    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 04:51:42.043155 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.042896    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="alertmanager" containerID="cri-o://5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747" gracePeriod=120
Sep 16 04:51:42.043155 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.042949    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy-web" containerID="cri-o://6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2" gracePeriod=120
Sep 16 04:51:42.043155 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.042985    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="config-reloader" containerID="cri-o://cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b" gracePeriod=120
Sep 16 04:51:42.043155 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.043004    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy-metric" containerID="cri-o://883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a" gracePeriod=120
Sep 16 04:51:42.043155 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.042942    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="prom-label-proxy" containerID="cri-o://bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6" gracePeriod=120
Sep 16 04:51:42.043155 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.042937    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy" containerID="cri-o://a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850" gracePeriod=120
Sep 16 04:51:42.713164 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.713124    2559 generic.go:356] "Generic (PLEG): container finished" podID="89250dda-ed65-459b-a04a-c6e1650c361f" containerID="bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6" exitCode=0
Sep 16 04:51:42.713164 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.713155    2559 generic.go:356] "Generic (PLEG): container finished" podID="89250dda-ed65-459b-a04a-c6e1650c361f" containerID="a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850" exitCode=0
Sep 16 04:51:42.713164 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.713163    2559 generic.go:356] "Generic (PLEG): container finished" podID="89250dda-ed65-459b-a04a-c6e1650c361f" containerID="6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2" exitCode=0
Sep 16 04:51:42.713164 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.713169    2559 generic.go:356] "Generic (PLEG): container finished" podID="89250dda-ed65-459b-a04a-c6e1650c361f" containerID="cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b" exitCode=0
Sep 16 04:51:42.713409 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.713175    2559 generic.go:356] "Generic (PLEG): container finished" podID="89250dda-ed65-459b-a04a-c6e1650c361f" containerID="5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747" exitCode=0
Sep 16 04:51:42.713409 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.713195    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerDied","Data":"bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6"}
Sep 16 04:51:42.713409 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.713278    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerDied","Data":"a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850"}
Sep 16 04:51:42.713409 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.713316    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerDied","Data":"6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2"}
Sep 16 04:51:42.713409 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.713342    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerDied","Data":"cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b"}
Sep 16 04:51:42.713409 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:42.713368    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerDied","Data":"5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747"}
Sep 16 04:51:43.282290 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.282268    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.428436 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428366    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-config-volume\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428436 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428408    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-main-db\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428666 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428439    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhd74\" (UniqueName: \"kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-kube-api-access-dhd74\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428666 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428467    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428666 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428530    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-trusted-ca-bundle\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428666 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428572    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-config-out\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428666 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428618    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-web-config\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428666 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428657    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428907 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428683    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-web\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428907 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428713    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-cluster-tls-config\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428907 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428739    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-metrics-client-ca\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428907 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428773    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-main-tls\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.428907 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428779    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 04:51:43.428907 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.428814    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-tls-assets\") pod \"89250dda-ed65-459b-a04a-c6e1650c361f\" (UID: \"89250dda-ed65-459b-a04a-c6e1650c361f\") "
Sep 16 04:51:43.429301 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.429088    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-main-db\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.429809 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.429762    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:43.429937 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.429686    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:43.431640 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.431612    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-config-out" (OuterVolumeSpecName: "config-out") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 04:51:43.432515 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.432308    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 04:51:43.432515 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.432443    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:43.432515 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.432471    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-config-volume" (OuterVolumeSpecName: "config-volume") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:43.432932 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.432907    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-kube-api-access-dhd74" (OuterVolumeSpecName: "kube-api-access-dhd74") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "kube-api-access-dhd74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 04:51:43.433129 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.433087    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:43.433334 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.433303    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:43.434013 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.433981    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:43.436664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.436632    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:43.443613 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.443583    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-web-config" (OuterVolumeSpecName: "web-config") pod "89250dda-ed65-459b-a04a-c6e1650c361f" (UID: "89250dda-ed65-459b-a04a-c6e1650c361f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:43.530148 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530125    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.530148 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530146    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/89250dda-ed65-459b-a04a-c6e1650c361f-config-out\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.530265 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530154    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-web-config\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.530265 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530163    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.530265 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530171    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.530265 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530180    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-cluster-tls-config\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.530265 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530188    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/89250dda-ed65-459b-a04a-c6e1650c361f-metrics-client-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.530265 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530196    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-main-tls\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.530265 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530205    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-tls-assets\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.530265 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530212    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.530265 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530219    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhd74\" (UniqueName: \"kubernetes.io/projected/89250dda-ed65-459b-a04a-c6e1650c361f-kube-api-access-dhd74\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.530265 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.530229    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/89250dda-ed65-459b-a04a-c6e1650c361f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:43.720822 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.720763    2559 generic.go:356] "Generic (PLEG): container finished" podID="89250dda-ed65-459b-a04a-c6e1650c361f" containerID="883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a" exitCode=0
Sep 16 04:51:43.720902 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.720838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerDied","Data":"883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a"}
Sep 16 04:51:43.720948 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.720909    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"89250dda-ed65-459b-a04a-c6e1650c361f","Type":"ContainerDied","Data":"d5e54b60ee9c77e1c00d794fe213858d3a8a97055376fbaa5f6be8fdfd4cc339"}
Sep 16 04:51:43.720948 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.720848    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.720948 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.720942    2559 scope.go:117] "RemoveContainer" containerID="bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6"
Sep 16 04:51:43.729791 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.729630    2559 scope.go:117] "RemoveContainer" containerID="883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a"
Sep 16 04:51:43.736643 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.736624    2559 scope.go:117] "RemoveContainer" containerID="a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850"
Sep 16 04:51:43.743273 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.743258    2559 scope.go:117] "RemoveContainer" containerID="6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2"
Sep 16 04:51:43.745730 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.745707    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 04:51:43.751312 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.751288    2559 scope.go:117] "RemoveContainer" containerID="cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b"
Sep 16 04:51:43.752051 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.752031    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 04:51:43.759606 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.759572    2559 scope.go:117] "RemoveContainer" containerID="5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747"
Sep 16 04:51:43.766642 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.766626    2559 scope.go:117] "RemoveContainer" containerID="7fcdf0710db4b5596532255118c24f94c1a2ee95fb910dc3456e674c4b6a5585"
Sep 16 04:51:43.773585 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.773569    2559 scope.go:117] "RemoveContainer" containerID="bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6"
Sep 16 04:51:43.773845 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:43.773824    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6\": container with ID starting with bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6 not found: ID does not exist" containerID="bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6"
Sep 16 04:51:43.773896 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.773853    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6"} err="failed to get container status \"bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6\": rpc error: code = NotFound desc = could not find container \"bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6\": container with ID starting with bad1565e1f981881fe936df99e603a39c0f94a567b36db98d2e0a6e271b420e6 not found: ID does not exist"
Sep 16 04:51:43.773896 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.773871    2559 scope.go:117] "RemoveContainer" containerID="883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a"
Sep 16 04:51:43.774115 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:43.774096    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a\": container with ID starting with 883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a not found: ID does not exist" containerID="883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a"
Sep 16 04:51:43.774158 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.774122    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a"} err="failed to get container status \"883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a\": rpc error: code = NotFound desc = could not find container \"883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a\": container with ID starting with 883a388d3d9ef701c747242be5d002bf10f452eef9430d40813bc8744c31b20a not found: ID does not exist"
Sep 16 04:51:43.774158 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.774137    2559 scope.go:117] "RemoveContainer" containerID="a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850"
Sep 16 04:51:43.774356 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:43.774339    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850\": container with ID starting with a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850 not found: ID does not exist" containerID="a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850"
Sep 16 04:51:43.774417 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.774364    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850"} err="failed to get container status \"a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850\": rpc error: code = NotFound desc = could not find container \"a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850\": container with ID starting with a76d2ff5f4537a06f0e20dc01a7527b4b18484e640a2b10d4786a86eddc72850 not found: ID does not exist"
Sep 16 04:51:43.774417 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.774384    2559 scope.go:117] "RemoveContainer" containerID="6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2"
Sep 16 04:51:43.774662 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:43.774643    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2\": container with ID starting with 6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2 not found: ID does not exist" containerID="6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2"
Sep 16 04:51:43.774750 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.774664    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2"} err="failed to get container status \"6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2\": rpc error: code = NotFound desc = could not find container \"6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2\": container with ID starting with 6fd32619e8f89c53ceb449dd90a1cf4cdc075f289e56742d0ca241b537ebadb2 not found: ID does not exist"
Sep 16 04:51:43.774750 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.774677    2559 scope.go:117] "RemoveContainer" containerID="cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b"
Sep 16 04:51:43.774949 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:43.774933    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b\": container with ID starting with cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b not found: ID does not exist" containerID="cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b"
Sep 16 04:51:43.774992 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.774954    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b"} err="failed to get container status \"cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b\": rpc error: code = NotFound desc = could not find container \"cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b\": container with ID starting with cfff73bffeda23041ba5bb24867fded1f90655fbef041a5642b671b3b360b96b not found: ID does not exist"
Sep 16 04:51:43.774992 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.774971    2559 scope.go:117] "RemoveContainer" containerID="5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747"
Sep 16 04:51:43.775179 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:43.775164    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747\": container with ID starting with 5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747 not found: ID does not exist" containerID="5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747"
Sep 16 04:51:43.775214 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.775184    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747"} err="failed to get container status \"5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747\": rpc error: code = NotFound desc = could not find container \"5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747\": container with ID starting with 5b9834b228f2ed75403530cf08fb2c9ce63ff799516c2ded5e239d9156b70747 not found: ID does not exist"
Sep 16 04:51:43.775214 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.775199    2559 scope.go:117] "RemoveContainer" containerID="7fcdf0710db4b5596532255118c24f94c1a2ee95fb910dc3456e674c4b6a5585"
Sep 16 04:51:43.775415 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:43.775401    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fcdf0710db4b5596532255118c24f94c1a2ee95fb910dc3456e674c4b6a5585\": container with ID starting with 7fcdf0710db4b5596532255118c24f94c1a2ee95fb910dc3456e674c4b6a5585 not found: ID does not exist" containerID="7fcdf0710db4b5596532255118c24f94c1a2ee95fb910dc3456e674c4b6a5585"
Sep 16 04:51:43.775456 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.775417    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fcdf0710db4b5596532255118c24f94c1a2ee95fb910dc3456e674c4b6a5585"} err="failed to get container status \"7fcdf0710db4b5596532255118c24f94c1a2ee95fb910dc3456e674c4b6a5585\": rpc error: code = NotFound desc = could not find container \"7fcdf0710db4b5596532255118c24f94c1a2ee95fb910dc3456e674c4b6a5585\": container with ID starting with 7fcdf0710db4b5596532255118c24f94c1a2ee95fb910dc3456e674c4b6a5585 not found: ID does not exist"
Sep 16 04:51:43.780098 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780078    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 04:51:43.780339 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780328    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy-web"
Sep 16 04:51:43.780380 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780341    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy-web"
Sep 16 04:51:43.780380 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780354    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy-metric"
Sep 16 04:51:43.780380 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780359    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy-metric"
Sep 16 04:51:43.780380 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780367    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ad67bd7-69c2-44af-be60-39a770ea7d73" containerName="console"
Sep 16 04:51:43.780380 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780373    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ad67bd7-69c2-44af-be60-39a770ea7d73" containerName="console"
Sep 16 04:51:43.780380 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780380    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="alertmanager"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780386    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="alertmanager"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780392    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="prom-label-proxy"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780397    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="prom-label-proxy"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780406    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="init-config-reloader"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780410    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="init-config-reloader"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780419    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780424    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780432    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="config-reloader"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780437    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="config-reloader"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780516    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy-metric"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780525    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="config-reloader"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780529    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780535    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="prom-label-proxy"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780540    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ad67bd7-69c2-44af-be60-39a770ea7d73" containerName="console"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780547    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="alertmanager"
Sep 16 04:51:43.780578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.780552    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" containerName="kube-rbac-proxy-web"
Sep 16 04:51:43.783990 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.783973    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.786253 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.786063    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 16 04:51:43.786253 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.786071    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 16 04:51:43.786253 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.786125    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 16 04:51:43.786253 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.786165    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 16 04:51:43.786253 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.786175    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 16 04:51:43.786253 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.786191    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 16 04:51:43.786253 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.786171    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-n76bg\""
Sep 16 04:51:43.786594 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.786522    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 16 04:51:43.786594 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.786540    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 16 04:51:43.792212 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.792194    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 16 04:51:43.800010 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.799990    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 04:51:43.933299 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3956437-acd4-4aad-a0b4-bf1158da6ba1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933299 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933471 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933319    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppmk7\" (UniqueName: \"kubernetes.io/projected/e3956437-acd4-4aad-a0b4-bf1158da6ba1-kube-api-access-ppmk7\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933471 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3956437-acd4-4aad-a0b4-bf1158da6ba1-config-out\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933471 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933421    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933596 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933509    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933596 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3956437-acd4-4aad-a0b4-bf1158da6ba1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933596 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3956437-acd4-4aad-a0b4-bf1158da6ba1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933687 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933619    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3956437-acd4-4aad-a0b4-bf1158da6ba1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933687 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933643    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933742 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933691    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933742 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:43.933801 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:43.933760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-web-config\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034320 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034290    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034452 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-web-config\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034452 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3956437-acd4-4aad-a0b4-bf1158da6ba1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034590 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034463    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034590 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034505    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppmk7\" (UniqueName: \"kubernetes.io/projected/e3956437-acd4-4aad-a0b4-bf1158da6ba1-kube-api-access-ppmk7\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034590 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034526    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3956437-acd4-4aad-a0b4-bf1158da6ba1-config-out\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034590 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034590 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034588    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034835 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034611    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3956437-acd4-4aad-a0b4-bf1158da6ba1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034835 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3956437-acd4-4aad-a0b4-bf1158da6ba1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034835 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034672    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3956437-acd4-4aad-a0b4-bf1158da6ba1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034835 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034699    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034835 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.034835 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.034769    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3956437-acd4-4aad-a0b4-bf1158da6ba1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.036001 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.035660    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3956437-acd4-4aad-a0b4-bf1158da6ba1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.037501 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.037448    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3956437-acd4-4aad-a0b4-bf1158da6ba1-config-out\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.037716 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.037694    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.037815 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.037799    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3956437-acd4-4aad-a0b4-bf1158da6ba1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.037883 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.037814    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.037947 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.037887    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-web-config\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.038001 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.037946    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.038001 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.037981    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.038342 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.038326    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3956437-acd4-4aad-a0b4-bf1158da6ba1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.038411 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.038397    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.039815 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.039794    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3956437-acd4-4aad-a0b4-bf1158da6ba1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.042800 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.042783    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppmk7\" (UniqueName: \"kubernetes.io/projected/e3956437-acd4-4aad-a0b4-bf1158da6ba1-kube-api-access-ppmk7\") pod \"alertmanager-main-0\" (UID: \"e3956437-acd4-4aad-a0b4-bf1158da6ba1\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.093328 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.093299    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 16 04:51:44.371130 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.371108    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 16 04:51:44.373125 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:51:44.373097    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3956437_acd4_4aad_a0b4_bf1158da6ba1.slice/crio-cdad25bc097393868c340d72c0f2082b1c1817889ef0c78db784fbcd30fb8d9d WatchSource:0}: Error finding container cdad25bc097393868c340d72c0f2082b1c1817889ef0c78db784fbcd30fb8d9d: Status 404 returned error can't find the container with id cdad25bc097393868c340d72c0f2082b1c1817889ef0c78db784fbcd30fb8d9d
Sep 16 04:51:44.726685 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.726650    2559 generic.go:356] "Generic (PLEG): container finished" podID="e3956437-acd4-4aad-a0b4-bf1158da6ba1" containerID="00682a2534d03b61050298fb3d5543d7379334270532b59aa83cee29b1c218e9" exitCode=0
Sep 16 04:51:44.726811 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.726747    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3956437-acd4-4aad-a0b4-bf1158da6ba1","Type":"ContainerDied","Data":"00682a2534d03b61050298fb3d5543d7379334270532b59aa83cee29b1c218e9"}
Sep 16 04:51:44.726872 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.726851    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3956437-acd4-4aad-a0b4-bf1158da6ba1","Type":"ContainerStarted","Data":"cdad25bc097393868c340d72c0f2082b1c1817889ef0c78db784fbcd30fb8d9d"}
Sep 16 04:51:44.784773 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:44.784753    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89250dda-ed65-459b-a04a-c6e1650c361f" path="/var/lib/kubelet/pods/89250dda-ed65-459b-a04a-c6e1650c361f/volumes"
Sep 16 04:51:45.735782 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:45.735743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3956437-acd4-4aad-a0b4-bf1158da6ba1","Type":"ContainerStarted","Data":"2da965b1c3deda2022e12f701d2a92c0481bbeeaef2d72ba23584efa3683be76"}
Sep 16 04:51:45.736130 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:45.735826    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3956437-acd4-4aad-a0b4-bf1158da6ba1","Type":"ContainerStarted","Data":"684cf3f357df7f967d1b7238e6e30dc74467d2153783c02befa3467dc12a54b7"}
Sep 16 04:51:45.736130 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:45.735867    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3956437-acd4-4aad-a0b4-bf1158da6ba1","Type":"ContainerStarted","Data":"9c70ea947cc061d746cb7983e94fc718b66f41452d0bddfc51df06ccc398d4e1"}
Sep 16 04:51:45.736130 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:45.735908    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3956437-acd4-4aad-a0b4-bf1158da6ba1","Type":"ContainerStarted","Data":"12a6d6a34da79b23fbe3e1e1e57252a6a7b65e644687c85effcdae14e0e62071"}
Sep 16 04:51:45.736130 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:45.735943    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3956437-acd4-4aad-a0b4-bf1158da6ba1","Type":"ContainerStarted","Data":"1781b0c07d94bbf99fa53ea3573d7748b8c6f5593051fe239f570c7f9c9274e7"}
Sep 16 04:51:45.736130 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:45.735979    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3956437-acd4-4aad-a0b4-bf1158da6ba1","Type":"ContainerStarted","Data":"94a79637f9f5d5427649444d76a6a73a7386ef426345665db2b0ef4f44998310"}
Sep 16 04:51:45.762150 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:45.762090    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.742491235 podStartE2EDuration="2.762069709s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.578474ms" isStatefulPod=false podCreationTimestamp="2026-09-16 04:51:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:51:45.761180193 +0000 UTC m=+159.422359371" watchObservedRunningTime="2026-09-16 04:51:45.762069709 +0000 UTC m=+159.423248887"
Sep 16 04:51:46.354253 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.354217    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 04:51:46.354579 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.354525    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="prometheus" containerID="cri-o://c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49" gracePeriod=600
Sep 16 04:51:46.354808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.354544    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279" gracePeriod=600
Sep 16 04:51:46.354913 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.354551    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy" containerID="cri-o://a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d" gracePeriod=600
Sep 16 04:51:46.354976 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.354584    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="config-reloader" containerID="cri-o://b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9" gracePeriod=600
Sep 16 04:51:46.355028 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.354584    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy-web" containerID="cri-o://c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6" gracePeriod=600
Sep 16 04:51:46.355082 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.354652    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="thanos-sidecar" containerID="cri-o://4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3" gracePeriod=600
Sep 16 04:51:46.608872 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.608808    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:46.742983 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.742952    2559 generic.go:356] "Generic (PLEG): container finished" podID="ed69115d-418a-4234-953c-175f3ae78849" containerID="3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279" exitCode=0
Sep 16 04:51:46.742983 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.742977    2559 generic.go:356] "Generic (PLEG): container finished" podID="ed69115d-418a-4234-953c-175f3ae78849" containerID="a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d" exitCode=0
Sep 16 04:51:46.742983 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.742987    2559 generic.go:356] "Generic (PLEG): container finished" podID="ed69115d-418a-4234-953c-175f3ae78849" containerID="c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6" exitCode=0
Sep 16 04:51:46.742983 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.742994    2559 generic.go:356] "Generic (PLEG): container finished" podID="ed69115d-418a-4234-953c-175f3ae78849" containerID="4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3" exitCode=0
Sep 16 04:51:46.742983 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.743002    2559 generic.go:356] "Generic (PLEG): container finished" podID="ed69115d-418a-4234-953c-175f3ae78849" containerID="b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9" exitCode=0
Sep 16 04:51:46.743601 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.743010    2559 generic.go:356] "Generic (PLEG): container finished" podID="ed69115d-418a-4234-953c-175f3ae78849" containerID="c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49" exitCode=0
Sep 16 04:51:46.743601 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.743030    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:46.743601 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.743036    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerDied","Data":"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"}
Sep 16 04:51:46.743601 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.743117    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerDied","Data":"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"}
Sep 16 04:51:46.743601 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.743176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerDied","Data":"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"}
Sep 16 04:51:46.743601 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.743221    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerDied","Data":"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"}
Sep 16 04:51:46.743601 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.743241    2559 scope.go:117] "RemoveContainer" containerID="3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"
Sep 16 04:51:46.743601 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.743264    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerDied","Data":"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"}
Sep 16 04:51:46.743601 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.743307    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerDied","Data":"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"}
Sep 16 04:51:46.743601 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.743343    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ed69115d-418a-4234-953c-175f3ae78849","Type":"ContainerDied","Data":"cf08161e67bce732dde6cebe95bbf3f5b0b436a6e60d437846418bbeee24d89d"}
Sep 16 04:51:46.750949 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.750933    2559 scope.go:117] "RemoveContainer" containerID="a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"
Sep 16 04:51:46.755999 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.755980    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-serving-certs-ca-bundle\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756087 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756008    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-config\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756087 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756040    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-grpc-tls\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756087 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756063    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-kube-rbac-proxy\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756244 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756090    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-db\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756244 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756111    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-web-config\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756244 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756139    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756244 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756163    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-2\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756244 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756191    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-metrics-client-ca\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756244 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756226    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-kubelet-serving-ca-bundle\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756546 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756257    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-tls-assets\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756546 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756283    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-0\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756546 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756312    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-thanos-prometheus-http-client-file\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756546 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756349    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-trusted-ca-bundle\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756729 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756675    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:46.756785 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756726    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-metrics-client-certs\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756785 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756730    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:46.756785 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756764    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-1\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756933 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756802    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-tls\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.756993 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756968    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhm2b\" (UniqueName: \"kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-kube-api-access-qhm2b\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.757044 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756997    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.757044 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.757026    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-config-out\") pod \"ed69115d-418a-4234-953c-175f3ae78849\" (UID: \"ed69115d-418a-4234-953c-175f3ae78849\") "
Sep 16 04:51:46.757403 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.757281    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-metrics-client-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.757403 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.757299    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.758643 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.756915    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:46.758756 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.757216    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:46.758835 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.757517    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:46.758923 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.758120    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 04:51:46.759019 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.758657    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:46.759844 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.759816    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:51:46.760058 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.760011    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:46.760211 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.760166    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:46.760334 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.760306    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 04:51:46.760454 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.760439    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-config" (OuterVolumeSpecName: "config") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:46.760683 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.760544    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-kube-api-access-qhm2b" (OuterVolumeSpecName: "kube-api-access-qhm2b") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "kube-api-access-qhm2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 04:51:46.760683 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.760645    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:46.761069 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.760962    2559 scope.go:117] "RemoveContainer" containerID="c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"
Sep 16 04:51:46.761403 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.761348    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:46.761403 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.761371    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:46.762004 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.761985    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:46.762276 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.762259    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-config-out" (OuterVolumeSpecName: "config-out") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 04:51:46.762712 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.762616    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:46.767921 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.767904    2559 scope.go:117] "RemoveContainer" containerID="4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"
Sep 16 04:51:46.772523 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.772501    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-web-config" (OuterVolumeSpecName: "web-config") pod "ed69115d-418a-4234-953c-175f3ae78849" (UID: "ed69115d-418a-4234-953c-175f3ae78849"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:51:46.774552 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.774534    2559 scope.go:117] "RemoveContainer" containerID="b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"
Sep 16 04:51:46.781645 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.781629    2559 scope.go:117] "RemoveContainer" containerID="c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"
Sep 16 04:51:46.789596 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.789577    2559 scope.go:117] "RemoveContainer" containerID="75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"
Sep 16 04:51:46.797050 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.797036    2559 scope.go:117] "RemoveContainer" containerID="3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"
Sep 16 04:51:46.797265 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:46.797248    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": container with ID starting with 3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279 not found: ID does not exist" containerID="3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"
Sep 16 04:51:46.797310 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.797272    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"} err="failed to get container status \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": rpc error: code = NotFound desc = could not find container \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": container with ID starting with 3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279 not found: ID does not exist"
Sep 16 04:51:46.797310 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.797291    2559 scope.go:117] "RemoveContainer" containerID="a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"
Sep 16 04:51:46.797526 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:46.797499    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": container with ID starting with a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d not found: ID does not exist" containerID="a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"
Sep 16 04:51:46.797594 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.797536    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"} err="failed to get container status \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": rpc error: code = NotFound desc = could not find container \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": container with ID starting with a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d not found: ID does not exist"
Sep 16 04:51:46.797594 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.797557    2559 scope.go:117] "RemoveContainer" containerID="c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"
Sep 16 04:51:46.797847 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:46.797830    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": container with ID starting with c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6 not found: ID does not exist" containerID="c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"
Sep 16 04:51:46.797891 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.797853    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"} err="failed to get container status \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": rpc error: code = NotFound desc = could not find container \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": container with ID starting with c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6 not found: ID does not exist"
Sep 16 04:51:46.797891 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.797869    2559 scope.go:117] "RemoveContainer" containerID="4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"
Sep 16 04:51:46.798097 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:46.798082    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": container with ID starting with 4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3 not found: ID does not exist" containerID="4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"
Sep 16 04:51:46.798148 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.798100    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"} err="failed to get container status \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": rpc error: code = NotFound desc = could not find container \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": container with ID starting with 4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3 not found: ID does not exist"
Sep 16 04:51:46.798148 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.798114    2559 scope.go:117] "RemoveContainer" containerID="b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"
Sep 16 04:51:46.798339 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:46.798322    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": container with ID starting with b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9 not found: ID does not exist" containerID="b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"
Sep 16 04:51:46.798397 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.798346    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"} err="failed to get container status \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": rpc error: code = NotFound desc = could not find container \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": container with ID starting with b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9 not found: ID does not exist"
Sep 16 04:51:46.798397 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.798366    2559 scope.go:117] "RemoveContainer" containerID="c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"
Sep 16 04:51:46.798662 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:46.798640    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": container with ID starting with c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49 not found: ID does not exist" containerID="c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"
Sep 16 04:51:46.798734 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.798665    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"} err="failed to get container status \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": rpc error: code = NotFound desc = could not find container \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": container with ID starting with c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49 not found: ID does not exist"
Sep 16 04:51:46.798734 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.798679    2559 scope.go:117] "RemoveContainer" containerID="75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"
Sep 16 04:51:46.798918 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:51:46.798901    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": container with ID starting with 75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77 not found: ID does not exist" containerID="75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"
Sep 16 04:51:46.798978 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.798925    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"} err="failed to get container status \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": rpc error: code = NotFound desc = could not find container \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": container with ID starting with 75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77 not found: ID does not exist"
Sep 16 04:51:46.798978 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.798948    2559 scope.go:117] "RemoveContainer" containerID="3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"
Sep 16 04:51:46.799228 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.799211    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"} err="failed to get container status \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": rpc error: code = NotFound desc = could not find container \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": container with ID starting with 3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279 not found: ID does not exist"
Sep 16 04:51:46.799301 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.799229    2559 scope.go:117] "RemoveContainer" containerID="a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"
Sep 16 04:51:46.799455 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.799439    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"} err="failed to get container status \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": rpc error: code = NotFound desc = could not find container \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": container with ID starting with a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d not found: ID does not exist"
Sep 16 04:51:46.799542 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.799456    2559 scope.go:117] "RemoveContainer" containerID="c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"
Sep 16 04:51:46.799703 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.799685    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"} err="failed to get container status \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": rpc error: code = NotFound desc = could not find container \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": container with ID starting with c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6 not found: ID does not exist"
Sep 16 04:51:46.799748 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.799704    2559 scope.go:117] "RemoveContainer" containerID="4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"
Sep 16 04:51:46.799936 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.799916    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"} err="failed to get container status \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": rpc error: code = NotFound desc = could not find container \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": container with ID starting with 4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3 not found: ID does not exist"
Sep 16 04:51:46.800011 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.799938    2559 scope.go:117] "RemoveContainer" containerID="b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"
Sep 16 04:51:46.800153 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.800138    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"} err="failed to get container status \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": rpc error: code = NotFound desc = could not find container \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": container with ID starting with b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9 not found: ID does not exist"
Sep 16 04:51:46.800198 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.800153    2559 scope.go:117] "RemoveContainer" containerID="c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"
Sep 16 04:51:46.800336 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.800322    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"} err="failed to get container status \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": rpc error: code = NotFound desc = could not find container \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": container with ID starting with c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49 not found: ID does not exist"
Sep 16 04:51:46.800336 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.800335    2559 scope.go:117] "RemoveContainer" containerID="75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"
Sep 16 04:51:46.800529 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.800515    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"} err="failed to get container status \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": rpc error: code = NotFound desc = could not find container \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": container with ID starting with 75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77 not found: ID does not exist"
Sep 16 04:51:46.800579 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.800529    2559 scope.go:117] "RemoveContainer" containerID="3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"
Sep 16 04:51:46.800722 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.800704    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"} err="failed to get container status \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": rpc error: code = NotFound desc = could not find container \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": container with ID starting with 3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279 not found: ID does not exist"
Sep 16 04:51:46.800781 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.800723    2559 scope.go:117] "RemoveContainer" containerID="a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"
Sep 16 04:51:46.800919 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.800901    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"} err="failed to get container status \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": rpc error: code = NotFound desc = could not find container \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": container with ID starting with a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d not found: ID does not exist"
Sep 16 04:51:46.800965 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.800921    2559 scope.go:117] "RemoveContainer" containerID="c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"
Sep 16 04:51:46.801103 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.801089    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"} err="failed to get container status \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": rpc error: code = NotFound desc = could not find container \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": container with ID starting with c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6 not found: ID does not exist"
Sep 16 04:51:46.801147 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.801103    2559 scope.go:117] "RemoveContainer" containerID="4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"
Sep 16 04:51:46.801284 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.801267    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"} err="failed to get container status \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": rpc error: code = NotFound desc = could not find container \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": container with ID starting with 4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3 not found: ID does not exist"
Sep 16 04:51:46.801349 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.801285    2559 scope.go:117] "RemoveContainer" containerID="b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"
Sep 16 04:51:46.801580 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.801469    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"} err="failed to get container status \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": rpc error: code = NotFound desc = could not find container \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": container with ID starting with b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9 not found: ID does not exist"
Sep 16 04:51:46.801628 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.801581    2559 scope.go:117] "RemoveContainer" containerID="c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"
Sep 16 04:51:46.801782 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.801766    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"} err="failed to get container status \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": rpc error: code = NotFound desc = could not find container \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": container with ID starting with c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49 not found: ID does not exist"
Sep 16 04:51:46.801822 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.801781    2559 scope.go:117] "RemoveContainer" containerID="75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"
Sep 16 04:51:46.801969 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.801952    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"} err="failed to get container status \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": rpc error: code = NotFound desc = could not find container \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": container with ID starting with 75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77 not found: ID does not exist"
Sep 16 04:51:46.802029 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.801971    2559 scope.go:117] "RemoveContainer" containerID="3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"
Sep 16 04:51:46.802170 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.802156    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"} err="failed to get container status \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": rpc error: code = NotFound desc = could not find container \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": container with ID starting with 3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279 not found: ID does not exist"
Sep 16 04:51:46.802218 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.802170    2559 scope.go:117] "RemoveContainer" containerID="a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"
Sep 16 04:51:46.802345 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.802327    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"} err="failed to get container status \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": rpc error: code = NotFound desc = could not find container \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": container with ID starting with a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d not found: ID does not exist"
Sep 16 04:51:46.802409 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.802346    2559 scope.go:117] "RemoveContainer" containerID="c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"
Sep 16 04:51:46.802583 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.802565    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"} err="failed to get container status \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": rpc error: code = NotFound desc = could not find container \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": container with ID starting with c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6 not found: ID does not exist"
Sep 16 04:51:46.802657 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.802585    2559 scope.go:117] "RemoveContainer" containerID="4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"
Sep 16 04:51:46.802795 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.802778    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"} err="failed to get container status \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": rpc error: code = NotFound desc = could not find container \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": container with ID starting with 4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3 not found: ID does not exist"
Sep 16 04:51:46.802866 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.802797    2559 scope.go:117] "RemoveContainer" containerID="b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"
Sep 16 04:51:46.803049 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.803031    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"} err="failed to get container status \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": rpc error: code = NotFound desc = could not find container \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": container with ID starting with b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9 not found: ID does not exist"
Sep 16 04:51:46.803095 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.803051    2559 scope.go:117] "RemoveContainer" containerID="c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"
Sep 16 04:51:46.803256 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.803239    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"} err="failed to get container status \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": rpc error: code = NotFound desc = could not find container \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": container with ID starting with c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49 not found: ID does not exist"
Sep 16 04:51:46.803322 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.803258    2559 scope.go:117] "RemoveContainer" containerID="75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"
Sep 16 04:51:46.803507 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.803474    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"} err="failed to get container status \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": rpc error: code = NotFound desc = could not find container \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": container with ID starting with 75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77 not found: ID does not exist"
Sep 16 04:51:46.803561 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.803508    2559 scope.go:117] "RemoveContainer" containerID="3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"
Sep 16 04:51:46.803716 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.803698    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"} err="failed to get container status \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": rpc error: code = NotFound desc = could not find container \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": container with ID starting with 3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279 not found: ID does not exist"
Sep 16 04:51:46.803780 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.803717    2559 scope.go:117] "RemoveContainer" containerID="a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"
Sep 16 04:51:46.803941 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.803920    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"} err="failed to get container status \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": rpc error: code = NotFound desc = could not find container \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": container with ID starting with a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d not found: ID does not exist"
Sep 16 04:51:46.803986 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.803943    2559 scope.go:117] "RemoveContainer" containerID="c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"
Sep 16 04:51:46.804144 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.804127    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"} err="failed to get container status \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": rpc error: code = NotFound desc = could not find container \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": container with ID starting with c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6 not found: ID does not exist"
Sep 16 04:51:46.804243 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.804145    2559 scope.go:117] "RemoveContainer" containerID="4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"
Sep 16 04:51:46.804356 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.804340    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"} err="failed to get container status \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": rpc error: code = NotFound desc = could not find container \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": container with ID starting with 4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3 not found: ID does not exist"
Sep 16 04:51:46.804397 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.804356    2559 scope.go:117] "RemoveContainer" containerID="b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"
Sep 16 04:51:46.804578 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.804561    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"} err="failed to get container status \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": rpc error: code = NotFound desc = could not find container \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": container with ID starting with b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9 not found: ID does not exist"
Sep 16 04:51:46.804643 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.804579    2559 scope.go:117] "RemoveContainer" containerID="c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"
Sep 16 04:51:46.804789 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.804773    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"} err="failed to get container status \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": rpc error: code = NotFound desc = could not find container \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": container with ID starting with c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49 not found: ID does not exist"
Sep 16 04:51:46.804834 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.804789    2559 scope.go:117] "RemoveContainer" containerID="75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"
Sep 16 04:51:46.804974 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.804955    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"} err="failed to get container status \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": rpc error: code = NotFound desc = could not find container \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": container with ID starting with 75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77 not found: ID does not exist"
Sep 16 04:51:46.805034 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.804974    2559 scope.go:117] "RemoveContainer" containerID="3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"
Sep 16 04:51:46.805197 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.805182    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279"} err="failed to get container status \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": rpc error: code = NotFound desc = could not find container \"3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279\": container with ID starting with 3011fc0a8955e8b0b8b8aa0067f663588ca4efc5c44ac9f85bf6300203dd0279 not found: ID does not exist"
Sep 16 04:51:46.805242 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.805197    2559 scope.go:117] "RemoveContainer" containerID="a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"
Sep 16 04:51:46.805398 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.805383    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d"} err="failed to get container status \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": rpc error: code = NotFound desc = could not find container \"a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d\": container with ID starting with a08bf3af7dbfbebc277fc410492de14716d2ea547ecc6341685126901f47895d not found: ID does not exist"
Sep 16 04:51:46.805436 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.805398    2559 scope.go:117] "RemoveContainer" containerID="c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"
Sep 16 04:51:46.805629 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.805613    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6"} err="failed to get container status \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": rpc error: code = NotFound desc = could not find container \"c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6\": container with ID starting with c1dc30902a99184016403c12222fe01f1e9bab3351a7a60841b06bfee15b8cc6 not found: ID does not exist"
Sep 16 04:51:46.805678 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.805630    2559 scope.go:117] "RemoveContainer" containerID="4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"
Sep 16 04:51:46.805808 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.805792    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3"} err="failed to get container status \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": rpc error: code = NotFound desc = could not find container \"4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3\": container with ID starting with 4a2f0e56eda91c4d8642a80e73f3f736041ac2432074b966deddea5473d2e4b3 not found: ID does not exist"
Sep 16 04:51:46.805850 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.805808    2559 scope.go:117] "RemoveContainer" containerID="b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"
Sep 16 04:51:46.805972 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.805957    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9"} err="failed to get container status \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": rpc error: code = NotFound desc = could not find container \"b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9\": container with ID starting with b3b34943ad94de88feb91035db8e06bb734101cdd370c9218b352ebc65a355a9 not found: ID does not exist"
Sep 16 04:51:46.806013 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.805972    2559 scope.go:117] "RemoveContainer" containerID="c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"
Sep 16 04:51:46.806160 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.806145    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49"} err="failed to get container status \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": rpc error: code = NotFound desc = could not find container \"c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49\": container with ID starting with c8c8c073afb4d7070ce92297bd16df604dd748bb58589e251c212eb0b1214a49 not found: ID does not exist"
Sep 16 04:51:46.806205 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.806160    2559 scope.go:117] "RemoveContainer" containerID="75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"
Sep 16 04:51:46.806342 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.806328    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77"} err="failed to get container status \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": rpc error: code = NotFound desc = could not find container \"75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77\": container with ID starting with 75bc77f1acd252531917d76d3cd26328d5de1f68c040e1d2f744023ceb726c77 not found: ID does not exist"
Sep 16 04:51:46.858499 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858452    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858600 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858517    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhm2b\" (UniqueName: \"kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-kube-api-access-qhm2b\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858600 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858533    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858600 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858543    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-config-out\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858600 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858555    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858600 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858569    2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-config\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858600 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858579    2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-grpc-tls\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858600 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858587    2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-kube-rbac-proxy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858600 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858597    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-db\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858862 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858605    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-web-config\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858862 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858613    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858862 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858621    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858862 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858630    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858862 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858638    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ed69115d-418a-4234-953c-175f3ae78849-tls-assets\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858862 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858646    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858862 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858653    2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858862 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858663    2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ed69115d-418a-4234-953c-175f3ae78849-secret-metrics-client-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:46.858862 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:46.858671    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ed69115d-418a-4234-953c-175f3ae78849-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:51:47.065235 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.065210    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 04:51:47.070131 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.070108    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 04:51:47.097366 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097340    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 04:51:47.097686 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097668    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="thanos-sidecar"
Sep 16 04:51:47.097816 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097689    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="thanos-sidecar"
Sep 16 04:51:47.097816 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097705    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy-web"
Sep 16 04:51:47.097816 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097715    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy-web"
Sep 16 04:51:47.097816 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097735    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="init-config-reloader"
Sep 16 04:51:47.097816 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097743    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="init-config-reloader"
Sep 16 04:51:47.097816 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097761    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="prometheus"
Sep 16 04:51:47.097816 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097769    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="prometheus"
Sep 16 04:51:47.097816 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097781    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy"
Sep 16 04:51:47.097816 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097789    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy"
Sep 16 04:51:47.097816 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097802    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="config-reloader"
Sep 16 04:51:47.097816 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097810    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="config-reloader"
Sep 16 04:51:47.098312 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097822    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy-thanos"
Sep 16 04:51:47.098312 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097830    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy-thanos"
Sep 16 04:51:47.098312 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097906    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="thanos-sidecar"
Sep 16 04:51:47.098312 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097919    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="config-reloader"
Sep 16 04:51:47.098312 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097934    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy-web"
Sep 16 04:51:47.098312 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097945    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy"
Sep 16 04:51:47.098312 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097954    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="kube-rbac-proxy-thanos"
Sep 16 04:51:47.098312 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.097963    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed69115d-418a-4234-953c-175f3ae78849" containerName="prometheus"
Sep 16 04:51:47.102034 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.102017    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.104652 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.104631    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 16 04:51:47.104753 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.104637    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 16 04:51:47.104753 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.104672    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 16 04:51:47.105179 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105019    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-eptut90j0faqr\""
Sep 16 04:51:47.105179 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105035    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 16 04:51:47.105179 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105044    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 16 04:51:47.105179 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105052    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 16 04:51:47.105179 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105083    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 16 04:51:47.105179 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105104    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 16 04:51:47.105521 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105200    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 16 04:51:47.105521 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105214    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 16 04:51:47.105521 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105346    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 16 04:51:47.105707 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105536    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 16 04:51:47.105707 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105549    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 16 04:51:47.105707 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.105685    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ll4vg\""
Sep 16 04:51:47.107979 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.107963    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 16 04:51:47.111964 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.111861    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 16 04:51:47.125059 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.125036    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 04:51:47.262138 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262108    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86dd0ef5-8698-4d54-a105-4b8e29634fed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262138 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262138    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262320 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262155    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262320 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262169    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262320 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262195    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262320 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262255    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262320 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262312    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262344    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmhfw\" (UniqueName: \"kubernetes.io/projected/86dd0ef5-8698-4d54-a105-4b8e29634fed-kube-api-access-tmhfw\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262384    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262447    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262474    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-config\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262525    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262571    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86dd0ef5-8698-4d54-a105-4b8e29634fed-config-out\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262594    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262621    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-web-config\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262952 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262952 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262697    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262952 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.262952 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.262731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363235 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363235 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-config\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363235 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363220    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363447 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363242    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86dd0ef5-8698-4d54-a105-4b8e29634fed-config-out\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363447 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363261    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363447 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363287    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-web-config\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363447 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363314    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363447 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363340    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363447 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363370    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363447 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363447 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363418    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86dd0ef5-8698-4d54-a105-4b8e29634fed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363447 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363436    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363455    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363528    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363549    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363577    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363603    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmhfw\" (UniqueName: \"kubernetes.io/projected/86dd0ef5-8698-4d54-a105-4b8e29634fed-kube-api-access-tmhfw\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363642    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.363893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.364434 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.364434 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.363991    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.364434 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.364151    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.366991 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.366889    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.366991 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.366906    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.366991 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.366957    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-config\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.366991 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.367152    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86dd0ef5-8698-4d54-a105-4b8e29634fed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.366991 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.367165    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.366991 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.367291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.366991 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.367413    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.366991 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.367599    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.368422 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.367793    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.368517 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.368463    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-web-config\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.368740 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.368714    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.368809 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.368752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86dd0ef5-8698-4d54-a105-4b8e29634fed-config-out\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.369944 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.369919    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.370032 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.369981    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.370213 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.370189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86dd0ef5-8698-4d54-a105-4b8e29634fed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.370577 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.370559    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/86dd0ef5-8698-4d54-a105-4b8e29634fed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.374927 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.374911    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmhfw\" (UniqueName: \"kubernetes.io/projected/86dd0ef5-8698-4d54-a105-4b8e29634fed-kube-api-access-tmhfw\") pod \"prometheus-k8s-0\" (UID: \"86dd0ef5-8698-4d54-a105-4b8e29634fed\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.414974 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.414955    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:51:47.699759 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.699690    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 16 04:51:47.702731 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:51:47.702704    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86dd0ef5_8698_4d54_a105_4b8e29634fed.slice/crio-8457278fafe606c7040036dc360313b1e6f13739f2476c05d8f2226747589a01 WatchSource:0}: Error finding container 8457278fafe606c7040036dc360313b1e6f13739f2476c05d8f2226747589a01: Status 404 returned error can't find the container with id 8457278fafe606c7040036dc360313b1e6f13739f2476c05d8f2226747589a01
Sep 16 04:51:47.750288 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:47.750263    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86dd0ef5-8698-4d54-a105-4b8e29634fed","Type":"ContainerStarted","Data":"8457278fafe606c7040036dc360313b1e6f13739f2476c05d8f2226747589a01"}
Sep 16 04:51:48.756695 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:48.756660    2559 generic.go:356] "Generic (PLEG): container finished" podID="86dd0ef5-8698-4d54-a105-4b8e29634fed" containerID="adeca89f662ce4aef81ae2379b33658c55f71dac08870e08240432b953e09c63" exitCode=0
Sep 16 04:51:48.757079 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:48.756756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86dd0ef5-8698-4d54-a105-4b8e29634fed","Type":"ContainerDied","Data":"adeca89f662ce4aef81ae2379b33658c55f71dac08870e08240432b953e09c63"}
Sep 16 04:51:48.786788 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:48.786758    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed69115d-418a-4234-953c-175f3ae78849" path="/var/lib/kubelet/pods/ed69115d-418a-4234-953c-175f3ae78849/volumes"
Sep 16 04:51:49.770007 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:49.769972    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86dd0ef5-8698-4d54-a105-4b8e29634fed","Type":"ContainerStarted","Data":"0982e7b0b253fca53884cb056658ab8dcc1932a5c6a2ff1278759a21a5d9e0fa"}
Sep 16 04:51:49.770379 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:49.770064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86dd0ef5-8698-4d54-a105-4b8e29634fed","Type":"ContainerStarted","Data":"acb63f11fab93bf9e19b0c82fe33da14836390a028506f039df16f3666bf439b"}
Sep 16 04:51:49.770379 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:49.770092    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86dd0ef5-8698-4d54-a105-4b8e29634fed","Type":"ContainerStarted","Data":"08bbf5d654b0d2a7cbbf5a390586d15214b82c7e219d93c1f0bde583c610e3a4"}
Sep 16 04:51:49.770379 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:49.770115    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86dd0ef5-8698-4d54-a105-4b8e29634fed","Type":"ContainerStarted","Data":"a704d5adc23a6ad37ed338143232c73eb99a0ded447f9d55072b7bc61da83e4e"}
Sep 16 04:51:49.770379 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:49.770138    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86dd0ef5-8698-4d54-a105-4b8e29634fed","Type":"ContainerStarted","Data":"0ac69d7ca5726f46c709c82bc39a26e098bb18eae550105b8fb1cbf839efaffa"}
Sep 16 04:51:49.770379 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:49.770161    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86dd0ef5-8698-4d54-a105-4b8e29634fed","Type":"ContainerStarted","Data":"da8bb0f34bd45f8d06160aab6a79995f170ecf92f0289fd96fc177d071199037"}
Sep 16 04:51:49.797414 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:49.797360    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.778162169 podStartE2EDuration="2.797344495s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.182326ms" isStatefulPod=false podCreationTimestamp="2026-09-16 04:51:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:51:49.795086077 +0000 UTC m=+163.456265296" watchObservedRunningTime="2026-09-16 04:51:49.797344495 +0000 UTC m=+163.458523673"
Sep 16 04:51:52.415926 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:51:52.415877    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:52:47.415733 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:52:47.415702    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:52:47.431263 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:52:47.431232    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:52:48.009241 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:52:48.009218    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 16 04:54:06.706748 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:54:06.706721    2559 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 04:55:37.826224 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.826192    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"]
Sep 16 04:55:37.829393 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.829372    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:37.831598 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.831573    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 04:55:37.831709 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.831622    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 04:55:37.831709 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.831575    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 04:55:37.831709 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.831573    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zn4sz\""
Sep 16 04:55:37.831872 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.831763    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 04:55:37.843728 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.843703    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"]
Sep 16 04:55:37.901347 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.901324    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-tmp\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:37.901446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.901366    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-manifests\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:37.901446 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.901388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:37.901545 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.901448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7962\" (UniqueName: \"kubernetes.io/projected/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-kube-api-access-m7962\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:37.901545 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:37.901535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-webhook-cert\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.003336 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.003307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-webhook-cert\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.003453 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.003375    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-tmp\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.003453 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.003411    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-manifests\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.003453 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.003441    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.003634 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.003470    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7962\" (UniqueName: \"kubernetes.io/projected/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-kube-api-access-m7962\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.003901 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.003875    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-manifests\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.005834 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.005808    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-webhook-cert\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.006079 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.006057    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-tmp\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.006314 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.006294    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.010598 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.010580    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7962\" (UniqueName: \"kubernetes.io/projected/2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d-kube-api-access-m7962\") pod \"opendatahub-operator-controller-manager-756589c867-f9ghs\" (UID: \"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d\") " pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.139305 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.139228    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:38.451880 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.451856    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"]
Sep 16 04:55:38.454026 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:55:38.453997    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfab273_bdf5_4b73_9dc4_a60fbc1cb14d.slice/crio-b7a8e6136192653d8770db1bf367318a0850d6842e1ddcae166fb650608d5f1f WatchSource:0}: Error finding container b7a8e6136192653d8770db1bf367318a0850d6842e1ddcae166fb650608d5f1f: Status 404 returned error can't find the container with id b7a8e6136192653d8770db1bf367318a0850d6842e1ddcae166fb650608d5f1f
Sep 16 04:55:38.456358 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.456341    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 04:55:38.613407 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:38.613377    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs" event={"ID":"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d","Type":"ContainerStarted","Data":"b7a8e6136192653d8770db1bf367318a0850d6842e1ddcae166fb650608d5f1f"}
Sep 16 04:55:41.629222 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:41.629190    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs" event={"ID":"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d","Type":"ContainerStarted","Data":"839a4605345d209c9c770f4ae00419ef36a388ce613da6460af3ee26f9cdf02d"}
Sep 16 04:55:42.634668 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:42.634635    2559 generic.go:356] "Generic (PLEG): container finished" podID="2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d" containerID="839a4605345d209c9c770f4ae00419ef36a388ce613da6460af3ee26f9cdf02d" exitCode=0
Sep 16 04:55:42.634960 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:42.634716    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs" event={"ID":"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d","Type":"ContainerDied","Data":"839a4605345d209c9c770f4ae00419ef36a388ce613da6460af3ee26f9cdf02d"}
Sep 16 04:55:43.644102 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:43.644059    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs" event={"ID":"2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d","Type":"ContainerStarted","Data":"a6b8227635f550dede4a31e297e8263f6a0a00cd79168b16443685b957925962"}
Sep 16 04:55:43.644570 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:43.644362    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:55:43.664240 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:43.664195    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs" podStartSLOduration=2.21730709 podStartE2EDuration="6.664180729s" totalImagesPullingTime="3.541781311s" totalInitContainerRuntime="905.092328ms" isStatefulPod=false podCreationTimestamp="2026-09-16 04:55:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:55:43.663730558 +0000 UTC m=+397.324909735" watchObservedRunningTime="2026-09-16 04:55:43.664180729 +0000 UTC m=+397.325359949"
Sep 16 04:55:54.649498 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:55:54.649453    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-756589c867-f9ghs"
Sep 16 04:56:04.638269 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.638240    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"]
Sep 16 04:56:04.641593 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.641571    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.647032 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.647005    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 04:56:04.647164 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.647047    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 04:56:04.647164 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.647113    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 04:56:04.647709 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.647688    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-srr2s\""
Sep 16 04:56:04.656944 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.656922    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"]
Sep 16 04:56:04.715779 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.715752    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnbmt\" (UniqueName: \"kubernetes.io/projected/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-kube-api-access-vnbmt\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.715910 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.715790    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.715910 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.715810    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.715910 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.715895    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.716007 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.715939    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.716007 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.715955    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.716085 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.716008    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.716085 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.716042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.716085 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.716080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.816679 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.816648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.816679 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.816684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.816879 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.816739    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnbmt\" (UniqueName: \"kubernetes.io/projected/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-kube-api-access-vnbmt\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.816879 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.816769    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.816879 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.816793    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.816879 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.816830    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.817071 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.816995    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.817071 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.817039    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.817071 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.817067    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.817274 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.817101    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.817274 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.817134    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.817385 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.817307    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.817438 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.817385    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.817559 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.817540    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.819321 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.819305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.819382 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.819364    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.827441 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.827417    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnbmt\" (UniqueName: \"kubernetes.io/projected/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-kube-api-access-vnbmt\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.828730 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.828708    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/863f33fa-18c2-4bcf-aabd-c6b82bca98d4-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj\" (UID: \"863f33fa-18c2-4bcf-aabd-c6b82bca98d4\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:04.951472 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:04.951417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:05.232802 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:05.232743    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"]
Sep 16 04:56:05.235043 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:56:05.235021    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863f33fa_18c2_4bcf_aabd_c6b82bca98d4.slice/crio-d1bb2a8001532ad7613e80dfd9ef0192d0e66fc97f38e56fd32803c17708ad2d WatchSource:0}: Error finding container d1bb2a8001532ad7613e80dfd9ef0192d0e66fc97f38e56fd32803c17708ad2d: Status 404 returned error can't find the container with id d1bb2a8001532ad7613e80dfd9ef0192d0e66fc97f38e56fd32803c17708ad2d
Sep 16 04:56:05.731079 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:05.731044    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj" event={"ID":"863f33fa-18c2-4bcf-aabd-c6b82bca98d4","Type":"ContainerStarted","Data":"d1bb2a8001532ad7613e80dfd9ef0192d0e66fc97f38e56fd32803c17708ad2d"}
Sep 16 04:56:07.695279 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:07.695241    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 04:56:07.695510 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:07.695316    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 04:56:07.695510 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:07.695346    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 04:56:08.747115 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:08.747078    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj" event={"ID":"863f33fa-18c2-4bcf-aabd-c6b82bca98d4","Type":"ContainerStarted","Data":"0baa7a269096408515e3f2fd55042c19560e19d8d73ee99c9b900d4fe860476c"}
Sep 16 04:56:08.772699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:08.772640    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj" podStartSLOduration=2.314584429 podStartE2EDuration="4.772618907s" totalImagesPullingTime="2.458034478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:56:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:56:08.771049911 +0000 UTC m=+422.432229088" watchObservedRunningTime="2026-09-16 04:56:08.772618907 +0000 UTC m=+422.433798083"
Sep 16 04:56:08.952162 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:08.952126    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:08.962556 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:08.962527    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:09.751175 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:09.751138    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:09.752119 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:09.752097    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj"
Sep 16 04:56:17.230367 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.230332    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"]
Sep 16 04:56:17.234977 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.234961    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.238912 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.238888    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 16 04:56:17.239014 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.238965    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-shcnf\""
Sep 16 04:56:17.239457 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.239437    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 04:56:17.239534 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.239451    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 04:56:17.239573 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.239550    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 16 04:56:17.239707 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.239694    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 16 04:56:17.253396 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.253374    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"]
Sep 16 04:56:17.326760 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.326729    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-manager-config\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.326906 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.326773    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cjjn\" (UniqueName: \"kubernetes.io/projected/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-kube-api-access-5cjjn\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.326906 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.326801    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-metrics-cert\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.326906 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.326842    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-cert\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.427991 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.427960    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-manager-config\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.428145 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.428005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cjjn\" (UniqueName: \"kubernetes.io/projected/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-kube-api-access-5cjjn\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.428145 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.428072    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-metrics-cert\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.428145 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.428103    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-cert\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.428804 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.428780    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-manager-config\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.430451 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.430431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-metrics-cert\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.430581 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.430560    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-cert\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.441985 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.441960    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cjjn\" (UniqueName: \"kubernetes.io/projected/acb6dcd3-5482-45ed-b62b-53b35cfc2a92-kube-api-access-5cjjn\") pod \"lws-controller-manager-778cf7776f-nn6sf\" (UID: \"acb6dcd3-5482-45ed-b62b-53b35cfc2a92\") " pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.543078 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.542982    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:17.873700 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:17.873625    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"]
Sep 16 04:56:17.876693 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:56:17.876658    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb6dcd3_5482_45ed_b62b_53b35cfc2a92.slice/crio-43616b462841cd739eda02797e727c7e0fb3314a9579b744c399caf4be306d55 WatchSource:0}: Error finding container 43616b462841cd739eda02797e727c7e0fb3314a9579b744c399caf4be306d55: Status 404 returned error can't find the container with id 43616b462841cd739eda02797e727c7e0fb3314a9579b744c399caf4be306d55
Sep 16 04:56:18.484260 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.484232    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"]
Sep 16 04:56:18.488931 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.488909    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"
Sep 16 04:56:18.497843 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.497819    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rhgms\""
Sep 16 04:56:18.498901 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.498879    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 16 04:56:18.511505 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.511455    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"]
Sep 16 04:56:18.530699 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.530669    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"]
Sep 16 04:56:18.534386 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.534366    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"
Sep 16 04:56:18.538403 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.538383    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-j7h6v\""
Sep 16 04:56:18.540694 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.540675    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 16 04:56:18.563812 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.563763    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"]
Sep 16 04:56:18.639440 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.639344    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2e404a4-97bc-4553-9b74-8ba983c076a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xthpw\" (UID: \"b2e404a4-97bc-4553-9b74-8ba983c076a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"
Sep 16 04:56:18.639440 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.639398    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wll7z\" (UniqueName: \"kubernetes.io/projected/b2e404a4-97bc-4553-9b74-8ba983c076a2-kube-api-access-wll7z\") pod \"llmisvc-controller-manager-777c6bd7d5-xthpw\" (UID: \"b2e404a4-97bc-4553-9b74-8ba983c076a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"
Sep 16 04:56:18.639440 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.639434    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2114dcf-4f02-414c-affd-1160ac57f2e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-jmnwg\" (UID: \"c2114dcf-4f02-414c-affd-1160ac57f2e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"
Sep 16 04:56:18.639790 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.639491    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88fwc\" (UniqueName: \"kubernetes.io/projected/c2114dcf-4f02-414c-affd-1160ac57f2e8-kube-api-access-88fwc\") pod \"kserve-controller-manager-d6f4b65b8-jmnwg\" (UID: \"c2114dcf-4f02-414c-affd-1160ac57f2e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"
Sep 16 04:56:18.740169 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.740076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wll7z\" (UniqueName: \"kubernetes.io/projected/b2e404a4-97bc-4553-9b74-8ba983c076a2-kube-api-access-wll7z\") pod \"llmisvc-controller-manager-777c6bd7d5-xthpw\" (UID: \"b2e404a4-97bc-4553-9b74-8ba983c076a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"
Sep 16 04:56:18.740169 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.740135    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2114dcf-4f02-414c-affd-1160ac57f2e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-jmnwg\" (UID: \"c2114dcf-4f02-414c-affd-1160ac57f2e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"
Sep 16 04:56:18.740389 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.740185    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88fwc\" (UniqueName: \"kubernetes.io/projected/c2114dcf-4f02-414c-affd-1160ac57f2e8-kube-api-access-88fwc\") pod \"kserve-controller-manager-d6f4b65b8-jmnwg\" (UID: \"c2114dcf-4f02-414c-affd-1160ac57f2e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"
Sep 16 04:56:18.740389 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.740284    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2e404a4-97bc-4553-9b74-8ba983c076a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xthpw\" (UID: \"b2e404a4-97bc-4553-9b74-8ba983c076a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"
Sep 16 04:56:18.740908 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:56:18.740555    2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 16 04:56:18.740908 ip-10-0-134-147 kubenswrapper[2559]: E0916 04:56:18.740622    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2114dcf-4f02-414c-affd-1160ac57f2e8-cert podName:c2114dcf-4f02-414c-affd-1160ac57f2e8 nodeName:}" failed. No retries permitted until 2026-09-16 04:56:19.240605008 +0000 UTC m=+432.901784163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c2114dcf-4f02-414c-affd-1160ac57f2e8-cert") pod "kserve-controller-manager-d6f4b65b8-jmnwg" (UID: "c2114dcf-4f02-414c-affd-1160ac57f2e8") : secret "kserve-webhook-server-cert" not found
Sep 16 04:56:18.743385 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.743360    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2e404a4-97bc-4553-9b74-8ba983c076a2-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xthpw\" (UID: \"b2e404a4-97bc-4553-9b74-8ba983c076a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"
Sep 16 04:56:18.750354 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.750326    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wll7z\" (UniqueName: \"kubernetes.io/projected/b2e404a4-97bc-4553-9b74-8ba983c076a2-kube-api-access-wll7z\") pod \"llmisvc-controller-manager-777c6bd7d5-xthpw\" (UID: \"b2e404a4-97bc-4553-9b74-8ba983c076a2\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"
Sep 16 04:56:18.753072 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.753046    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88fwc\" (UniqueName: \"kubernetes.io/projected/c2114dcf-4f02-414c-affd-1160ac57f2e8-kube-api-access-88fwc\") pod \"kserve-controller-manager-d6f4b65b8-jmnwg\" (UID: \"c2114dcf-4f02-414c-affd-1160ac57f2e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"
Sep 16 04:56:18.793664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.793618    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf" event={"ID":"acb6dcd3-5482-45ed-b62b-53b35cfc2a92","Type":"ContainerStarted","Data":"43616b462841cd739eda02797e727c7e0fb3314a9579b744c399caf4be306d55"}
Sep 16 04:56:18.845203 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:18.845171    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"
Sep 16 04:56:19.147759 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:19.147733    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"]
Sep 16 04:56:19.149569 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:56:19.149535    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb2e404a4_97bc_4553_9b74_8ba983c076a2.slice/crio-84337ddb0470f8a3ac478a3d7ac3be8dfbcda6d37dba96a926691ad82d3c0745 WatchSource:0}: Error finding container 84337ddb0470f8a3ac478a3d7ac3be8dfbcda6d37dba96a926691ad82d3c0745: Status 404 returned error can't find the container with id 84337ddb0470f8a3ac478a3d7ac3be8dfbcda6d37dba96a926691ad82d3c0745
Sep 16 04:56:19.246105 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:19.246076    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2114dcf-4f02-414c-affd-1160ac57f2e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-jmnwg\" (UID: \"c2114dcf-4f02-414c-affd-1160ac57f2e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"
Sep 16 04:56:19.248449 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:19.248432    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c2114dcf-4f02-414c-affd-1160ac57f2e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-jmnwg\" (UID: \"c2114dcf-4f02-414c-affd-1160ac57f2e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"
Sep 16 04:56:19.402858 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:19.402770    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"
Sep 16 04:56:19.801087 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:19.801046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw" event={"ID":"b2e404a4-97bc-4553-9b74-8ba983c076a2","Type":"ContainerStarted","Data":"84337ddb0470f8a3ac478a3d7ac3be8dfbcda6d37dba96a926691ad82d3c0745"}
Sep 16 04:56:20.543223 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:20.543201    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"]
Sep 16 04:56:20.545354 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:56:20.545323    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2114dcf_4f02_414c_affd_1160ac57f2e8.slice/crio-9cbfc721c8e6e44b48817a6cbcc041dbb64952c44c4d6e6db74065c73af4f012 WatchSource:0}: Error finding container 9cbfc721c8e6e44b48817a6cbcc041dbb64952c44c4d6e6db74065c73af4f012: Status 404 returned error can't find the container with id 9cbfc721c8e6e44b48817a6cbcc041dbb64952c44c4d6e6db74065c73af4f012
Sep 16 04:56:20.808255 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:20.808127    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf" event={"ID":"acb6dcd3-5482-45ed-b62b-53b35cfc2a92","Type":"ContainerStarted","Data":"6f8a716bcdc08f76f8a7d34f1df279f997d4f98e1c51d8d490c63e61d3c7befb"}
Sep 16 04:56:20.808695 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:20.808256    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:20.810180 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:20.810145    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg" event={"ID":"c2114dcf-4f02-414c-affd-1160ac57f2e8","Type":"ContainerStarted","Data":"9cbfc721c8e6e44b48817a6cbcc041dbb64952c44c4d6e6db74065c73af4f012"}
Sep 16 04:56:20.823822 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:20.823779    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf" podStartSLOduration=1.393700194 podStartE2EDuration="3.823760934s" totalImagesPullingTime="2.43006074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:56:20.823437676 +0000 UTC m=+434.484616854" watchObservedRunningTime="2026-09-16 04:56:20.823760934 +0000 UTC m=+434.484940112"
Sep 16 04:56:24.831222 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:24.831185    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg" event={"ID":"c2114dcf-4f02-414c-affd-1160ac57f2e8","Type":"ContainerStarted","Data":"5948ac05fade45213e0bd5d97e73c19292422311c1efd16be64c6d9115ae52f5"}
Sep 16 04:56:24.831664 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:24.831244    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"
Sep 16 04:56:24.832648 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:24.832614    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw" event={"ID":"b2e404a4-97bc-4553-9b74-8ba983c076a2","Type":"ContainerStarted","Data":"1897480d740dabda22709bef91a4b7b9c544df8099d89d6122cb7a5e8f528bc2"}
Sep 16 04:56:24.832748 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:24.832658    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"
Sep 16 04:56:24.847159 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:24.847112    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg" podStartSLOduration=3.62145047 podStartE2EDuration="6.847096137s" totalImagesPullingTime="3.225645667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:56:24.84683406 +0000 UTC m=+438.508013259" watchObservedRunningTime="2026-09-16 04:56:24.847096137 +0000 UTC m=+438.508275314"
Sep 16 04:56:24.862928 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:24.862888    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw" podStartSLOduration=2.289051008 podStartE2EDuration="6.862877727s" totalImagesPullingTime="4.573826719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:56:24.861626076 +0000 UTC m=+438.522805254" watchObservedRunningTime="2026-09-16 04:56:24.862877727 +0000 UTC m=+438.524056904"
Sep 16 04:56:31.819734 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:31.819661    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-778cf7776f-nn6sf"
Sep 16 04:56:55.839305 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:55.839277    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xthpw"
Sep 16 04:56:55.842234 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:56:55.842209    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-jmnwg"
Sep 16 04:57:32.712855 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:32.712821    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv"]
Sep 16 04:57:32.716062 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:32.716045    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv"
Sep 16 04:57:32.719128 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:32.719106    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 04:57:32.719553 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:32.719537    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8fcjm\""
Sep 16 04:57:32.719827 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:32.719811    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 16 04:57:32.721277 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:32.721260    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 04:57:32.731345 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:32.731325    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x7bm\" (UniqueName: \"kubernetes.io/projected/94360647-5232-45b1-8243-a33e453f8197-kube-api-access-2x7bm\") pod \"dns-operator-controller-manager-7b84cd7c9c-66bgv\" (UID: \"94360647-5232-45b1-8243-a33e453f8197\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv"
Sep 16 04:57:32.735736 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:32.735716    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv"]
Sep 16 04:57:32.832058 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:32.832021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x7bm\" (UniqueName: \"kubernetes.io/projected/94360647-5232-45b1-8243-a33e453f8197-kube-api-access-2x7bm\") pod \"dns-operator-controller-manager-7b84cd7c9c-66bgv\" (UID: \"94360647-5232-45b1-8243-a33e453f8197\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv"
Sep 16 04:57:32.852935 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:32.852910    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x7bm\" (UniqueName: \"kubernetes.io/projected/94360647-5232-45b1-8243-a33e453f8197-kube-api-access-2x7bm\") pod \"dns-operator-controller-manager-7b84cd7c9c-66bgv\" (UID: \"94360647-5232-45b1-8243-a33e453f8197\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv"
Sep 16 04:57:33.025781 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:33.025755    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv"
Sep 16 04:57:33.295770 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:33.295748    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv"]
Sep 16 04:57:33.298290 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:57:33.298262    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94360647_5232_45b1_8243_a33e453f8197.slice/crio-913546ee4e2d8e719396fd2823c9498a8b1837bf80780f987cc1f4871488c84e WatchSource:0}: Error finding container 913546ee4e2d8e719396fd2823c9498a8b1837bf80780f987cc1f4871488c84e: Status 404 returned error can't find the container with id 913546ee4e2d8e719396fd2823c9498a8b1837bf80780f987cc1f4871488c84e
Sep 16 04:57:34.122226 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:34.122194    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv" event={"ID":"94360647-5232-45b1-8243-a33e453f8197","Type":"ContainerStarted","Data":"913546ee4e2d8e719396fd2823c9498a8b1837bf80780f987cc1f4871488c84e"}
Sep 16 04:57:38.141924 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:38.141884    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv" event={"ID":"94360647-5232-45b1-8243-a33e453f8197","Type":"ContainerStarted","Data":"c233bde84cf28d64dd0baffe3ef5c9cfd0ff51fcef082d9d25585e842c2a37fb"}
Sep 16 04:57:38.142360 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:38.142013    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv"
Sep 16 04:57:38.160073 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:38.160026    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv" podStartSLOduration=2.108921238 podStartE2EDuration="6.160012462s" totalImagesPullingTime="4.051091224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:57:38.159223281 +0000 UTC m=+511.820402459" watchObservedRunningTime="2026-09-16 04:57:38.160012462 +0000 UTC m=+511.821191639"
Sep 16 04:57:39.408547 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:39.408514    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hx2q7"]
Sep 16 04:57:39.411972 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:39.411956    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hx2q7"
Sep 16 04:57:39.414140 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:39.414121    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gcsbs\""
Sep 16 04:57:39.429316 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:39.429282    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hx2q7"]
Sep 16 04:57:39.486438 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:39.486409    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf66g\" (UniqueName: \"kubernetes.io/projected/c2a27d53-193e-4e50-a220-f9e7ce2b4024-kube-api-access-cf66g\") pod \"authorino-operator-76b478bd78-hx2q7\" (UID: \"c2a27d53-193e-4e50-a220-f9e7ce2b4024\") " pod="kuadrant-system/authorino-operator-76b478bd78-hx2q7"
Sep 16 04:57:39.587224 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:39.587199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf66g\" (UniqueName: \"kubernetes.io/projected/c2a27d53-193e-4e50-a220-f9e7ce2b4024-kube-api-access-cf66g\") pod \"authorino-operator-76b478bd78-hx2q7\" (UID: \"c2a27d53-193e-4e50-a220-f9e7ce2b4024\") " pod="kuadrant-system/authorino-operator-76b478bd78-hx2q7"
Sep 16 04:57:39.598315 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:39.598288    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf66g\" (UniqueName: \"kubernetes.io/projected/c2a27d53-193e-4e50-a220-f9e7ce2b4024-kube-api-access-cf66g\") pod \"authorino-operator-76b478bd78-hx2q7\" (UID: \"c2a27d53-193e-4e50-a220-f9e7ce2b4024\") " pod="kuadrant-system/authorino-operator-76b478bd78-hx2q7"
Sep 16 04:57:39.721705 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:39.721654    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hx2q7"
Sep 16 04:57:40.001059 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:40.001035    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hx2q7"]
Sep 16 04:57:40.002728 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:57:40.002696    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a27d53_193e_4e50_a220_f9e7ce2b4024.slice/crio-7514fc957b402dc15ed5990e321b3c24b014e8d5c990f5e06cbddabbe462e2dc WatchSource:0}: Error finding container 7514fc957b402dc15ed5990e321b3c24b014e8d5c990f5e06cbddabbe462e2dc: Status 404 returned error can't find the container with id 7514fc957b402dc15ed5990e321b3c24b014e8d5c990f5e06cbddabbe462e2dc
Sep 16 04:57:40.151845 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:40.151814    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hx2q7" event={"ID":"c2a27d53-193e-4e50-a220-f9e7ce2b4024","Type":"ContainerStarted","Data":"7514fc957b402dc15ed5990e321b3c24b014e8d5c990f5e06cbddabbe462e2dc"}
Sep 16 04:57:43.167221 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:43.167184    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hx2q7" event={"ID":"c2a27d53-193e-4e50-a220-f9e7ce2b4024","Type":"ContainerStarted","Data":"63ffb0b28035f91fa832e3a4d34ae14baaaf01888c9119af6014b8de637dc512"}
Sep 16 04:57:43.167622 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:43.167309    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-hx2q7"
Sep 16 04:57:43.186752 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:43.186709    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-hx2q7" podStartSLOduration=1.812454419 podStartE2EDuration="4.186694975s" totalImagesPullingTime="2.374240556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:57:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:57:43.184460316 +0000 UTC m=+516.845639499" watchObservedRunningTime="2026-09-16 04:57:43.186694975 +0000 UTC m=+516.847874152"
Sep 16 04:57:49.148272 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:49.148243    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-66bgv"
Sep 16 04:57:54.174582 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:57:54.174555    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-hx2q7"
Sep 16 04:58:31.355814 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.355784    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"]
Sep 16 04:58:31.359067 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.359046    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.361440 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.361421    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mtdjn\""
Sep 16 04:58:31.374793 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.374775    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"]
Sep 16 04:58:31.496961 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.496930    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfv9k\" (UniqueName: \"kubernetes.io/projected/b6b1cb04-82ac-4e66-8159-867647a40482-kube-api-access-sfv9k\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.496961 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.496962    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b1cb04-82ac-4e66-8159-867647a40482-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.497167 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.496984    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.497167 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.497067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.497167 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.497094    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.497167 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.497133    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b1cb04-82ac-4e66-8159-867647a40482-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.497360 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.497192    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.497360 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.497214    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.497360 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.497247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b1cb04-82ac-4e66-8159-867647a40482-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.598345 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.598317    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b1cb04-82ac-4e66-8159-867647a40482-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.598508 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.598352    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.598508 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.598372    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.598508 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.598387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.598508 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.598419    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b1cb04-82ac-4e66-8159-867647a40482-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.598508 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.598468    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.598763 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.598522    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.598763 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.598558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b1cb04-82ac-4e66-8159-867647a40482-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.598763 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.598596    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfv9k\" (UniqueName: \"kubernetes.io/projected/b6b1cb04-82ac-4e66-8159-867647a40482-kube-api-access-sfv9k\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.598987 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.598813    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.598987 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.598862    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.599092 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.599013    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.599092 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.599058    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.599092 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.599068    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6b1cb04-82ac-4e66-8159-867647a40482-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.600920 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.600896    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6b1cb04-82ac-4e66-8159-867647a40482-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.601097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.601079    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6b1cb04-82ac-4e66-8159-867647a40482-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.606829 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.606777    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6b1cb04-82ac-4e66-8159-867647a40482-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.607166 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.607150    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfv9k\" (UniqueName: \"kubernetes.io/projected/b6b1cb04-82ac-4e66-8159-867647a40482-kube-api-access-sfv9k\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4fbjr\" (UID: \"b6b1cb04-82ac-4e66-8159-867647a40482\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.668405 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.668375    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:31.946571 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.946548    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"]
Sep 16 04:58:31.948769 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:58:31.948742    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b1cb04_82ac_4e66_8159_867647a40482.slice/crio-0ba455ecb7632c0fe99dbfeddeebcfa351e394d13374041b8114a720423001de WatchSource:0}: Error finding container 0ba455ecb7632c0fe99dbfeddeebcfa351e394d13374041b8114a720423001de: Status 404 returned error can't find the container with id 0ba455ecb7632c0fe99dbfeddeebcfa351e394d13374041b8114a720423001de
Sep 16 04:58:31.950815 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.950780    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 04:58:31.950894 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.950842    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 04:58:31.950894 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:31.950868    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 04:58:32.391318 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:32.391284    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr" event={"ID":"b6b1cb04-82ac-4e66-8159-867647a40482","Type":"ContainerStarted","Data":"8b3dad7aa02670022a19217b1d84e5e3aedcf5581a064a5393c9de7c092f8d8a"}
Sep 16 04:58:32.391755 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:32.391338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr" event={"ID":"b6b1cb04-82ac-4e66-8159-867647a40482","Type":"ContainerStarted","Data":"0ba455ecb7632c0fe99dbfeddeebcfa351e394d13374041b8114a720423001de"}
Sep 16 04:58:32.410415 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:32.410355    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr" podStartSLOduration=1.4103379249999999 podStartE2EDuration="1.410337925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:58:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:58:32.409759309 +0000 UTC m=+566.070938486" watchObservedRunningTime="2026-09-16 04:58:32.410337925 +0000 UTC m=+566.071517104"
Sep 16 04:58:32.668987 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:32.668917    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:32.672770 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:32.672747    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:33.395252 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:33.395216    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:33.396117 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:33.396094    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 04:58:48.180020 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.179990    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-665n4"]
Sep 16 04:58:48.183641 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.183621    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:58:48.185590 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.185567    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 16 04:58:48.185694 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.185650    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-d2fln\""
Sep 16 04:58:48.191472 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.191448    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-665n4"]
Sep 16 04:58:48.222188 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.222162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvmfd\" (UniqueName: \"kubernetes.io/projected/386bb023-fd1f-4f45-97c5-2e17c3423fe5-kube-api-access-jvmfd\") pod \"limitador-limitador-8588749977-665n4\" (UID: \"386bb023-fd1f-4f45-97c5-2e17c3423fe5\") " pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:58:48.222277 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.222198    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/386bb023-fd1f-4f45-97c5-2e17c3423fe5-config-file\") pod \"limitador-limitador-8588749977-665n4\" (UID: \"386bb023-fd1f-4f45-97c5-2e17c3423fe5\") " pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:58:48.284120 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.284089    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-665n4"]
Sep 16 04:58:48.323592 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.323565    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/386bb023-fd1f-4f45-97c5-2e17c3423fe5-config-file\") pod \"limitador-limitador-8588749977-665n4\" (UID: \"386bb023-fd1f-4f45-97c5-2e17c3423fe5\") " pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:58:48.323716 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.323668    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvmfd\" (UniqueName: \"kubernetes.io/projected/386bb023-fd1f-4f45-97c5-2e17c3423fe5-kube-api-access-jvmfd\") pod \"limitador-limitador-8588749977-665n4\" (UID: \"386bb023-fd1f-4f45-97c5-2e17c3423fe5\") " pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:58:48.324209 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.324193    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/386bb023-fd1f-4f45-97c5-2e17c3423fe5-config-file\") pod \"limitador-limitador-8588749977-665n4\" (UID: \"386bb023-fd1f-4f45-97c5-2e17c3423fe5\") " pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:58:48.331137 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.331116    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvmfd\" (UniqueName: \"kubernetes.io/projected/386bb023-fd1f-4f45-97c5-2e17c3423fe5-kube-api-access-jvmfd\") pod \"limitador-limitador-8588749977-665n4\" (UID: \"386bb023-fd1f-4f45-97c5-2e17c3423fe5\") " pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:58:48.494097 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.494068    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:58:48.763782 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:48.763681    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-665n4"]
Sep 16 04:58:48.766181 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:58:48.766156    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386bb023_fd1f_4f45_97c5_2e17c3423fe5.slice/crio-3ff7d90b4d18332d9d2e2f52965db34e47a99771643f2559e3d3fca1b1ef510b WatchSource:0}: Error finding container 3ff7d90b4d18332d9d2e2f52965db34e47a99771643f2559e3d3fca1b1ef510b: Status 404 returned error can't find the container with id 3ff7d90b4d18332d9d2e2f52965db34e47a99771643f2559e3d3fca1b1ef510b
Sep 16 04:58:49.471127 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:49.471093    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-665n4" event={"ID":"386bb023-fd1f-4f45-97c5-2e17c3423fe5","Type":"ContainerStarted","Data":"3ff7d90b4d18332d9d2e2f52965db34e47a99771643f2559e3d3fca1b1ef510b"}
Sep 16 04:58:50.478070 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:50.478036    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-665n4" event={"ID":"386bb023-fd1f-4f45-97c5-2e17c3423fe5","Type":"ContainerStarted","Data":"66b62548fdc9d22e1036925adcdef463bff42035d873f2889edb7ef0f981b4b3"}
Sep 16 04:58:50.478416 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:50.478126    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:58:50.493238 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:58:50.493185    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-665n4" podStartSLOduration=1.379407335 podStartE2EDuration="2.493170342s" totalImagesPullingTime="1.113763007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:58:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:58:50.492337411 +0000 UTC m=+584.153516588" watchObservedRunningTime="2026-09-16 04:58:50.493170342 +0000 UTC m=+584.154349521"
Sep 16 04:59:01.197371 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.197333    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-665n4"]
Sep 16 04:59:01.197846 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.197571    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-665n4" podUID="386bb023-fd1f-4f45-97c5-2e17c3423fe5" containerName="limitador" containerID="cri-o://66b62548fdc9d22e1036925adcdef463bff42035d873f2889edb7ef0f981b4b3" gracePeriod=30
Sep 16 04:59:01.200196 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.200147    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:59:01.529190 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.529160    2559 generic.go:356] "Generic (PLEG): container finished" podID="386bb023-fd1f-4f45-97c5-2e17c3423fe5" containerID="66b62548fdc9d22e1036925adcdef463bff42035d873f2889edb7ef0f981b4b3" exitCode=0
Sep 16 04:59:01.529358 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.529240    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-665n4" event={"ID":"386bb023-fd1f-4f45-97c5-2e17c3423fe5","Type":"ContainerDied","Data":"66b62548fdc9d22e1036925adcdef463bff42035d873f2889edb7ef0f981b4b3"}
Sep 16 04:59:01.644758 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.644731    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:59:01.718875 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.718848    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvmfd\" (UniqueName: \"kubernetes.io/projected/386bb023-fd1f-4f45-97c5-2e17c3423fe5-kube-api-access-jvmfd\") pod \"386bb023-fd1f-4f45-97c5-2e17c3423fe5\" (UID: \"386bb023-fd1f-4f45-97c5-2e17c3423fe5\") "
Sep 16 04:59:01.718999 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.718879    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/386bb023-fd1f-4f45-97c5-2e17c3423fe5-config-file\") pod \"386bb023-fd1f-4f45-97c5-2e17c3423fe5\" (UID: \"386bb023-fd1f-4f45-97c5-2e17c3423fe5\") "
Sep 16 04:59:01.719249 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.719223    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/386bb023-fd1f-4f45-97c5-2e17c3423fe5-config-file" (OuterVolumeSpecName: "config-file") pod "386bb023-fd1f-4f45-97c5-2e17c3423fe5" (UID: "386bb023-fd1f-4f45-97c5-2e17c3423fe5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 04:59:01.721082 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.721049    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/386bb023-fd1f-4f45-97c5-2e17c3423fe5-kube-api-access-jvmfd" (OuterVolumeSpecName: "kube-api-access-jvmfd") pod "386bb023-fd1f-4f45-97c5-2e17c3423fe5" (UID: "386bb023-fd1f-4f45-97c5-2e17c3423fe5"). InnerVolumeSpecName "kube-api-access-jvmfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 04:59:01.820538 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.820461    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvmfd\" (UniqueName: \"kubernetes.io/projected/386bb023-fd1f-4f45-97c5-2e17c3423fe5-kube-api-access-jvmfd\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:59:01.820538 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:01.820506    2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/386bb023-fd1f-4f45-97c5-2e17c3423fe5-config-file\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:59:02.537043 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:02.537019    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-665n4"
Sep 16 04:59:02.537422 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:02.537047    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-665n4" event={"ID":"386bb023-fd1f-4f45-97c5-2e17c3423fe5","Type":"ContainerDied","Data":"3ff7d90b4d18332d9d2e2f52965db34e47a99771643f2559e3d3fca1b1ef510b"}
Sep 16 04:59:02.537422 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:02.537109    2559 scope.go:117] "RemoveContainer" containerID="66b62548fdc9d22e1036925adcdef463bff42035d873f2889edb7ef0f981b4b3"
Sep 16 04:59:02.572105 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:02.572078    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-665n4"]
Sep 16 04:59:02.581644 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:02.581622    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-665n4"]
Sep 16 04:59:02.784047 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:02.784021    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="386bb023-fd1f-4f45-97c5-2e17c3423fe5" path="/var/lib/kubelet/pods/386bb023-fd1f-4f45-97c5-2e17c3423fe5/volumes"
Sep 16 04:59:05.391502 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.391445    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"]
Sep 16 04:59:05.391862 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.391801    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="386bb023-fd1f-4f45-97c5-2e17c3423fe5" containerName="limitador"
Sep 16 04:59:05.391862 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.391813    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="386bb023-fd1f-4f45-97c5-2e17c3423fe5" containerName="limitador"
Sep 16 04:59:05.391942 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.391873    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="386bb023-fd1f-4f45-97c5-2e17c3423fe5" containerName="limitador"
Sep 16 04:59:05.396052 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.396029    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"
Sep 16 04:59:05.400761 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.400744    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 04:59:05.402918 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.402892    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-cw2sh\""
Sep 16 04:59:05.403963 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.403946    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 16 04:59:05.404059 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.403982    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 04:59:05.412606 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.412586    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"]
Sep 16 04:59:05.448157 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.448134    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-277zh\" (UniqueName: \"kubernetes.io/projected/f012a490-718b-4ea9-91a0-4e40baa20888-kube-api-access-277zh\") pod \"postgres-69fb4594cf-2nzd7\" (UID: \"f012a490-718b-4ea9-91a0-4e40baa20888\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"
Sep 16 04:59:05.448237 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.448173    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f012a490-718b-4ea9-91a0-4e40baa20888-data\") pod \"postgres-69fb4594cf-2nzd7\" (UID: \"f012a490-718b-4ea9-91a0-4e40baa20888\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"
Sep 16 04:59:05.549133 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.549108    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-277zh\" (UniqueName: \"kubernetes.io/projected/f012a490-718b-4ea9-91a0-4e40baa20888-kube-api-access-277zh\") pod \"postgres-69fb4594cf-2nzd7\" (UID: \"f012a490-718b-4ea9-91a0-4e40baa20888\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"
Sep 16 04:59:05.549285 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.549150    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f012a490-718b-4ea9-91a0-4e40baa20888-data\") pod \"postgres-69fb4594cf-2nzd7\" (UID: \"f012a490-718b-4ea9-91a0-4e40baa20888\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"
Sep 16 04:59:05.549517 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.549501    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f012a490-718b-4ea9-91a0-4e40baa20888-data\") pod \"postgres-69fb4594cf-2nzd7\" (UID: \"f012a490-718b-4ea9-91a0-4e40baa20888\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"
Sep 16 04:59:05.562196 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.562173    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-277zh\" (UniqueName: \"kubernetes.io/projected/f012a490-718b-4ea9-91a0-4e40baa20888-kube-api-access-277zh\") pod \"postgres-69fb4594cf-2nzd7\" (UID: \"f012a490-718b-4ea9-91a0-4e40baa20888\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"
Sep 16 04:59:05.706382 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.706326    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"
Sep 16 04:59:05.976629 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:05.976607    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"]
Sep 16 04:59:05.979182 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:59:05.979153    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf012a490_718b_4ea9_91a0_4e40baa20888.slice/crio-c3c9f8eb303fe2851929819c9e30254c9a5d817707d53d51ce725e089e91cb11 WatchSource:0}: Error finding container c3c9f8eb303fe2851929819c9e30254c9a5d817707d53d51ce725e089e91cb11: Status 404 returned error can't find the container with id c3c9f8eb303fe2851929819c9e30254c9a5d817707d53d51ce725e089e91cb11
Sep 16 04:59:06.556866 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:06.556837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7" event={"ID":"f012a490-718b-4ea9-91a0-4e40baa20888","Type":"ContainerStarted","Data":"c3c9f8eb303fe2851929819c9e30254c9a5d817707d53d51ce725e089e91cb11"}
Sep 16 04:59:10.630663 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:10.630642    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 16 04:59:11.585341 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:11.585308    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7" event={"ID":"f012a490-718b-4ea9-91a0-4e40baa20888","Type":"ContainerStarted","Data":"49d7753a9b8c7238d295636ee026bcf5ceb8afaa6ed041c45f8def2e83dac248"}
Sep 16 04:59:11.585522 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:11.585388    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"
Sep 16 04:59:11.604108 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:11.604055    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7" podStartSLOduration=1.9560568040000001 podStartE2EDuration="6.604041004s" totalImagesPullingTime="4.6479842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:59:11.602559337 +0000 UTC m=+605.263738513" watchObservedRunningTime="2026-09-16 04:59:11.604041004 +0000 UTC m=+605.265220180"
Sep 16 04:59:17.616597 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:17.616565    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-2nzd7"
Sep 16 04:59:25.097759 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.097724    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dc5f499bb-n6lpr"]
Sep 16 04:59:25.121710 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.121680    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc5f499bb-n6lpr"]
Sep 16 04:59:25.121853 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.121800    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:25.124573 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.124540    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mx82w\""
Sep 16 04:59:25.124914 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.124880    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 04:59:25.125074 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.125049    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 04:59:25.125720 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.125701    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 04:59:25.210172 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.210142    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-metrics-certs\") pod \"maas-controller-dc5f499bb-n6lpr\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") " pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:25.210333 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.210189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnd4k\" (UniqueName: \"kubernetes.io/projected/9a7ac3b7-dce7-4850-957a-b77065806881-kube-api-access-dnd4k\") pod \"maas-controller-dc5f499bb-n6lpr\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") " pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:25.210333 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.210292    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-webhook-cert\") pod \"maas-controller-dc5f499bb-n6lpr\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") " pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:25.310893 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.310864    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-metrics-certs\") pod \"maas-controller-dc5f499bb-n6lpr\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") " pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:25.311018 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.310924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnd4k\" (UniqueName: \"kubernetes.io/projected/9a7ac3b7-dce7-4850-957a-b77065806881-kube-api-access-dnd4k\") pod \"maas-controller-dc5f499bb-n6lpr\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") " pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:25.311018 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.310984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-webhook-cert\") pod \"maas-controller-dc5f499bb-n6lpr\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") " pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:25.313563 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.313538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-metrics-certs\") pod \"maas-controller-dc5f499bb-n6lpr\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") " pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:25.313676 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.313538    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-webhook-cert\") pod \"maas-controller-dc5f499bb-n6lpr\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") " pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:25.318979 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.318948    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnd4k\" (UniqueName: \"kubernetes.io/projected/9a7ac3b7-dce7-4850-957a-b77065806881-kube-api-access-dnd4k\") pod \"maas-controller-dc5f499bb-n6lpr\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") " pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:25.433945 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.433884    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:25.706001 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:25.705979    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dc5f499bb-n6lpr"]
Sep 16 04:59:25.708331 ip-10-0-134-147 kubenswrapper[2559]: W0916 04:59:25.708307    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7ac3b7_dce7_4850_957a_b77065806881.slice/crio-7f133e7906c804cb41aedbed061c24c62b4f56cd89867b92038c2bf394d13877 WatchSource:0}: Error finding container 7f133e7906c804cb41aedbed061c24c62b4f56cd89867b92038c2bf394d13877: Status 404 returned error can't find the container with id 7f133e7906c804cb41aedbed061c24c62b4f56cd89867b92038c2bf394d13877
Sep 16 04:59:26.655090 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:26.655046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc5f499bb-n6lpr" event={"ID":"9a7ac3b7-dce7-4850-957a-b77065806881","Type":"ContainerStarted","Data":"7f133e7906c804cb41aedbed061c24c62b4f56cd89867b92038c2bf394d13877"}
Sep 16 04:59:28.666533 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:28.666464    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc5f499bb-n6lpr" event={"ID":"9a7ac3b7-dce7-4850-957a-b77065806881","Type":"ContainerStarted","Data":"a4df38bd121ece9104c5f2e7dc5039004de49a79e5d4f4a799da44b3d0bb0279"}
Sep 16 04:59:28.666874 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:28.666598    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:28.687399 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:28.687356    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dc5f499bb-n6lpr" podStartSLOduration=1.406363328 podStartE2EDuration="3.687344731s" totalImagesPullingTime="2.280981403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 04:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 04:59:28.685382406 +0000 UTC m=+622.346561585" watchObservedRunningTime="2026-09-16 04:59:28.687344731 +0000 UTC m=+622.348523907"
Sep 16 04:59:39.473317 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.473262    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dc5f499bb-n6lpr"]
Sep 16 04:59:39.473757 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.473509    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-dc5f499bb-n6lpr" podUID="9a7ac3b7-dce7-4850-957a-b77065806881" containerName="manager" containerID="cri-o://a4df38bd121ece9104c5f2e7dc5039004de49a79e5d4f4a799da44b3d0bb0279" gracePeriod=30
Sep 16 04:59:39.475521 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.475471    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:39.716379 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.716351    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a7ac3b7-dce7-4850-957a-b77065806881" containerID="a4df38bd121ece9104c5f2e7dc5039004de49a79e5d4f4a799da44b3d0bb0279" exitCode=0
Sep 16 04:59:39.716534 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.716425    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc5f499bb-n6lpr" event={"ID":"9a7ac3b7-dce7-4850-957a-b77065806881","Type":"ContainerDied","Data":"a4df38bd121ece9104c5f2e7dc5039004de49a79e5d4f4a799da44b3d0bb0279"}
Sep 16 04:59:39.716599 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.716537    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dc5f499bb-n6lpr" event={"ID":"9a7ac3b7-dce7-4850-957a-b77065806881","Type":"ContainerDied","Data":"7f133e7906c804cb41aedbed061c24c62b4f56cd89867b92038c2bf394d13877"}
Sep 16 04:59:39.716599 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.716563    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f133e7906c804cb41aedbed061c24c62b4f56cd89867b92038c2bf394d13877"
Sep 16 04:59:39.718375 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.718358    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:39.824734 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.824714    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-metrics-certs\") pod \"9a7ac3b7-dce7-4850-957a-b77065806881\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") "
Sep 16 04:59:39.824860 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.824788    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnd4k\" (UniqueName: \"kubernetes.io/projected/9a7ac3b7-dce7-4850-957a-b77065806881-kube-api-access-dnd4k\") pod \"9a7ac3b7-dce7-4850-957a-b77065806881\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") "
Sep 16 04:59:39.824860 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.824804    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-webhook-cert\") pod \"9a7ac3b7-dce7-4850-957a-b77065806881\" (UID: \"9a7ac3b7-dce7-4850-957a-b77065806881\") "
Sep 16 04:59:39.826986 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.826958    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9a7ac3b7-dce7-4850-957a-b77065806881" (UID: "9a7ac3b7-dce7-4850-957a-b77065806881"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:59:39.827080 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.827004    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a7ac3b7-dce7-4850-957a-b77065806881-kube-api-access-dnd4k" (OuterVolumeSpecName: "kube-api-access-dnd4k") pod "9a7ac3b7-dce7-4850-957a-b77065806881" (UID: "9a7ac3b7-dce7-4850-957a-b77065806881"). InnerVolumeSpecName "kube-api-access-dnd4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 04:59:39.827080 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.827005    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9a7ac3b7-dce7-4850-957a-b77065806881" (UID: "9a7ac3b7-dce7-4850-957a-b77065806881"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 04:59:39.925541 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.925522    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-metrics-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:59:39.925541 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.925542    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnd4k\" (UniqueName: \"kubernetes.io/projected/9a7ac3b7-dce7-4850-957a-b77065806881-kube-api-access-dnd4k\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:59:39.925674 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:39.925551    2559 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a7ac3b7-dce7-4850-957a-b77065806881-webhook-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 04:59:40.720933 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:40.720903    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dc5f499bb-n6lpr"
Sep 16 04:59:40.740793 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:40.740768    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dc5f499bb-n6lpr"]
Sep 16 04:59:40.744916 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:40.744894    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dc5f499bb-n6lpr"]
Sep 16 04:59:40.785380 ip-10-0-134-147 kubenswrapper[2559]: I0916 04:59:40.785354    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a7ac3b7-dce7-4850-957a-b77065806881" path="/var/lib/kubelet/pods/9a7ac3b7-dce7-4850-957a-b77065806881/volumes"
Sep 16 05:00:02.191512 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.191461    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"]
Sep 16 05:00:02.195277 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.192000    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a7ac3b7-dce7-4850-957a-b77065806881" containerName="manager"
Sep 16 05:00:02.195277 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.192018    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a7ac3b7-dce7-4850-957a-b77065806881" containerName="manager"
Sep 16 05:00:02.195277 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.192083    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a7ac3b7-dce7-4850-957a-b77065806881" containerName="manager"
Sep 16 05:00:02.195733 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.195717    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"
Sep 16 05:00:02.203523 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.203504    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 16 05:00:02.209441 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.209419    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"]
Sep 16 05:00:02.229758 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.229731    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"]
Sep 16 05:00:02.232300 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.232281    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"
Sep 16 05:00:02.235433 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.235415    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tqd2w\""
Sep 16 05:00:02.242018 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.241999    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"]
Sep 16 05:00:02.293853 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.293824    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6tcb\" (UniqueName: \"kubernetes.io/projected/cad4ca0f-be34-4ca8-a7ee-b681df543ece-kube-api-access-p6tcb\") pod \"payload-pre-processing-59fbc47bf8-f4k6g\" (UID: \"cad4ca0f-be34-4ca8-a7ee-b681df543ece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"
Sep 16 05:00:02.293983 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.293880    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad4ca0f-be34-4ca8-a7ee-b681df543ece-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-f4k6g\" (UID: \"cad4ca0f-be34-4ca8-a7ee-b681df543ece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"
Sep 16 05:00:02.395185 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.395156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2aa8f3c-21cd-4411-bd90-d6128d4b54cc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-lf8r9\" (UID: \"d2aa8f3c-21cd-4411-bd90-d6128d4b54cc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"
Sep 16 05:00:02.395291 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.395197    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad4ca0f-be34-4ca8-a7ee-b681df543ece-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-f4k6g\" (UID: \"cad4ca0f-be34-4ca8-a7ee-b681df543ece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"
Sep 16 05:00:02.395291 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.395260    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvvx7\" (UniqueName: \"kubernetes.io/projected/d2aa8f3c-21cd-4411-bd90-d6128d4b54cc-kube-api-access-nvvx7\") pod \"payload-processing-5b54b7fbb7-lf8r9\" (UID: \"d2aa8f3c-21cd-4411-bd90-d6128d4b54cc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"
Sep 16 05:00:02.395359 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.395342    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6tcb\" (UniqueName: \"kubernetes.io/projected/cad4ca0f-be34-4ca8-a7ee-b681df543ece-kube-api-access-p6tcb\") pod \"payload-pre-processing-59fbc47bf8-f4k6g\" (UID: \"cad4ca0f-be34-4ca8-a7ee-b681df543ece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"
Sep 16 05:00:02.395850 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.395834    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cad4ca0f-be34-4ca8-a7ee-b681df543ece-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-f4k6g\" (UID: \"cad4ca0f-be34-4ca8-a7ee-b681df543ece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"
Sep 16 05:00:02.406088 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.406063    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6tcb\" (UniqueName: \"kubernetes.io/projected/cad4ca0f-be34-4ca8-a7ee-b681df543ece-kube-api-access-p6tcb\") pod \"payload-pre-processing-59fbc47bf8-f4k6g\" (UID: \"cad4ca0f-be34-4ca8-a7ee-b681df543ece\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"
Sep 16 05:00:02.495778 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.495747    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvvx7\" (UniqueName: \"kubernetes.io/projected/d2aa8f3c-21cd-4411-bd90-d6128d4b54cc-kube-api-access-nvvx7\") pod \"payload-processing-5b54b7fbb7-lf8r9\" (UID: \"d2aa8f3c-21cd-4411-bd90-d6128d4b54cc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"
Sep 16 05:00:02.495916 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.495817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2aa8f3c-21cd-4411-bd90-d6128d4b54cc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-lf8r9\" (UID: \"d2aa8f3c-21cd-4411-bd90-d6128d4b54cc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"
Sep 16 05:00:02.496406 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.496387    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2aa8f3c-21cd-4411-bd90-d6128d4b54cc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-lf8r9\" (UID: \"d2aa8f3c-21cd-4411-bd90-d6128d4b54cc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"
Sep 16 05:00:02.505387 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.505360    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"
Sep 16 05:00:02.513970 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.513952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvvx7\" (UniqueName: \"kubernetes.io/projected/d2aa8f3c-21cd-4411-bd90-d6128d4b54cc-kube-api-access-nvvx7\") pod \"payload-processing-5b54b7fbb7-lf8r9\" (UID: \"d2aa8f3c-21cd-4411-bd90-d6128d4b54cc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"
Sep 16 05:00:02.542614 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.542586    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"
Sep 16 05:00:02.775617 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.775590    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"]
Sep 16 05:00:02.777920 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:00:02.777897    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcad4ca0f_be34_4ca8_a7ee_b681df543ece.slice/crio-a068587dfc1af30fe88e8b54ad4fe39291bc6a575cc93b1574459b0c072f1c6f WatchSource:0}: Error finding container a068587dfc1af30fe88e8b54ad4fe39291bc6a575cc93b1574459b0c072f1c6f: Status 404 returned error can't find the container with id a068587dfc1af30fe88e8b54ad4fe39291bc6a575cc93b1574459b0c072f1c6f
Sep 16 05:00:02.818917 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.818883    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"]
Sep 16 05:00:02.821248 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:00:02.821214    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2aa8f3c_21cd_4411_bd90_d6128d4b54cc.slice/crio-06bf1a9e5a4c7fe92cf3b08fa75f98dc3c778ce1844218032839a584ab408a8b WatchSource:0}: Error finding container 06bf1a9e5a4c7fe92cf3b08fa75f98dc3c778ce1844218032839a584ab408a8b: Status 404 returned error can't find the container with id 06bf1a9e5a4c7fe92cf3b08fa75f98dc3c778ce1844218032839a584ab408a8b
Sep 16 05:00:02.826432 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:02.826409    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g" event={"ID":"cad4ca0f-be34-4ca8-a7ee-b681df543ece","Type":"ContainerStarted","Data":"a068587dfc1af30fe88e8b54ad4fe39291bc6a575cc93b1574459b0c072f1c6f"}
Sep 16 05:00:03.832530 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:03.832494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9" event={"ID":"d2aa8f3c-21cd-4411-bd90-d6128d4b54cc","Type":"ContainerStarted","Data":"06bf1a9e5a4c7fe92cf3b08fa75f98dc3c778ce1844218032839a584ab408a8b"}
Sep 16 05:00:07.857583 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:07.857540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g" event={"ID":"cad4ca0f-be34-4ca8-a7ee-b681df543ece","Type":"ContainerStarted","Data":"0a6e7b68d383d9645241da360297f4b6cb49e4fe7529170238070add3f039eb9"}
Sep 16 05:00:07.858027 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:07.857643    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"
Sep 16 05:00:07.859271 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:07.859246    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9" event={"ID":"d2aa8f3c-21cd-4411-bd90-d6128d4b54cc","Type":"ContainerStarted","Data":"9c7668dbb7eb6e240ff6c246392b7e7c25187d437b78cfd83c4c1b0c0a94a5a0"}
Sep 16 05:00:07.859395 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:07.859377    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"
Sep 16 05:00:07.877077 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:07.877026    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g" podStartSLOduration=1.831418812 podStartE2EDuration="5.877008891s" totalImagesPullingTime="4.045590079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:00:07.873192131 +0000 UTC m=+661.534371311" watchObservedRunningTime="2026-09-16 05:00:07.877008891 +0000 UTC m=+661.538188069"
Sep 16 05:00:07.892159 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:07.892095    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9" podStartSLOduration=1.899713449 podStartE2EDuration="5.892083844s" totalImagesPullingTime="3.992370395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:00:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:00:07.889521135 +0000 UTC m=+661.550700312" watchObservedRunningTime="2026-09-16 05:00:07.892083844 +0000 UTC m=+661.553263022"
Sep 16 05:00:11.879530 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:11.879495    2559 generic.go:356] "Generic (PLEG): container finished" podID="b6b1cb04-82ac-4e66-8159-867647a40482" containerID="8b3dad7aa02670022a19217b1d84e5e3aedcf5581a064a5393c9de7c092f8d8a" exitCode=0
Sep 16 05:00:11.879897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:11.879536    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr" event={"ID":"b6b1cb04-82ac-4e66-8159-867647a40482","Type":"ContainerDied","Data":"8b3dad7aa02670022a19217b1d84e5e3aedcf5581a064a5393c9de7c092f8d8a"}
Sep 16 05:00:11.879897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:11.879841    2559 scope.go:117] "RemoveContainer" containerID="8b3dad7aa02670022a19217b1d84e5e3aedcf5581a064a5393c9de7c092f8d8a"
Sep 16 05:00:11.880730 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:11.880702    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:00:11.880801 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:11.880772    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:00:11.880839 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:11.880806    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:00:12.885988 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:12.885945    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr" event={"ID":"b6b1cb04-82ac-4e66-8159-867647a40482","Type":"ContainerStarted","Data":"dd40f6efcd32042035e2a2c38615609f0efb387c7ad889fef5f31b130e053d86"}
Sep 16 05:00:13.668568 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:13.668530    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 05:00:13.668792 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:13.668747    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4fbjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 16 05:00:13.668855 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:13.668800    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr" podUID="b6b1cb04-82ac-4e66-8159-867647a40482" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 16 05:00:14.669058 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:14.669023    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4fbjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 16 05:00:14.669429 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:14.669080    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr" podUID="b6b1cb04-82ac-4e66-8159-867647a40482" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 16 05:00:15.669182 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:15.669142    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4fbjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 16 05:00:15.669650 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:15.669217    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr" podUID="b6b1cb04-82ac-4e66-8159-867647a40482" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 16 05:00:16.669728 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:16.669692    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4fbjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 16 05:00:16.670092 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:16.669751    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr" podUID="b6b1cb04-82ac-4e66-8159-867647a40482" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 16 05:00:17.668860 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:17.668817    2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4fbjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 16 05:00:17.669048 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:17.668879    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr" podUID="b6b1cb04-82ac-4e66-8159-867647a40482" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 16 05:00:18.395777 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:18.395732    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 05:00:18.672597 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:18.672519    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 05:00:18.866421 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:18.866391    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-lf8r9"
Sep 16 05:00:18.866643 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:18.866624    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-f4k6g"
Sep 16 05:00:18.928573 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:18.928498    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4fbjr"
Sep 16 05:00:46.847849 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.847819    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"]
Sep 16 05:00:46.855512 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.855472    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:46.857667 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.857646    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 05:00:46.857931 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.857908    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 16 05:00:46.858008 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.857989    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-sl6zs\""
Sep 16 05:00:46.858219 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.858203    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 05:00:46.861821 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.861801    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"]
Sep 16 05:00:46.912074 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.912042    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smlw7\" (UniqueName: \"kubernetes.io/projected/f283abb9-540b-4253-a056-236a2b953d49-kube-api-access-smlw7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:46.912244 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.912080    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:46.912244 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.912103    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:46.912244 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.912190    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f283abb9-540b-4253-a056-236a2b953d49-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:46.912244 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.912218    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:46.912402 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:46.912249    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.013144 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.013117    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smlw7\" (UniqueName: \"kubernetes.io/projected/f283abb9-540b-4253-a056-236a2b953d49-kube-api-access-smlw7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.013280 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.013159    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.013341 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.013296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.013434 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.013408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f283abb9-540b-4253-a056-236a2b953d49-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.013521 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.013440    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.013521 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.013499    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.013635 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.013575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.013753 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.013732    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.013828 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.013809    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.016282 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.016253    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f283abb9-540b-4253-a056-236a2b953d49-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.016414 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.016392    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f283abb9-540b-4253-a056-236a2b953d49-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.020932 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.020908    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smlw7\" (UniqueName: \"kubernetes.io/projected/f283abb9-540b-4253-a056-236a2b953d49-kube-api-access-smlw7\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g\" (UID: \"f283abb9-540b-4253-a056-236a2b953d49\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.166434 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.166373    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:47.438333 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.438245    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"]
Sep 16 05:00:47.456294 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:00:47.456265    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf283abb9_540b_4253_a056_236a2b953d49.slice/crio-515b42421b8fe84a9504c84f12586a00c38b986bd15eacb5fa16d48db501fd48 WatchSource:0}: Error finding container 515b42421b8fe84a9504c84f12586a00c38b986bd15eacb5fa16d48db501fd48: Status 404 returned error can't find the container with id 515b42421b8fe84a9504c84f12586a00c38b986bd15eacb5fa16d48db501fd48
Sep 16 05:00:47.459084 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:47.457929    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 05:00:48.061934 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:48.061900    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g" event={"ID":"f283abb9-540b-4253-a056-236a2b953d49","Type":"ContainerStarted","Data":"515b42421b8fe84a9504c84f12586a00c38b986bd15eacb5fa16d48db501fd48"}
Sep 16 05:00:49.069897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:49.069861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g" event={"ID":"f283abb9-540b-4253-a056-236a2b953d49","Type":"ContainerStarted","Data":"f1a8ab9ddcdb47ef2598009f8b41f099019dd79ee0bf57a3efa3157fe717a5fd"}
Sep 16 05:00:49.090571 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:49.090514    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g" podStartSLOduration=2.112705346 podStartE2EDuration="3.090495652s" totalImagesPullingTime="977.790306ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:00:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:00:49.087852947 +0000 UTC m=+702.749032145" watchObservedRunningTime="2026-09-16 05:00:49.090495652 +0000 UTC m=+702.751674823"
Sep 16 05:00:57.167205 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:57.167163    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:57.167583 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:57.167254    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:57.179028 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:57.179008    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:00:58.127003 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:00:58.126969    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g"
Sep 16 05:01:08.142127 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.142092    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"]
Sep 16 05:01:08.145813 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.145788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.147600 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.147577    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 16 05:01:08.154503 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.154416    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"]
Sep 16 05:01:08.295235 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.295204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.295395 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.295250    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.295395 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.295270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.295395 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.295347    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.295395 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.295369    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.295576 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.295404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5g46\" (UniqueName: \"kubernetes.io/projected/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-kube-api-access-v5g46\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.396541 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.396448    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5g46\" (UniqueName: \"kubernetes.io/projected/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-kube-api-access-v5g46\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.396541 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.396522    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.396791 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.396562    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.396791 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.396580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.396791 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.396625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.396791 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.396641    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.397006 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.396980    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.397062 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.397014    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.397062 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.397034    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.398994 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.398972    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.399150 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.399133    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.403721 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.403700    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5g46\" (UniqueName: \"kubernetes.io/projected/340a892f-ac56-4cfb-bf7d-4c34fd355f5e-kube-api-access-v5g46\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-qpf82\" (UID: \"340a892f-ac56-4cfb-bf7d-4c34fd355f5e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.458562 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.458539    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:08.728809 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:08.728760    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"]
Sep 16 05:01:08.730860 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:01:08.730832    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod340a892f_ac56_4cfb_bf7d_4c34fd355f5e.slice/crio-74b39450c6e4a08be93b99412b16f83f3a26b564d27c949a6dea6bdc2509a16c WatchSource:0}: Error finding container 74b39450c6e4a08be93b99412b16f83f3a26b564d27c949a6dea6bdc2509a16c: Status 404 returned error can't find the container with id 74b39450c6e4a08be93b99412b16f83f3a26b564d27c949a6dea6bdc2509a16c
Sep 16 05:01:09.168522 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:09.168430    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82" event={"ID":"340a892f-ac56-4cfb-bf7d-4c34fd355f5e","Type":"ContainerStarted","Data":"3a1efe880141ea75cbd5f89372614e525b631499c03a3180aefa9540c4b6661a"}
Sep 16 05:01:09.168522 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:09.168499    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82" event={"ID":"340a892f-ac56-4cfb-bf7d-4c34fd355f5e","Type":"ContainerStarted","Data":"74b39450c6e4a08be93b99412b16f83f3a26b564d27c949a6dea6bdc2509a16c"}
Sep 16 05:01:09.186958 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:09.186910    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82" podStartSLOduration=0.996040717 podStartE2EDuration="1.186895608s" totalImagesPullingTime="190.854891ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:01:09.184222425 +0000 UTC m=+722.845401605" watchObservedRunningTime="2026-09-16 05:01:09.186895608 +0000 UTC m=+722.848074832"
Sep 16 05:01:18.459119 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:18.459087    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:18.459604 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:18.459150    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:18.470999 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:18.470978    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:19.225443 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:19.225413    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-qpf82"
Sep 16 05:01:23.192047 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.192018    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"]
Sep 16 05:01:23.201308 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.201282    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.203451 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.203424    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 16 05:01:23.205188 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.205166    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"]
Sep 16 05:01:23.316591 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.316562    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6hk5\" (UniqueName: \"kubernetes.io/projected/d400ef7f-26f4-4498-b5ac-a895469f748a-kube-api-access-z6hk5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.316749 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.316605    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d400ef7f-26f4-4498-b5ac-a895469f748a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.316749 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.316627    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.316841 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.316746    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.316841 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.316789    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.316909 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.316858    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.417294 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.417266    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6hk5\" (UniqueName: \"kubernetes.io/projected/d400ef7f-26f4-4498-b5ac-a895469f748a-kube-api-access-z6hk5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.417435 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.417307    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d400ef7f-26f4-4498-b5ac-a895469f748a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.417435 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.417324    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.417435 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.417352    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.417435 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.417380    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.417435 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.417423    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.417808 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.417780    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.417915 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.417829    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.417915 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.417880    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.419734 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.419712    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d400ef7f-26f4-4498-b5ac-a895469f748a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.420090 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.420069    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d400ef7f-26f4-4498-b5ac-a895469f748a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.425381 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.425363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6hk5\" (UniqueName: \"kubernetes.io/projected/d400ef7f-26f4-4498-b5ac-a895469f748a-kube-api-access-z6hk5\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn\" (UID: \"d400ef7f-26f4-4498-b5ac-a895469f748a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.511899 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.511873    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:23.783565 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:23.783535    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"]
Sep 16 05:01:23.784516 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:01:23.784472    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd400ef7f_26f4_4498_b5ac_a895469f748a.slice/crio-04658052ab43f6548fee147a54c5fb7723ea935e6a9c7094db320749b6542d53 WatchSource:0}: Error finding container 04658052ab43f6548fee147a54c5fb7723ea935e6a9c7094db320749b6542d53: Status 404 returned error can't find the container with id 04658052ab43f6548fee147a54c5fb7723ea935e6a9c7094db320749b6542d53
Sep 16 05:01:24.240084 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:24.240051    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn" event={"ID":"d400ef7f-26f4-4498-b5ac-a895469f748a","Type":"ContainerStarted","Data":"78c2ad5b203e4cae86e523fd543d8d34d4341322ed15a5274d5b7b0873d52068"}
Sep 16 05:01:24.240084 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:24.240099    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn" event={"ID":"d400ef7f-26f4-4498-b5ac-a895469f748a","Type":"ContainerStarted","Data":"04658052ab43f6548fee147a54c5fb7723ea935e6a9c7094db320749b6542d53"}
Sep 16 05:01:24.258149 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:24.258102    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn" podStartSLOduration=1.100055767 podStartE2EDuration="1.258087216s" totalImagesPullingTime="158.031449ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:01:24.256908838 +0000 UTC m=+737.918088015" watchObservedRunningTime="2026-09-16 05:01:24.258087216 +0000 UTC m=+737.919266394"
Sep 16 05:01:33.512716 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:33.512689    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:33.513147 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:33.512727    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:33.524906 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:33.524883    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:01:34.303943 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:01:34.303913    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn"
Sep 16 05:02:48.658712 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.658680    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"]
Sep 16 05:02:48.662403 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.662385    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.666197 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.666172    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c05179-openshift-default-dockercfg-vblmr\""
Sep 16 05:02:48.688125 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.688101    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"]
Sep 16 05:02:48.725923 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.725897    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnk9x\" (UniqueName: \"kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-kube-api-access-vnk9x\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.726042 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.725958    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-envoy\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.726042 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.726021    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-data\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.726149 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.726059    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-token\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.726203 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.726135    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-socket\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.726203 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.726182    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-credential-socket\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.726306 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.726229    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-podinfo\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.726306 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.726266    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-certs\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.726306 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.726296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8510fd0-50d4-496e-975c-463bc585f7eb-istiod-ca-cert\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.827152 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.827115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-data\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.827331 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.827167    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-token\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.827331 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.827199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-socket\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.827331 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.827230    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-credential-socket\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.827331 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.827264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-podinfo\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.827331 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.827315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-certs\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.827624 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.827342    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8510fd0-50d4-496e-975c-463bc585f7eb-istiod-ca-cert\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.827624 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.827427    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnk9x\" (UniqueName: \"kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-kube-api-access-vnk9x\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.827624 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.827533    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-envoy\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.827814 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.827638    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-data\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.828303 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.827982    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-socket\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.828514 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.828468    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-certs\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.828703 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.828678    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-credential-socket\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.829267 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.829246    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8510fd0-50d4-496e-975c-463bc585f7eb-istiod-ca-cert\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.830369 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.830242    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-envoy\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.833070 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.833046    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-podinfo\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.833431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.833414    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"]
Sep 16 05:02:48.838140 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.838120    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:48.840669 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.840647    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-12b6c6-openshift-default-dockercfg-xqffk\""
Sep 16 05:02:48.844221 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.844199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-token\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.846630 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.846609    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnk9x\" (UniqueName: \"kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-kube-api-access-vnk9x\") pod \"e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") " pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:48.852415 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.852357    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"]
Sep 16 05:02:48.928942 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.928872    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-data\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:48.928942 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.928904    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-envoy\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:48.928942 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.928925    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-certs\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:48.929162 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.928978    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-podinfo\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:48.929162 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.929072    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-token\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:48.929254 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.929191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-socket\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:48.929254 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.929232    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-credential-socket\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:48.929353 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.929257    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5hrq\" (UniqueName: \"kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-kube-api-access-m5hrq\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:48.929353 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.929298    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istiod-ca-cert\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:48.973507 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:48.973464    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:49.031426 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.031384    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-socket\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.031671 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.031642    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-credential-socket\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.031803 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.031788    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5hrq\" (UniqueName: \"kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-kube-api-access-m5hrq\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.032204 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.032176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istiod-ca-cert\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.032540 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.032519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-data\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.034214 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.033401    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-envoy\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.034214 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.033451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-certs\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.034214 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.033457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istiod-ca-cert\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.034214 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.033509    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-podinfo\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.034214 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.033620    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-token\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.034214 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.032892    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-data\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.034214 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.032689    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-socket\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.035765 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.033188    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-credential-socket\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.036098 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.036064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-certs\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.046908 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.046861    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5hrq\" (UniqueName: \"kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-kube-api-access-m5hrq\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.047277 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.047232    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-envoy\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.047871 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.047832    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-podinfo\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.050187 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.050147    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-token\") pod \"e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") " pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.172590 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.172560    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:49.259021 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.258994    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"]
Sep 16 05:02:49.261686 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:02:49.261659    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8510fd0_50d4_496e_975c_463bc585f7eb.slice/crio-e8537af0840813fc97e6ed7444d218ef0804e0616e93e1c80b9ff24b86a685e7 WatchSource:0}: Error finding container e8537af0840813fc97e6ed7444d218ef0804e0616e93e1c80b9ff24b86a685e7: Status 404 returned error can't find the container with id e8537af0840813fc97e6ed7444d218ef0804e0616e93e1c80b9ff24b86a685e7
Sep 16 05:02:49.263935 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.263903    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:02:49.264006 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.263975    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:02:49.264006 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.264000    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:02:49.450974 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.450945    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"]
Sep 16 05:02:49.452467 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:02:49.452438    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0b12f0_3a7f_47d0_b8d5_40cd9d161092.slice/crio-75fee7235e0261a416f021fc835778b495cafa73cc772a9ed9d9f5eb28c09cd3 WatchSource:0}: Error finding container 75fee7235e0261a416f021fc835778b495cafa73cc772a9ed9d9f5eb28c09cd3: Status 404 returned error can't find the container with id 75fee7235e0261a416f021fc835778b495cafa73cc772a9ed9d9f5eb28c09cd3
Sep 16 05:02:49.459640 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.459590    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:02:49.459809 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.459724    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:02:49.459879 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.459805    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:02:49.668558 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.668516    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" event={"ID":"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092","Type":"ContainerStarted","Data":"554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f"}
Sep 16 05:02:49.668993 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.668629    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" event={"ID":"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092","Type":"ContainerStarted","Data":"75fee7235e0261a416f021fc835778b495cafa73cc772a9ed9d9f5eb28c09cd3"}
Sep 16 05:02:49.670309 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.670288    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" event={"ID":"b8510fd0-50d4-496e-975c-463bc585f7eb","Type":"ContainerStarted","Data":"fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f"}
Sep 16 05:02:49.670402 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.670326    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" event={"ID":"b8510fd0-50d4-496e-975c-463bc585f7eb","Type":"ContainerStarted","Data":"e8537af0840813fc97e6ed7444d218ef0804e0616e93e1c80b9ff24b86a685e7"}
Sep 16 05:02:49.703410 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.703318    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" podStartSLOduration=1.70329888 podStartE2EDuration="1.70329888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:02:49.700583176 +0000 UTC m=+823.361762355" watchObservedRunningTime="2026-09-16 05:02:49.70329888 +0000 UTC m=+823.364478060"
Sep 16 05:02:49.973853 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:49.973774    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:50.173662 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:50.173631    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:50.178411 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:50.178388    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:50.225103 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:50.225061    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" podStartSLOduration=2.225040989 podStartE2EDuration="2.225040989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:02:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:02:49.742812982 +0000 UTC m=+823.403992157" watchObservedRunningTime="2026-09-16 05:02:50.225040989 +0000 UTC m=+823.886220172"
Sep 16 05:02:50.676036 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:50.675948    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:50.676672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:50.676652    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:02:50.978853 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:50.978829    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:51.682355 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:51.682319    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:51.683438 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:51.683417    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:02:53.753563 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:53.753536    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"]
Sep 16 05:02:53.757396 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:53.757376    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:02:53.759440 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:53.759416    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-c05179\""
Sep 16 05:02:53.759545 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:53.759509    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-c05179-dockercfg-xktm5\""
Sep 16 05:02:53.773544 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:53.773520    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"]
Sep 16 05:02:53.878655 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:53.878603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkd86\" (UniqueName: \"kubernetes.io/projected/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-kube-api-access-bkd86\") pod \"payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb\" (UID: \"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:02:53.878822 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:53.878696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb\" (UID: \"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:02:53.979813 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:53.979779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb\" (UID: \"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:02:53.979965 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:53.979884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkd86\" (UniqueName: \"kubernetes.io/projected/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-kube-api-access-bkd86\") pod \"payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb\" (UID: \"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:02:53.980606 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:53.980585    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb\" (UID: \"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:02:53.987138 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:53.987117    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkd86\" (UniqueName: \"kubernetes.io/projected/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-kube-api-access-bkd86\") pod \"payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb\" (UID: \"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:02:54.067786 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.067713    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:02:54.362832 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.362810    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"]
Sep 16 05:02:54.365403 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:02:54.365377    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2b64f9_a4c1_4fdb_a70e_73baa528fc3d.slice/crio-04c8af8653bfc640c8c400ed142a7eb2fcbc1095e3485135ff622974056c16d1 WatchSource:0}: Error finding container 04c8af8653bfc640c8c400ed142a7eb2fcbc1095e3485135ff622974056c16d1: Status 404 returned error can't find the container with id 04c8af8653bfc640c8c400ed142a7eb2fcbc1095e3485135ff622974056c16d1
Sep 16 05:02:54.695357 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.695281    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"]
Sep 16 05:02:54.699560 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.699528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb" event={"ID":"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d","Type":"ContainerStarted","Data":"963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1"}
Sep 16 05:02:54.699683 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.699574    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb" event={"ID":"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d","Type":"ContainerStarted","Data":"04c8af8653bfc640c8c400ed142a7eb2fcbc1095e3485135ff622974056c16d1"}
Sep 16 05:02:54.699683 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.699598    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:02:54.699683 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.699615    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:02:54.701349 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.701331    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-12b6c6\""
Sep 16 05:02:54.708199 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.708176    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"]
Sep 16 05:02:54.719991 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.719927    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb" podStartSLOduration=1.7199104520000001 podStartE2EDuration="1.719910452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:02:54.71758876 +0000 UTC m=+828.378767941" watchObservedRunningTime="2026-09-16 05:02:54.719910452 +0000 UTC m=+828.381089630"
Sep 16 05:02:54.787535 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.787512    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd\" (UID: \"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:02:54.787852 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.787607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbbtl\" (UniqueName: \"kubernetes.io/projected/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-kube-api-access-xbbtl\") pod \"payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd\" (UID: \"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:02:54.888308 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.888272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbbtl\" (UniqueName: \"kubernetes.io/projected/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-kube-api-access-xbbtl\") pod \"payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd\" (UID: \"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:02:54.888565 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.888381    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd\" (UID: \"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:02:54.889360 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.889333    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd\" (UID: \"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:02:54.896678 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:54.896653    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbbtl\" (UniqueName: \"kubernetes.io/projected/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-kube-api-access-xbbtl\") pod \"payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd\" (UID: \"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:02:55.011588 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:55.011567    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:02:55.288463 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:55.288439    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"]
Sep 16 05:02:55.290455 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:02:55.290422    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdcd8f3_8029_43f8_82d1_0acc90b4bbcd.slice/crio-f2a6f138bca0b14d5740fb843cd5d662b049736d4a59144e647ef39e6f79c594 WatchSource:0}: Error finding container f2a6f138bca0b14d5740fb843cd5d662b049736d4a59144e647ef39e6f79c594: Status 404 returned error can't find the container with id f2a6f138bca0b14d5740fb843cd5d662b049736d4a59144e647ef39e6f79c594
Sep 16 05:02:55.706763 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:55.706659    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd" event={"ID":"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd","Type":"ContainerStarted","Data":"7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3"}
Sep 16 05:02:55.706763 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:55.706726    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd" event={"ID":"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd","Type":"ContainerStarted","Data":"f2a6f138bca0b14d5740fb843cd5d662b049736d4a59144e647ef39e6f79c594"}
Sep 16 05:02:55.706991 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:55.706905    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:02:55.734280 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:55.734234    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd" podStartSLOduration=1.7342182579999998 podStartE2EDuration="1.734218258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:02:55.731436338 +0000 UTC m=+829.392615571" watchObservedRunningTime="2026-09-16 05:02:55.734218258 +0000 UTC m=+829.395397485"
Sep 16 05:02:57.378865 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.378828    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"]
Sep 16 05:02:57.383298 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.383275    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.385571 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.385550    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b9f9e7ea-openshift-default-dockercfg-7lqkc\""
Sep 16 05:02:57.399591 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.399565    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"]
Sep 16 05:02:57.521972 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.521928    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b43631-897f-4826-a90f-d19459db06ab-istio-podinfo\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.522174 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.522003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b43631-897f-4826-a90f-d19459db06ab-istiod-ca-cert\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.522174 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.522033    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-envoy\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.522174 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.522078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-istio-token\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.522174 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.522122    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-credential-socket\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.522394 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.522189    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-socket\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.522394 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.522239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b87qj\" (UniqueName: \"kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-kube-api-access-b87qj\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.522394 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.522274    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-data\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.522394 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.522317    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-certs\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.623152    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-socket\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.623226    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b87qj\" (UniqueName: \"kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-kube-api-access-b87qj\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.623264    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-data\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.623297    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-certs\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.623338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b43631-897f-4826-a90f-d19459db06ab-istio-podinfo\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.623403    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b43631-897f-4826-a90f-d19459db06ab-istiod-ca-cert\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.623429    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-envoy\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.623456    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-istio-token\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.623508    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-credential-socket\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.623932    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-credential-socket\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.624141    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-socket\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.624659    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-data\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.625502 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.624867    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-certs\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.626378 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.626348    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b43631-897f-4826-a90f-d19459db06ab-istiod-ca-cert\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.635065 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.634965    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-envoy\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.638028 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.637972    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b43631-897f-4826-a90f-d19459db06ab-istio-podinfo\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.641244 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.641125    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b87qj\" (UniqueName: \"kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-kube-api-access-b87qj\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.641244 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.641189    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-istio-token\") pod \"e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") " pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.697313 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.697241    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:57.999733 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:57.999712    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"]
Sep 16 05:02:58.001382 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:02:58.001357    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b43631_897f_4826_a90f_d19459db06ab.slice/crio-7fa360d5850b935c8fe92fde178e9ad5ffc29a967564def3bc3d1da4ce5a5191 WatchSource:0}: Error finding container 7fa360d5850b935c8fe92fde178e9ad5ffc29a967564def3bc3d1da4ce5a5191: Status 404 returned error can't find the container with id 7fa360d5850b935c8fe92fde178e9ad5ffc29a967564def3bc3d1da4ce5a5191
Sep 16 05:02:58.003939 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.003898    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:02:58.004016 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.003983    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:02:58.004056 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.004027    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:02:58.268831 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.268745    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"]
Sep 16 05:02:58.272544 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.272521    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:02:58.274378 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.274349    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-ee7a60\""
Sep 16 05:02:58.274531 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.274430    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-ee7a60-dockercfg-q56s8\""
Sep 16 05:02:58.282440 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.282417    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"]
Sep 16 05:02:58.434813 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.434769    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhptn\" (UniqueName: \"kubernetes.io/projected/2d5333cb-a1e5-4d13-89cc-05f82892af48-kube-api-access-lhptn\") pod \"payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn\" (UID: \"2d5333cb-a1e5-4d13-89cc-05f82892af48\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:02:58.435184 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.434910    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d5333cb-a1e5-4d13-89cc-05f82892af48-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn\" (UID: \"2d5333cb-a1e5-4d13-89cc-05f82892af48\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:02:58.536112 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.536021    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d5333cb-a1e5-4d13-89cc-05f82892af48-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn\" (UID: \"2d5333cb-a1e5-4d13-89cc-05f82892af48\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:02:58.536112 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.536096    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhptn\" (UniqueName: \"kubernetes.io/projected/2d5333cb-a1e5-4d13-89cc-05f82892af48-kube-api-access-lhptn\") pod \"payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn\" (UID: \"2d5333cb-a1e5-4d13-89cc-05f82892af48\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:02:58.536769 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.536745    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d5333cb-a1e5-4d13-89cc-05f82892af48-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn\" (UID: \"2d5333cb-a1e5-4d13-89cc-05f82892af48\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:02:58.543812 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.543789    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhptn\" (UniqueName: \"kubernetes.io/projected/2d5333cb-a1e5-4d13-89cc-05f82892af48-kube-api-access-lhptn\") pod \"payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn\" (UID: \"2d5333cb-a1e5-4d13-89cc-05f82892af48\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:02:58.585298 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.585274    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:02:58.733831 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.733798    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" event={"ID":"63b43631-897f-4826-a90f-d19459db06ab","Type":"ContainerStarted","Data":"022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6"}
Sep 16 05:02:58.733984 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.733844    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" event={"ID":"63b43631-897f-4826-a90f-d19459db06ab","Type":"ContainerStarted","Data":"7fa360d5850b935c8fe92fde178e9ad5ffc29a967564def3bc3d1da4ce5a5191"}
Sep 16 05:02:58.754780 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.754731    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" podStartSLOduration=1.754717772 podStartE2EDuration="1.754717772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:02:58.751968346 +0000 UTC m=+832.413147522" watchObservedRunningTime="2026-09-16 05:02:58.754717772 +0000 UTC m=+832.415896948"
Sep 16 05:02:58.862810 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:58.862783    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"]
Sep 16 05:02:59.698281 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:59.698247    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:59.703627 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:59.703602    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:59.741740 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:59.741700    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn" event={"ID":"2d5333cb-a1e5-4d13-89cc-05f82892af48","Type":"ContainerStarted","Data":"d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457"}
Sep 16 05:02:59.741891 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:59.741757    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn" event={"ID":"2d5333cb-a1e5-4d13-89cc-05f82892af48","Type":"ContainerStarted","Data":"df9998b5c0f0e2bf61e30cbd33a701e75acbb069839020f5d8cf5261d4f6d508"}
Sep 16 05:02:59.741940 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:59.741900    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:02:59.741982 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:59.741939    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:59.742905 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:59.742888    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:02:59.776427 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:02:59.776381    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn" podStartSLOduration=1.776367493 podStartE2EDuration="1.776367493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:02:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:02:59.774307269 +0000 UTC m=+833.435486446" watchObservedRunningTime="2026-09-16 05:02:59.776367493 +0000 UTC m=+833.437546669"
Sep 16 05:03:05.017257 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.017214    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"]
Sep 16 05:03:05.038229 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.038199    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"]
Sep 16 05:03:05.038583 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.038507    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:05.044341 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.044313    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-b9f9e7ea\""
Sep 16 05:03:05.044690 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.044671    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-b9f9e7ea-dockercfg-47h8k\""
Sep 16 05:03:05.048727 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.048622    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"]
Sep 16 05:03:05.053302 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.053060    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:05.063617 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.063593    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"]
Sep 16 05:03:05.121068 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.121024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2h6m\" (UniqueName: \"kubernetes.io/projected/31baea54-8625-43cc-8b9c-7c8eb0a18db3-kube-api-access-k2h6m\") pod \"payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj\" (UID: \"31baea54-8625-43cc-8b9c-7c8eb0a18db3\") " pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:05.121360 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.121337    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sglrx\" (UniqueName: \"kubernetes.io/projected/f60563d1-7646-4661-9a1a-9490f73d2b96-kube-api-access-sglrx\") pod \"payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj\" (UID: \"f60563d1-7646-4661-9a1a-9490f73d2b96\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:05.121616 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.121597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31baea54-8625-43cc-8b9c-7c8eb0a18db3-plugins-config-volume\") pod \"payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj\" (UID: \"31baea54-8625-43cc-8b9c-7c8eb0a18db3\") " pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:05.121778 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.121763    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f60563d1-7646-4661-9a1a-9490f73d2b96-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj\" (UID: \"f60563d1-7646-4661-9a1a-9490f73d2b96\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:05.223316 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.223281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31baea54-8625-43cc-8b9c-7c8eb0a18db3-plugins-config-volume\") pod \"payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj\" (UID: \"31baea54-8625-43cc-8b9c-7c8eb0a18db3\") " pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:05.223677 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.223649    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f60563d1-7646-4661-9a1a-9490f73d2b96-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj\" (UID: \"f60563d1-7646-4661-9a1a-9490f73d2b96\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:05.223882 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.223850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2h6m\" (UniqueName: \"kubernetes.io/projected/31baea54-8625-43cc-8b9c-7c8eb0a18db3-kube-api-access-k2h6m\") pod \"payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj\" (UID: \"31baea54-8625-43cc-8b9c-7c8eb0a18db3\") " pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:05.224077 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.224061    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sglrx\" (UniqueName: \"kubernetes.io/projected/f60563d1-7646-4661-9a1a-9490f73d2b96-kube-api-access-sglrx\") pod \"payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj\" (UID: \"f60563d1-7646-4661-9a1a-9490f73d2b96\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:05.224230 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.224200    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31baea54-8625-43cc-8b9c-7c8eb0a18db3-plugins-config-volume\") pod \"payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj\" (UID: \"31baea54-8625-43cc-8b9c-7c8eb0a18db3\") " pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:05.225141 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.225081    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f60563d1-7646-4661-9a1a-9490f73d2b96-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj\" (UID: \"f60563d1-7646-4661-9a1a-9490f73d2b96\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:05.232496 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.232431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2h6m\" (UniqueName: \"kubernetes.io/projected/31baea54-8625-43cc-8b9c-7c8eb0a18db3-kube-api-access-k2h6m\") pod \"payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj\" (UID: \"31baea54-8625-43cc-8b9c-7c8eb0a18db3\") " pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:05.240374 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.240352    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sglrx\" (UniqueName: \"kubernetes.io/projected/f60563d1-7646-4661-9a1a-9490f73d2b96-kube-api-access-sglrx\") pod \"payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj\" (UID: \"f60563d1-7646-4661-9a1a-9490f73d2b96\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:05.358263 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.358180    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:05.368195 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.368004    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:05.696826 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.690306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"]
Sep 16 05:03:05.712520 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.712057    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"]
Sep 16 05:03:05.714060 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.713724    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:03:05.777618 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.777592    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj" event={"ID":"31baea54-8625-43cc-8b9c-7c8eb0a18db3","Type":"ContainerStarted","Data":"82c383214c7c17dfc04705cc4300096ad87271ba71cbc31f371caaa89e251373"}
Sep 16 05:03:05.779280 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:05.779198    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj" event={"ID":"f60563d1-7646-4661-9a1a-9490f73d2b96","Type":"ContainerStarted","Data":"0516cc61b0e276f38640cce7a6fcbe4e5af08bea6fe2814c8d7f58772168cc5c"}
Sep 16 05:03:06.714681 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:06.714649    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:03:06.719003 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:06.717556    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 05:03:06.719217 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:06.719192    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 05:03:06.814843 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:06.814444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj" event={"ID":"31baea54-8625-43cc-8b9c-7c8eb0a18db3","Type":"ContainerStarted","Data":"3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf"}
Sep 16 05:03:06.815359 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:06.815316    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:06.825375 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:06.825338    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj" event={"ID":"f60563d1-7646-4661-9a1a-9490f73d2b96","Type":"ContainerStarted","Data":"a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0"}
Sep 16 05:03:06.825854 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:06.825832    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:06.831292 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:06.831246    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj" podStartSLOduration=1.83123003 podStartE2EDuration="1.83123003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:03:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:03:06.829821065 +0000 UTC m=+840.491000242" watchObservedRunningTime="2026-09-16 05:03:06.83123003 +0000 UTC m=+840.492409206"
Sep 16 05:03:06.846845 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:06.846797    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj" podStartSLOduration=2.846782547 podStartE2EDuration="2.846782547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:03:06.844354374 +0000 UTC m=+840.505533551" watchObservedRunningTime="2026-09-16 05:03:06.846782547 +0000 UTC m=+840.507961722"
Sep 16 05:03:09.846613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:09.846577    2559 generic.go:356] "Generic (PLEG): container finished" podID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerID="554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f" exitCode=0
Sep 16 05:03:09.847023 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:09.846655    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" event={"ID":"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092","Type":"ContainerDied","Data":"554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f"}
Sep 16 05:03:09.847145 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:09.847131    2559 scope.go:117] "RemoveContainer" containerID="554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f"
Sep 16 05:03:09.848254 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:09.848225    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:09.848316 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:09.848295    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:09.848354 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:09.848344    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:10.749893 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:10.749857    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:03:10.857269 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:10.857235    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" event={"ID":"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092","Type":"ContainerStarted","Data":"d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53"}
Sep 16 05:03:10.859278 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:10.859253    2559 generic.go:356] "Generic (PLEG): container finished" podID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerID="fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f" exitCode=0
Sep 16 05:03:10.859430 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:10.859359    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" event={"ID":"b8510fd0-50d4-496e-975c-463bc585f7eb","Type":"ContainerDied","Data":"fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f"}
Sep 16 05:03:10.859835 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:10.859818    2559 scope.go:117] "RemoveContainer" containerID="fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f"
Sep 16 05:03:10.861133 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:10.861103    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:10.861292 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:10.861277    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:10.861641 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:10.861451    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:11.173572 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:11.173496    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:03:11.173708 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:11.173596    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 16 05:03:11.173708 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:11.173629    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 16 05:03:11.867190 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:11.867156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" event={"ID":"b8510fd0-50d4-496e-975c-463bc585f7eb","Type":"ContainerStarted","Data":"c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739"}
Sep 16 05:03:11.973704 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:11.973667    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:03:11.973892 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:11.973872    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 05:03:11.973945 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:11.973925    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 05:03:12.059505 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.059213    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"]
Sep 16 05:03:12.065529 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.065164    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.072051 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.071159    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d1f291-openshift-default-dockercfg-gkzkd\""
Sep 16 05:03:12.084432 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.083390    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"]
Sep 16 05:03:12.174543 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.173651    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 16 05:03:12.174543 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.173709    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 16 05:03:12.237513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.237056    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-token\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.237513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.237126    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef233360-7b34-4517-9e06-f7f3a64654ca-istiod-ca-cert\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.237513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.237169    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-envoy\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.237513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.237254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-data\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.237513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.237284    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-credential-socket\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.237513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.237316    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64l9f\" (UniqueName: \"kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-kube-api-access-64l9f\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.237513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.237353    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-certs\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.237513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.237399    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-socket\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.237513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.237464    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-podinfo\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.338520 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.338457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-token\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.338717 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.338548    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef233360-7b34-4517-9e06-f7f3a64654ca-istiod-ca-cert\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.338717 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.338593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-envoy\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.338717 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.338666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-data\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.338717 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.338696    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-credential-socket\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.338935 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.338728    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64l9f\" (UniqueName: \"kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-kube-api-access-64l9f\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.338935 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.338763    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-certs\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.338935 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.338807    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-socket\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.338935 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.338865    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-podinfo\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.339762 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.339734    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-data\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.340740 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.340712    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef233360-7b34-4517-9e06-f7f3a64654ca-istiod-ca-cert\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.342180 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.341458    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-credential-socket\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.342180 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.341716    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-certs\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.342180 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.341945    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-socket\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.344796 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.344766    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-podinfo\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.345392 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.345371    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-envoy\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.347858 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.347818    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-token\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.352153 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.352122    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64l9f\" (UniqueName: \"kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-kube-api-access-64l9f\") pod \"e2e-inf-b-d1f291-openshift-default-79c888d486-2745f\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") " pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.383275 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.383046    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:12.859560 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.857950    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"]
Sep 16 05:03:12.879972 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.879539    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:12.879972 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.879629    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:12.879972 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.879668    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:12.976497 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.975504    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 05:03:12.976497 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:12.975576    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 05:03:13.173114 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:13.173010    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 16 05:03:13.173114 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:13.173084    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 16 05:03:13.886787 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:13.886750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" event={"ID":"ef233360-7b34-4517-9e06-f7f3a64654ca","Type":"ContainerStarted","Data":"3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019"}
Sep 16 05:03:13.887147 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:13.886804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" event={"ID":"ef233360-7b34-4517-9e06-f7f3a64654ca","Type":"ContainerStarted","Data":"c1f04054924bf51561b9ccb9af22f94564489e07fb20613e444820536f40d493"}
Sep 16 05:03:13.907973 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:13.907905    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" podStartSLOduration=1.9078831790000002 podStartE2EDuration="1.907883179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:03:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:03:13.906166212 +0000 UTC m=+847.567345390" watchObservedRunningTime="2026-09-16 05:03:13.907883179 +0000 UTC m=+847.569062357"
Sep 16 05:03:13.974351 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:13.974302    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 05:03:13.974576 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:13.974378    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 05:03:14.173043 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:14.172947    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 16 05:03:14.173043 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:14.173012    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 16 05:03:14.384616 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:14.384579    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:14.401842 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:14.401803    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:14.896886 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:14.896850    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:14.898440 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:14.898413    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:14.979508 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:14.974914    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 05:03:14.979508 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:14.974982    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 05:03:15.173236 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:15.173140    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 16 05:03:15.173236 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:15.173194    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 16 05:03:15.974670 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:15.974623    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 05:03:15.975128 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:15.974692    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 05:03:16.176920 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:16.176894    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:03:16.177209 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:16.177186    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:03:16.177851 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:16.177831    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:03:16.973893 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:16.973860    2559 patch_prober.go:28] interesting pod/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 16 05:03:16.974067 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:16.973910    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 16 05:03:17.835613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:17.835372    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:17.836001 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:17.835975    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:18.010011 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:18.009973    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:03:18.010782 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:18.010760    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:03:18.012277 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:18.012258    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:03:19.936370 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:19.936255    2559 generic.go:356] "Generic (PLEG): container finished" podID="63b43631-897f-4826-a90f-d19459db06ab" containerID="022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6" exitCode=0
Sep 16 05:03:19.937159 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:19.936441    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" event={"ID":"63b43631-897f-4826-a90f-d19459db06ab","Type":"ContainerDied","Data":"022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6"}
Sep 16 05:03:19.937159 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:19.936955    2559 scope.go:117] "RemoveContainer" containerID="022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6"
Sep 16 05:03:19.938089 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:19.938062    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:19.938155 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:19.938124    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:19.938189 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:19.938155    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:20.491673 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:20.491630    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"]
Sep 16 05:03:20.495261 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:20.495234    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"
Sep 16 05:03:20.503678 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:20.503648    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:03:20.504841 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:20.504813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"]
Sep 16 05:03:20.552063 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:20.552027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35ec9481-4174-43f0-a900-61e1b193991d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf\" (UID: \"35ec9481-4174-43f0-a900-61e1b193991d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"
Sep 16 05:03:20.653274 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:20.653236    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35ec9481-4174-43f0-a900-61e1b193991d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf\" (UID: \"35ec9481-4174-43f0-a900-61e1b193991d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"
Sep 16 05:03:20.653938 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:20.653917    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35ec9481-4174-43f0-a900-61e1b193991d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf\" (UID: \"35ec9481-4174-43f0-a900-61e1b193991d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"
Sep 16 05:03:20.819776 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:20.819692    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"
Sep 16 05:03:20.944257 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:20.944223    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" event={"ID":"63b43631-897f-4826-a90f-d19459db06ab","Type":"ContainerStarted","Data":"8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7"}
Sep 16 05:03:21.095542 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:21.088787    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"]
Sep 16 05:03:21.108775 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:03:21.108738    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35ec9481_4174_43f0_a900_61e1b193991d.slice/crio-81e46460faa2f3b4c517349803e1fd99ba5479e5aceac1e08eeeda2986027c31 WatchSource:0}: Error finding container 81e46460faa2f3b4c517349803e1fd99ba5479e5aceac1e08eeeda2986027c31: Status 404 returned error can't find the container with id 81e46460faa2f3b4c517349803e1fd99ba5479e5aceac1e08eeeda2986027c31
Sep 16 05:03:21.699332 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:21.698859    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:03:21.699332 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:21.698985    2559 patch_prober.go:28] interesting pod/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 05:03:21.699332 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:21.699028    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 05:03:21.950815 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:21.950725    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf" event={"ID":"35ec9481-4174-43f0-a900-61e1b193991d","Type":"ContainerStarted","Data":"81e46460faa2f3b4c517349803e1fd99ba5479e5aceac1e08eeeda2986027c31"}
Sep 16 05:03:22.704514 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:22.703839    2559 patch_prober.go:28] interesting pod/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 05:03:22.704514 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:22.703902    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 05:03:23.708987 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:23.708945    2559 patch_prober.go:28] interesting pod/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 05:03:23.709493 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:23.709014    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 05:03:24.699207 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:24.698808    2559 patch_prober.go:28] interesting pod/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 05:03:24.699207 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:24.698865    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 05:03:24.970739 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:24.970661    2559 generic.go:356] "Generic (PLEG): container finished" podID="35ec9481-4174-43f0-a900-61e1b193991d" containerID="b6ca99b1879c1e7a33d2f0e6d5368d0f69fc9e2d483da1664134970665f3ce92" exitCode=0
Sep 16 05:03:24.971056 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:24.970748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf" event={"ID":"35ec9481-4174-43f0-a900-61e1b193991d","Type":"ContainerDied","Data":"b6ca99b1879c1e7a33d2f0e6d5368d0f69fc9e2d483da1664134970665f3ce92"}
Sep 16 05:03:25.699193 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:25.699155    2559 patch_prober.go:28] interesting pod/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 16 05:03:25.699391 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:25.699235    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 16 05:03:26.117499 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:26.117453    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"
Sep 16 05:03:26.241082 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:26.241005    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35ec9481-4174-43f0-a900-61e1b193991d-maas-api-service-ca\") pod \"35ec9481-4174-43f0-a900-61e1b193991d\" (UID: \"35ec9481-4174-43f0-a900-61e1b193991d\") "
Sep 16 05:03:26.241347 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:26.241325    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35ec9481-4174-43f0-a900-61e1b193991d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "35ec9481-4174-43f0-a900-61e1b193991d" (UID: "35ec9481-4174-43f0-a900-61e1b193991d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:03:26.342715 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:26.342688    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35ec9481-4174-43f0-a900-61e1b193991d-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:26.702197 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:26.702120    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:03:26.702412 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:26.702388    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:03:26.703007 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:26.702989    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:03:26.982585 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:26.982551    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"
Sep 16 05:03:26.982746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:26.982583    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf" event={"ID":"35ec9481-4174-43f0-a900-61e1b193991d","Type":"ContainerDied","Data":"81e46460faa2f3b4c517349803e1fd99ba5479e5aceac1e08eeeda2986027c31"}
Sep 16 05:03:26.982746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:26.982635    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81e46460faa2f3b4c517349803e1fd99ba5479e5aceac1e08eeeda2986027c31"
Sep 16 05:03:31.065793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.065764    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"]
Sep 16 05:03:31.066222 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.065951    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj" podUID="31baea54-8625-43cc-8b9c-7c8eb0a18db3" containerName="payload-processing" containerID="cri-o://3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf" gracePeriod=30
Sep 16 05:03:31.073848 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.073133    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"]
Sep 16 05:03:31.073848 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.073445    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj" podUID="f60563d1-7646-4661-9a1a-9490f73d2b96" containerName="payload-pre-processing" containerID="cri-o://a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0" gracePeriod=30
Sep 16 05:03:31.219600 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.219354    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"]
Sep 16 05:03:31.221757 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.221737    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-b9f9e7ea-smxlf"]
Sep 16 05:03:31.343530 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.343408    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"]
Sep 16 05:03:31.344513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.343958    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy" containerID="cri-o://8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7" gracePeriod=30
Sep 16 05:03:31.468503 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.468122    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:31.484963 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.484694    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:31.614518 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.613822    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f60563d1-7646-4661-9a1a-9490f73d2b96-plugins-config-volume\") pod \"f60563d1-7646-4661-9a1a-9490f73d2b96\" (UID: \"f60563d1-7646-4661-9a1a-9490f73d2b96\") "
Sep 16 05:03:31.614518 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.613931    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31baea54-8625-43cc-8b9c-7c8eb0a18db3-plugins-config-volume\") pod \"31baea54-8625-43cc-8b9c-7c8eb0a18db3\" (UID: \"31baea54-8625-43cc-8b9c-7c8eb0a18db3\") "
Sep 16 05:03:31.614518 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.613958    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sglrx\" (UniqueName: \"kubernetes.io/projected/f60563d1-7646-4661-9a1a-9490f73d2b96-kube-api-access-sglrx\") pod \"f60563d1-7646-4661-9a1a-9490f73d2b96\" (UID: \"f60563d1-7646-4661-9a1a-9490f73d2b96\") "
Sep 16 05:03:31.614518 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.613997    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2h6m\" (UniqueName: \"kubernetes.io/projected/31baea54-8625-43cc-8b9c-7c8eb0a18db3-kube-api-access-k2h6m\") pod \"31baea54-8625-43cc-8b9c-7c8eb0a18db3\" (UID: \"31baea54-8625-43cc-8b9c-7c8eb0a18db3\") "
Sep 16 05:03:31.614912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.614813    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31baea54-8625-43cc-8b9c-7c8eb0a18db3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "31baea54-8625-43cc-8b9c-7c8eb0a18db3" (UID: "31baea54-8625-43cc-8b9c-7c8eb0a18db3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:03:31.615098 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.615073    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f60563d1-7646-4661-9a1a-9490f73d2b96-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f60563d1-7646-4661-9a1a-9490f73d2b96" (UID: "f60563d1-7646-4661-9a1a-9490f73d2b96"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:03:31.617033 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.616999    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f60563d1-7646-4661-9a1a-9490f73d2b96-kube-api-access-sglrx" (OuterVolumeSpecName: "kube-api-access-sglrx") pod "f60563d1-7646-4661-9a1a-9490f73d2b96" (UID: "f60563d1-7646-4661-9a1a-9490f73d2b96"). InnerVolumeSpecName "kube-api-access-sglrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:03:31.617132 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.617051    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31baea54-8625-43cc-8b9c-7c8eb0a18db3-kube-api-access-k2h6m" (OuterVolumeSpecName: "kube-api-access-k2h6m") pod "31baea54-8625-43cc-8b9c-7c8eb0a18db3" (UID: "31baea54-8625-43cc-8b9c-7c8eb0a18db3"). InnerVolumeSpecName "kube-api-access-k2h6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:03:31.715458 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.715413    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2h6m\" (UniqueName: \"kubernetes.io/projected/31baea54-8625-43cc-8b9c-7c8eb0a18db3-kube-api-access-k2h6m\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:31.715458 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.715457    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f60563d1-7646-4661-9a1a-9490f73d2b96-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:31.715741 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.715469    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31baea54-8625-43cc-8b9c-7c8eb0a18db3-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:31.715741 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:31.715499    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sglrx\" (UniqueName: \"kubernetes.io/projected/f60563d1-7646-4661-9a1a-9490f73d2b96-kube-api-access-sglrx\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:32.042058 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.042028    2559 generic.go:356] "Generic (PLEG): container finished" podID="31baea54-8625-43cc-8b9c-7c8eb0a18db3" containerID="3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf" exitCode=0
Sep 16 05:03:32.042243 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.042075    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"
Sep 16 05:03:32.042243 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.042114    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj" event={"ID":"31baea54-8625-43cc-8b9c-7c8eb0a18db3","Type":"ContainerDied","Data":"3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf"}
Sep 16 05:03:32.042243 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.042172    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj" event={"ID":"31baea54-8625-43cc-8b9c-7c8eb0a18db3","Type":"ContainerDied","Data":"82c383214c7c17dfc04705cc4300096ad87271ba71cbc31f371caaa89e251373"}
Sep 16 05:03:32.042243 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.042200    2559 scope.go:117] "RemoveContainer" containerID="3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf"
Sep 16 05:03:32.043655 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.043632    2559 generic.go:356] "Generic (PLEG): container finished" podID="f60563d1-7646-4661-9a1a-9490f73d2b96" containerID="a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0" exitCode=0
Sep 16 05:03:32.043828 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.043657    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj" event={"ID":"f60563d1-7646-4661-9a1a-9490f73d2b96","Type":"ContainerDied","Data":"a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0"}
Sep 16 05:03:32.043828 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.043674    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"
Sep 16 05:03:32.043828 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.043709    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj" event={"ID":"f60563d1-7646-4661-9a1a-9490f73d2b96","Type":"ContainerDied","Data":"0516cc61b0e276f38640cce7a6fcbe4e5af08bea6fe2814c8d7f58772168cc5c"}
Sep 16 05:03:32.052445 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.052415    2559 scope.go:117] "RemoveContainer" containerID="3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf"
Sep 16 05:03:32.052766 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:03:32.052738    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf\": container with ID starting with 3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf not found: ID does not exist" containerID="3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf"
Sep 16 05:03:32.052879 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.052774    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf"} err="failed to get container status \"3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf\": rpc error: code = NotFound desc = could not find container \"3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf\": container with ID starting with 3bb2cafb72ac010876b106443263019d86a65598b9afa678685dd3a669357caf not found: ID does not exist"
Sep 16 05:03:32.052879 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.052790    2559 scope.go:117] "RemoveContainer" containerID="a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0"
Sep 16 05:03:32.061235 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.061210    2559 scope.go:117] "RemoveContainer" containerID="a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0"
Sep 16 05:03:32.061512 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:03:32.061471    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0\": container with ID starting with a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0 not found: ID does not exist" containerID="a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0"
Sep 16 05:03:32.061597 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.061522    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0"} err="failed to get container status \"a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0\": rpc error: code = NotFound desc = could not find container \"a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0\": container with ID starting with a7bf290eb8b86bfb561aff5c500b6915a45eb86bdeeb7288aaa565f96fa640c0 not found: ID does not exist"
Sep 16 05:03:32.066433 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.066413    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"]
Sep 16 05:03:32.070981 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.070954    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-b9f9e7ea-6c7d779dcf-69wkj"]
Sep 16 05:03:32.084259 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.084241    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"]
Sep 16 05:03:32.088687 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.088665    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-b9f9e7ea-6b67f5899d-tm5vj"]
Sep 16 05:03:32.307856 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.307764    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"]
Sep 16 05:03:32.309231 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.309195    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31baea54-8625-43cc-8b9c-7c8eb0a18db3" containerName="payload-processing"
Sep 16 05:03:32.309380 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.309368    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="31baea54-8625-43cc-8b9c-7c8eb0a18db3" containerName="payload-processing"
Sep 16 05:03:32.309503 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.309490    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35ec9481-4174-43f0-a900-61e1b193991d" containerName="revoke-keys"
Sep 16 05:03:32.309595 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.309585    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="35ec9481-4174-43f0-a900-61e1b193991d" containerName="revoke-keys"
Sep 16 05:03:32.309730 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.309719    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60563d1-7646-4661-9a1a-9490f73d2b96" containerName="payload-pre-processing"
Sep 16 05:03:32.309814 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.309804    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60563d1-7646-4661-9a1a-9490f73d2b96" containerName="payload-pre-processing"
Sep 16 05:03:32.309984 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.309972    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="35ec9481-4174-43f0-a900-61e1b193991d" containerName="revoke-keys"
Sep 16 05:03:32.310072 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.310062    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f60563d1-7646-4661-9a1a-9490f73d2b96" containerName="payload-pre-processing"
Sep 16 05:03:32.310146 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.310138    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="31baea54-8625-43cc-8b9c-7c8eb0a18db3" containerName="payload-processing"
Sep 16 05:03:32.327195 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.327164    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.328924 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.328903    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"]
Sep 16 05:03:32.330500 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.330267    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-70554e75-gw-openshift-default-dockercfg-bcc9l\""
Sep 16 05:03:32.429509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.426049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-podinfo\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.429509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.426095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4gpx\" (UniqueName: \"kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-kube-api-access-r4gpx\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.429509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.426148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-envoy\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.429509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.426204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istiod-ca-cert\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.429509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.426296    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-socket\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.429509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.426370    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-credential-socket\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.429509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.426408    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-certs\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.429509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.426462    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-token\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.429509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.426537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-data\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.527871 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.527842    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-credential-socket\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528038 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.527883    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-certs\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528038 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.527917    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-token\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528038 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.527955    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-data\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528038 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.528015    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-podinfo\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528038 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.528033    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4gpx\" (UniqueName: \"kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-kube-api-access-r4gpx\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528304 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.528054    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-envoy\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528304 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.528080    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istiod-ca-cert\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528304 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.528151    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-socket\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528304 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.528270    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-credential-socket\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528304 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.528291    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-certs\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528647 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.528618    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-data\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.528939 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.528713    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-socket\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.529127 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.529104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istiod-ca-cert\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.530518 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.530496    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-envoy\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.530646 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.530628    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-podinfo\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.536323 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.536298    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4gpx\" (UniqueName: \"kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-kube-api-access-r4gpx\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.536459 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.536441    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-token\") pod \"e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") " pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.640846 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.640755    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:32.786105 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.786065    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31baea54-8625-43cc-8b9c-7c8eb0a18db3" path="/var/lib/kubelet/pods/31baea54-8625-43cc-8b9c-7c8eb0a18db3/volumes"
Sep 16 05:03:32.786467 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.786453    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35ec9481-4174-43f0-a900-61e1b193991d" path="/var/lib/kubelet/pods/35ec9481-4174-43f0-a900-61e1b193991d/volumes"
Sep 16 05:03:32.786829 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.786815    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f60563d1-7646-4661-9a1a-9490f73d2b96" path="/var/lib/kubelet/pods/f60563d1-7646-4661-9a1a-9490f73d2b96/volumes"
Sep 16 05:03:32.924899 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.924875    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"]
Sep 16 05:03:32.927200 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:03:32.927173    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce9986c7_fc16_4f19_8ac7_c1dcee96d7cd.slice/crio-193d9cf0c8041e728df4d7af634dba773ac4d0256bcf0631ff8260eb865e9fa1 WatchSource:0}: Error finding container 193d9cf0c8041e728df4d7af634dba773ac4d0256bcf0631ff8260eb865e9fa1: Status 404 returned error can't find the container with id 193d9cf0c8041e728df4d7af634dba773ac4d0256bcf0631ff8260eb865e9fa1
Sep 16 05:03:32.929629 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.929593    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:32.929736 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.929656    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:32.929736 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:32.929684    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:33.055016 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:33.054975    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" event={"ID":"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd","Type":"ContainerStarted","Data":"f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620"}
Sep 16 05:03:33.055192 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:33.055037    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" event={"ID":"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd","Type":"ContainerStarted","Data":"193d9cf0c8041e728df4d7af634dba773ac4d0256bcf0631ff8260eb865e9fa1"}
Sep 16 05:03:33.096729 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:33.096669    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" podStartSLOduration=1.096646158 podStartE2EDuration="1.096646158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:03:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:03:33.093942165 +0000 UTC m=+866.755121341" watchObservedRunningTime="2026-09-16 05:03:33.096646158 +0000 UTC m=+866.757825335"
Sep 16 05:03:33.641333 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:33.641298    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:33.646638 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:33.646611    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:34.060465 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:34.060425    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:34.061391 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:34.061370    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:36.072596 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.072530    2559 generic.go:356] "Generic (PLEG): container finished" podID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerID="3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019" exitCode=0
Sep 16 05:03:36.073022 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.072607    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" event={"ID":"ef233360-7b34-4517-9e06-f7f3a64654ca","Type":"ContainerDied","Data":"3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019"}
Sep 16 05:03:36.073193 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.073175    2559 scope.go:117] "RemoveContainer" containerID="3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019"
Sep 16 05:03:36.074223 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.074194    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:36.074309 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.074276    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:36.074377 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.074321    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:36.812797 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.812620    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:03:36.961552 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.961158    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"]
Sep 16 05:03:36.961921 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.961899    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy"
Sep 16 05:03:36.962072 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.962058    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy"
Sep 16 05:03:36.962189 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.962178    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy"
Sep 16 05:03:36.962271 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.962262    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy"
Sep 16 05:03:36.962474 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.962462    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy"
Sep 16 05:03:36.965372 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.965355    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:03:36.968201 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.968179    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-70554e75-dockercfg-dqc48\""
Sep 16 05:03:36.968843 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.968820    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-70554e75\""
Sep 16 05:03:36.975153 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.975123    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"]
Sep 16 05:03:36.975990 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.975666    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-credential-socket\") pod \"63b43631-897f-4826-a90f-d19459db06ab\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") "
Sep 16 05:03:36.976228 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.976211    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b43631-897f-4826-a90f-d19459db06ab-istio-podinfo\") pod \"63b43631-897f-4826-a90f-d19459db06ab\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") "
Sep 16 05:03:36.976784 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.976761    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b87qj\" (UniqueName: \"kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-kube-api-access-b87qj\") pod \"63b43631-897f-4826-a90f-d19459db06ab\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") "
Sep 16 05:03:36.977116 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.977096    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-certs\") pod \"63b43631-897f-4826-a90f-d19459db06ab\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") "
Sep 16 05:03:36.977305 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.977291    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-envoy\") pod \"63b43631-897f-4826-a90f-d19459db06ab\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") "
Sep 16 05:03:36.977739 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.977683    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63b43631-897f-4826-a90f-d19459db06ab" (UID: "63b43631-897f-4826-a90f-d19459db06ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:03:36.977739 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.977713    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63b43631-897f-4826-a90f-d19459db06ab" (UID: "63b43631-897f-4826-a90f-d19459db06ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:03:36.977911 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.977766    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-data\") pod \"63b43631-897f-4826-a90f-d19459db06ab\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") "
Sep 16 05:03:36.977911 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.977828    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b43631-897f-4826-a90f-d19459db06ab-istiod-ca-cert\") pod \"63b43631-897f-4826-a90f-d19459db06ab\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") "
Sep 16 05:03:36.977911 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.977872    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-socket\") pod \"63b43631-897f-4826-a90f-d19459db06ab\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") "
Sep 16 05:03:36.977911 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.977908    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-istio-token\") pod \"63b43631-897f-4826-a90f-d19459db06ab\" (UID: \"63b43631-897f-4826-a90f-d19459db06ab\") "
Sep 16 05:03:36.978581 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.978330    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-data" (OuterVolumeSpecName: "istio-data") pod "63b43631-897f-4826-a90f-d19459db06ab" (UID: "63b43631-897f-4826-a90f-d19459db06ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:03:36.979040 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.979018    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63b43631-897f-4826-a90f-d19459db06ab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63b43631-897f-4826-a90f-d19459db06ab" (UID: "63b43631-897f-4826-a90f-d19459db06ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:03:36.979637 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.979411    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63b43631-897f-4826-a90f-d19459db06ab" (UID: "63b43631-897f-4826-a90f-d19459db06ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:03:36.979637 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.979578    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:36.979637 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.979595    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:36.979637 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.979609    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:36.979637 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.979621    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63b43631-897f-4826-a90f-d19459db06ab-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:36.979637 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.979634    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:36.982173 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:36.982145    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-kube-api-access-b87qj" (OuterVolumeSpecName: "kube-api-access-b87qj") pod "63b43631-897f-4826-a90f-d19459db06ab" (UID: "63b43631-897f-4826-a90f-d19459db06ab"). InnerVolumeSpecName "kube-api-access-b87qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:03:37.004613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.004574    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "63b43631-897f-4826-a90f-d19459db06ab" (UID: "63b43631-897f-4826-a90f-d19459db06ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:03:37.008844 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.008802    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63b43631-897f-4826-a90f-d19459db06ab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63b43631-897f-4826-a90f-d19459db06ab" (UID: "63b43631-897f-4826-a90f-d19459db06ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:03:37.017359 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.017277    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63b43631-897f-4826-a90f-d19459db06ab" (UID: "63b43631-897f-4826-a90f-d19459db06ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:03:37.080232 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.080192    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zgcm\" (UniqueName: \"kubernetes.io/projected/aee924eb-f4c2-463e-9218-02cb48be9d03-kube-api-access-4zgcm\") pod \"payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr\" (UID: \"aee924eb-f4c2-463e-9218-02cb48be9d03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:03:37.080784 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.080264    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee924eb-f4c2-463e-9218-02cb48be9d03-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr\" (UID: \"aee924eb-f4c2-463e-9218-02cb48be9d03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:03:37.080784 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.080384    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:37.080784 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.080401    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63b43631-897f-4826-a90f-d19459db06ab-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:37.080784 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.080415    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b87qj\" (UniqueName: \"kubernetes.io/projected/63b43631-897f-4826-a90f-d19459db06ab-kube-api-access-b87qj\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:37.080784 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.080428    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63b43631-897f-4826-a90f-d19459db06ab-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:03:37.081605 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.081579    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" event={"ID":"ef233360-7b34-4517-9e06-f7f3a64654ca","Type":"ContainerStarted","Data":"8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff"}
Sep 16 05:03:37.083321 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.083296    2559 generic.go:356] "Generic (PLEG): container finished" podID="63b43631-897f-4826-a90f-d19459db06ab" containerID="8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7" exitCode=0
Sep 16 05:03:37.083404 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.083354    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"
Sep 16 05:03:37.083404 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.083369    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" event={"ID":"63b43631-897f-4826-a90f-d19459db06ab","Type":"ContainerDied","Data":"8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7"}
Sep 16 05:03:37.083509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.083413    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92" event={"ID":"63b43631-897f-4826-a90f-d19459db06ab","Type":"ContainerDied","Data":"7fa360d5850b935c8fe92fde178e9ad5ffc29a967564def3bc3d1da4ce5a5191"}
Sep 16 05:03:37.083509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.083442    2559 scope.go:117] "RemoveContainer" containerID="8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7"
Sep 16 05:03:37.100299 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.099855    2559 scope.go:117] "RemoveContainer" containerID="022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6"
Sep 16 05:03:37.126459 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.126419    2559 scope.go:117] "RemoveContainer" containerID="8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7"
Sep 16 05:03:37.126840 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:03:37.126821    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7\": container with ID starting with 8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7 not found: ID does not exist" containerID="8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7"
Sep 16 05:03:37.126947 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.126929    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7"} err="failed to get container status \"8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7\": rpc error: code = NotFound desc = could not find container \"8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7\": container with ID starting with 8de7ecccca33fd45ba27c7bd12a13f9c4c4d34d5542b28edf762318bdcd921d7 not found: ID does not exist"
Sep 16 05:03:37.127016 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.127008    2559 scope.go:117] "RemoveContainer" containerID="022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6"
Sep 16 05:03:37.127232 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.127214    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"]
Sep 16 05:03:37.127337 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:03:37.127319    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6\": container with ID starting with 022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6 not found: ID does not exist" containerID="022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6"
Sep 16 05:03:37.127377 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.127355    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6"} err="failed to get container status \"022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6\": rpc error: code = NotFound desc = could not find container \"022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6\": container with ID starting with 022e530d22d46a41115132214a3bcb18408539cebbed2446e552a3326a048fc6 not found: ID does not exist"
Sep 16 05:03:37.132336 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.132313    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b9f9e7ea-openshift-default-c86fbf676-5wm92"]
Sep 16 05:03:37.181727 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.181703    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zgcm\" (UniqueName: \"kubernetes.io/projected/aee924eb-f4c2-463e-9218-02cb48be9d03-kube-api-access-4zgcm\") pod \"payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr\" (UID: \"aee924eb-f4c2-463e-9218-02cb48be9d03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:03:37.181864 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.181759    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee924eb-f4c2-463e-9218-02cb48be9d03-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr\" (UID: \"aee924eb-f4c2-463e-9218-02cb48be9d03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:03:37.182426 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.182409    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee924eb-f4c2-463e-9218-02cb48be9d03-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr\" (UID: \"aee924eb-f4c2-463e-9218-02cb48be9d03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:03:37.195124 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.195094    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zgcm\" (UniqueName: \"kubernetes.io/projected/aee924eb-f4c2-463e-9218-02cb48be9d03-kube-api-access-4zgcm\") pod \"payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr\" (UID: \"aee924eb-f4c2-463e-9218-02cb48be9d03\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:03:37.338551 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.338520    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:03:37.383382 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.383356    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:37.383699 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.383661    2559 patch_prober.go:28] interesting pod/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 05:03:37.383809 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.383729    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 05:03:37.621731 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:37.621704    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"]
Sep 16 05:03:37.623759 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:03:37.623736    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee924eb_f4c2_463e_9218_02cb48be9d03.slice/crio-2e519bd5b7e1ec5c1f10320671b44afe8a5f18f540572107bc45ceb26aae5fe4 WatchSource:0}: Error finding container 2e519bd5b7e1ec5c1f10320671b44afe8a5f18f540572107bc45ceb26aae5fe4: Status 404 returned error can't find the container with id 2e519bd5b7e1ec5c1f10320671b44afe8a5f18f540572107bc45ceb26aae5fe4
Sep 16 05:03:38.106512 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:38.097330    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr" event={"ID":"aee924eb-f4c2-463e-9218-02cb48be9d03","Type":"ContainerStarted","Data":"91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4"}
Sep 16 05:03:38.106512 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:38.097381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr" event={"ID":"aee924eb-f4c2-463e-9218-02cb48be9d03","Type":"ContainerStarted","Data":"2e519bd5b7e1ec5c1f10320671b44afe8a5f18f540572107bc45ceb26aae5fe4"}
Sep 16 05:03:38.106512 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:38.097423    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:03:38.114818 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:38.114767    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr" podStartSLOduration=2.11474747 podStartE2EDuration="2.11474747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:03:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:03:38.112728989 +0000 UTC m=+871.773908167" watchObservedRunningTime="2026-09-16 05:03:38.11474747 +0000 UTC m=+871.775926648"
Sep 16 05:03:38.383448 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:38.383364    2559 patch_prober.go:28] interesting pod/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 05:03:38.383448 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:38.383420    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 05:03:38.786254 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:38.786222    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63b43631-897f-4826-a90f-d19459db06ab" path="/var/lib/kubelet/pods/63b43631-897f-4826-a90f-d19459db06ab/volumes"
Sep 16 05:03:39.384296 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:39.384252    2559 patch_prober.go:28] interesting pod/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 05:03:39.384766 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:39.384324    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 05:03:40.384316 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:40.384280    2559 patch_prober.go:28] interesting pod/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 05:03:40.384707 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:40.384333    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 05:03:41.383793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:41.383759    2559 patch_prober.go:28] interesting pod/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 16 05:03:41.383966 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:41.383815    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 16 05:03:42.390984 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:42.390954    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:42.391646 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:42.391622    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:42.392559 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:42.392533    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:03:50.121087 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:50.121054    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:03:54.200139 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:54.200103    2559 generic.go:356] "Generic (PLEG): container finished" podID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerID="f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620" exitCode=0
Sep 16 05:03:54.200547 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:54.200176    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" event={"ID":"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd","Type":"ContainerDied","Data":"f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620"}
Sep 16 05:03:54.200596 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:54.200582    2559 scope.go:117] "RemoveContainer" containerID="f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620"
Sep 16 05:03:54.201741 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:54.201714    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:54.201804 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:54.201779    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:54.201839 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:54.201808    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:03:55.215628 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:55.215591    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" event={"ID":"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd","Type":"ContainerStarted","Data":"a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5"}
Sep 16 05:03:55.641205 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:55.641162    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:03:55.641435 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:55.641411    2559 patch_prober.go:28] interesting pod/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 16 05:03:55.641557 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:55.641468    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 16 05:03:56.641555 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:56.641520    2559 patch_prober.go:28] interesting pod/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 16 05:03:56.642007 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:56.641598    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 16 05:03:57.159029 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.158997    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"]
Sep 16 05:03:57.159627 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.159602    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="63b43631-897f-4826-a90f-d19459db06ab" containerName="istio-proxy"
Sep 16 05:03:57.161735 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.161720    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.164308 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.164281    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-12b6c6\"/\"default-dockercfg-j9d82\""
Sep 16 05:03:57.164430 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.164331    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-12b6c6\"/\"simulator-w4-12b6c6-kserve-self-signed-certs\""
Sep 16 05:03:57.164430 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.164294    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-12b6c6\"/\"openshift-service-ca.crt\""
Sep 16 05:03:57.164430 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.164391    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-12b6c6\"/\"kube-root-ca.crt\""
Sep 16 05:03:57.170112 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.170093    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"]
Sep 16 05:03:57.316641 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.316597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-model-cache\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.316853 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.316696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tmp-dir\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.316853 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.316730    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tls-certs\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.316853 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.316768    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-home\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.317032 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.316854    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9qlf\" (UniqueName: \"kubernetes.io/projected/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-kube-api-access-h9qlf\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.317032 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.316899    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-dshm\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.418098 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.418008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9qlf\" (UniqueName: \"kubernetes.io/projected/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-kube-api-access-h9qlf\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.418098 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.418075    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-dshm\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.418300 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.418126    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-model-cache\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.418300 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.418174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tmp-dir\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.418300 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.418195    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tls-certs\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.418300 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.418232    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-home\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.418685 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.418639    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-model-cache\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.418685 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.418660    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-home\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.418903 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.418811    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tmp-dir\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.420627 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.420602    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-dshm\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.420941 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.420922    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tls-certs\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.425118 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.425095    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9qlf\" (UniqueName: \"kubernetes.io/projected/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-kube-api-access-h9qlf\") pod \"simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") " pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.472598 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.472542    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:03:57.642165 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.642132    2559 patch_prober.go:28] interesting pod/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 16 05:03:57.642621 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.642205    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 16 05:03:57.770193 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:57.770140    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"]
Sep 16 05:03:57.774935 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:03:57.774879    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf7a43ff_35e2_4c4e_b77c_0404e4c38ef4.slice/crio-93da428cd600cb001969eb38eb4dd77692a86cabda1133e879cdd02bcb7d3edc WatchSource:0}: Error finding container 93da428cd600cb001969eb38eb4dd77692a86cabda1133e879cdd02bcb7d3edc: Status 404 returned error can't find the container with id 93da428cd600cb001969eb38eb4dd77692a86cabda1133e879cdd02bcb7d3edc
Sep 16 05:03:58.234556 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:58.234527    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs" event={"ID":"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4","Type":"ContainerStarted","Data":"1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298"}
Sep 16 05:03:58.234720 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:58.234566    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs" event={"ID":"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4","Type":"ContainerStarted","Data":"93da428cd600cb001969eb38eb4dd77692a86cabda1133e879cdd02bcb7d3edc"}
Sep 16 05:03:58.250926 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:58.250882    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs" podStartSLOduration=1.25086601 podStartE2EDuration="1.25086601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:03:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:03:58.247989654 +0000 UTC m=+891.909168829" watchObservedRunningTime="2026-09-16 05:03:58.25086601 +0000 UTC m=+891.912045186"
Sep 16 05:03:58.641381 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:58.641294    2559 patch_prober.go:28] interesting pod/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 16 05:03:58.641381 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:58.641350    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 16 05:03:59.477558 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:59.477523    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"]
Sep 16 05:03:59.480109 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:59.480091    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"
Sep 16 05:03:59.481685 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:59.481665    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:03:59.486905 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:59.486885    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"]
Sep 16 05:03:59.640154 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:59.640121    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6\" (UID: \"d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"
Sep 16 05:03:59.641549 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:59.641528    2559 patch_prober.go:28] interesting pod/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 16 05:03:59.641613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:59.641575    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 16 05:03:59.741716 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:59.741628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6\" (UID: \"d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"
Sep 16 05:03:59.742248 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:59.742229    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6\" (UID: \"d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"
Sep 16 05:03:59.794177 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:03:59.794140    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"
Sep 16 05:04:00.075115 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:00.075039    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"]
Sep 16 05:04:00.077354 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:04:00.077330    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c90cd4_c091_4587_8ac8_c77ae3d2d7b6.slice/crio-f71e7f397d78903276b2e07b39b4c074bac612d1060f08a94f1e3b59759ec32c WatchSource:0}: Error finding container f71e7f397d78903276b2e07b39b4c074bac612d1060f08a94f1e3b59759ec32c: Status 404 returned error can't find the container with id f71e7f397d78903276b2e07b39b4c074bac612d1060f08a94f1e3b59759ec32c
Sep 16 05:04:00.247657 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:00.247626    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6" event={"ID":"d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6","Type":"ContainerStarted","Data":"f71e7f397d78903276b2e07b39b4c074bac612d1060f08a94f1e3b59759ec32c"}
Sep 16 05:04:00.645264 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:00.645236    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:04:00.645688 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:00.645596    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:04:00.646237 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:00.646218    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:04:01.254645 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:01.254615    2559 generic.go:356] "Generic (PLEG): container finished" podID="d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6" containerID="46caa67ecdd4aea09f61bfa4aad843090c9cc9ad7c75fe722eac37bffca720c1" exitCode=0
Sep 16 05:04:01.254796 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:01.254701    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6" event={"ID":"d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6","Type":"ContainerDied","Data":"46caa67ecdd4aea09f61bfa4aad843090c9cc9ad7c75fe722eac37bffca720c1"}
Sep 16 05:04:02.401307 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:02.401279    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"
Sep 16 05:04:02.571294 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:02.571202    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6-maas-api-service-ca\") pod \"d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6\" (UID: \"d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6\") "
Sep 16 05:04:02.571574 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:02.571551    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6" (UID: "d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:04:02.672574 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:02.672544    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:03.267357 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:03.267327    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"
Sep 16 05:04:03.267537 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:03.267372    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6" event={"ID":"d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6","Type":"ContainerDied","Data":"f71e7f397d78903276b2e07b39b4c074bac612d1060f08a94f1e3b59759ec32c"}
Sep 16 05:04:03.267537 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:03.267418    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f71e7f397d78903276b2e07b39b4c074bac612d1060f08a94f1e3b59759ec32c"
Sep 16 05:04:06.341775 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.341739    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"]
Sep 16 05:04:06.342222 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.341998    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr" podUID="aee924eb-f4c2-463e-9218-02cb48be9d03" containerName="payload-pre-processing" containerID="cri-o://91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4" gracePeriod=30
Sep 16 05:04:06.491119 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.491067    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"]
Sep 16 05:04:06.493404 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.493379    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-70554e75-6v9d6"]
Sep 16 05:04:06.626219 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.626184    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"]
Sep 16 05:04:06.626448 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.626416    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy" containerID="cri-o://a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5" gracePeriod=30
Sep 16 05:04:06.642512 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.642419    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:04:06.787333 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.787304    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6" path="/var/lib/kubelet/pods/d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6/volumes"
Sep 16 05:04:06.818403 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.818378    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee924eb-f4c2-463e-9218-02cb48be9d03-plugins-config-volume\") pod \"aee924eb-f4c2-463e-9218-02cb48be9d03\" (UID: \"aee924eb-f4c2-463e-9218-02cb48be9d03\") "
Sep 16 05:04:06.818597 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.818474    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zgcm\" (UniqueName: \"kubernetes.io/projected/aee924eb-f4c2-463e-9218-02cb48be9d03-kube-api-access-4zgcm\") pod \"aee924eb-f4c2-463e-9218-02cb48be9d03\" (UID: \"aee924eb-f4c2-463e-9218-02cb48be9d03\") "
Sep 16 05:04:06.818811 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.818788    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aee924eb-f4c2-463e-9218-02cb48be9d03-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aee924eb-f4c2-463e-9218-02cb48be9d03" (UID: "aee924eb-f4c2-463e-9218-02cb48be9d03"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:04:06.818904 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.818890    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aee924eb-f4c2-463e-9218-02cb48be9d03-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:06.820536 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.820510    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aee924eb-f4c2-463e-9218-02cb48be9d03-kube-api-access-4zgcm" (OuterVolumeSpecName: "kube-api-access-4zgcm") pod "aee924eb-f4c2-463e-9218-02cb48be9d03" (UID: "aee924eb-f4c2-463e-9218-02cb48be9d03"). InnerVolumeSpecName "kube-api-access-4zgcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:04:06.919942 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:06.919907    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zgcm\" (UniqueName: \"kubernetes.io/projected/aee924eb-f4c2-463e-9218-02cb48be9d03-kube-api-access-4zgcm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:07.295201 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.295170    2559 generic.go:356] "Generic (PLEG): container finished" podID="aee924eb-f4c2-463e-9218-02cb48be9d03" containerID="91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4" exitCode=0
Sep 16 05:04:07.295386 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.295226    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"
Sep 16 05:04:07.295386 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.295245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr" event={"ID":"aee924eb-f4c2-463e-9218-02cb48be9d03","Type":"ContainerDied","Data":"91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4"}
Sep 16 05:04:07.295386 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.295298    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr" event={"ID":"aee924eb-f4c2-463e-9218-02cb48be9d03","Type":"ContainerDied","Data":"2e519bd5b7e1ec5c1f10320671b44afe8a5f18f540572107bc45ceb26aae5fe4"}
Sep 16 05:04:07.295386 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.295323    2559 scope.go:117] "RemoveContainer" containerID="91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4"
Sep 16 05:04:07.304728 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.304705    2559 scope.go:117] "RemoveContainer" containerID="91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4"
Sep 16 05:04:07.305035 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:04:07.305017    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4\": container with ID starting with 91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4 not found: ID does not exist" containerID="91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4"
Sep 16 05:04:07.305126 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.305045    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4"} err="failed to get container status \"91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4\": rpc error: code = NotFound desc = could not find container \"91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4\": container with ID starting with 91d1064ced2d4944fa514ce6e2fb45b274afe84cce600222745e29d6faf5a1c4 not found: ID does not exist"
Sep 16 05:04:07.324432 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.324352    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"]
Sep 16 05:04:07.328399 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.328355    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"]
Sep 16 05:04:07.329064 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.329045    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aee924eb-f4c2-463e-9218-02cb48be9d03" containerName="payload-pre-processing"
Sep 16 05:04:07.329158 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.329069    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aee924eb-f4c2-463e-9218-02cb48be9d03" containerName="payload-pre-processing"
Sep 16 05:04:07.329158 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.329101    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6" containerName="revoke-keys"
Sep 16 05:04:07.329158 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.329110    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6" containerName="revoke-keys"
Sep 16 05:04:07.329326 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.329206    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aee924eb-f4c2-463e-9218-02cb48be9d03" containerName="payload-pre-processing"
Sep 16 05:04:07.329326 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.329223    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7c90cd4-c091-4587-8ac8-c77ae3d2d7b6" containerName="revoke-keys"
Sep 16 05:04:07.332138 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.332111    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.334178 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.334155    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-25f3e8f3-openshift-default-dockercfg-w58nk\""
Sep 16 05:04:07.335300 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.335277    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-70554e75-c49fb4b9d-jz2rr"]
Sep 16 05:04:07.343244 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.343170    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"]
Sep 16 05:04:07.434212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.433973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-envoy\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.434212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.434019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istiod-ca-cert\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.434212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.434053    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-podinfo\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.434212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.434106    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-certs\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.434212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.434153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdt8s\" (UniqueName: \"kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-kube-api-access-hdt8s\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.434212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.434184    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-data\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.434712 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.434247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-socket\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.434712 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.434291    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-token\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.434712 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.434334    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-credential-socket\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.472891 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.472848    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:04:07.473082 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.472915    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:04:07.484774 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.484754    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:04:07.535994 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.535962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-envoy\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.535994 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.535990    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istiod-ca-cert\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.536212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.536009    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-podinfo\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.536212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.536037    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-certs\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.536212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.536073    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdt8s\" (UniqueName: \"kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-kube-api-access-hdt8s\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.536212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.536101    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-data\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.536212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.536170    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-socket\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.536447 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.536208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-token\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.536447 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.536263    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-credential-socket\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.536551 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.536437    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-certs\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.536551 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.536450    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-data\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.536681 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.536661    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-socket\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.536744 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.536714    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-credential-socket\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.537078 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.537057    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istiod-ca-cert\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.538626 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.538609    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-envoy\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.538877 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.538859    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-podinfo\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.543160 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.543138    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-token\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.543292 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.543276    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdt8s\" (UniqueName: \"kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-kube-api-access-hdt8s\") pod \"e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") " pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.645600 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.645509    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:07.924529 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.924503    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"]
Sep 16 05:04:07.926163 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:04:07.926133    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33f887cc_7148_47f5_bf7d_7bcf709ba54e.slice/crio-72819c0e2ee5a24a4fed699b035dbb6dba20d676bce3ccc823475138060617b4 WatchSource:0}: Error finding container 72819c0e2ee5a24a4fed699b035dbb6dba20d676bce3ccc823475138060617b4: Status 404 returned error can't find the container with id 72819c0e2ee5a24a4fed699b035dbb6dba20d676bce3ccc823475138060617b4
Sep 16 05:04:07.928585 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.928549    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:04:07.928688 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.928628    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:04:07.928688 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:07.928674    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:04:08.303801 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:08.303763    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" event={"ID":"33f887cc-7148-47f5-bf7d-7bcf709ba54e","Type":"ContainerStarted","Data":"a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c"}
Sep 16 05:04:08.303965 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:08.303864    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" event={"ID":"33f887cc-7148-47f5-bf7d-7bcf709ba54e","Type":"ContainerStarted","Data":"72819c0e2ee5a24a4fed699b035dbb6dba20d676bce3ccc823475138060617b4"}
Sep 16 05:04:08.319440 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:08.319400    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:04:08.325654 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:08.325603    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" podStartSLOduration=1.325587637 podStartE2EDuration="1.325587637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:04:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:04:08.323037757 +0000 UTC m=+901.984216933" watchObservedRunningTime="2026-09-16 05:04:08.325587637 +0000 UTC m=+901.986766814"
Sep 16 05:04:08.646320 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:08.646229    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:08.652428 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:08.652401    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:08.785604 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:08.785572    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aee924eb-f4c2-463e-9218-02cb48be9d03" path="/var/lib/kubelet/pods/aee924eb-f4c2-463e-9218-02cb48be9d03/volumes"
Sep 16 05:04:09.309589 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:09.309553    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:09.310417 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:09.310396    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:11.884783 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.884760    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:04:11.981409 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.981376    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istiod-ca-cert\") pod \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") "
Sep 16 05:04:11.981575 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.981429    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4gpx\" (UniqueName: \"kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-kube-api-access-r4gpx\") pod \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") "
Sep 16 05:04:11.981575 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.981461    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-socket\") pod \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") "
Sep 16 05:04:11.981575 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.981511    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-token\") pod \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") "
Sep 16 05:04:11.981575 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.981532    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-credential-socket\") pod \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") "
Sep 16 05:04:11.981812 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.981719    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" (UID: "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:04:11.981812 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.981763    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-certs\") pod \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") "
Sep 16 05:04:11.981921 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.981823    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-envoy\") pod \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") "
Sep 16 05:04:11.981921 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.981885    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-podinfo\") pod \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") "
Sep 16 05:04:11.981921 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.981916    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-data\") pod \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\" (UID: \"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd\") "
Sep 16 05:04:11.982061 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.981959    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" (UID: "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:04:11.982061 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.982022    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" (UID: "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:04:11.982320 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.982155    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" (UID: "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:04:11.983001 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.982601    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:11.983122 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.983028    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:11.983122 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.983047    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:11.983122 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.982182    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" (UID: "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:04:11.983953 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.983927    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-kube-api-access-r4gpx" (OuterVolumeSpecName: "kube-api-access-r4gpx") pod "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" (UID: "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd"). InnerVolumeSpecName "kube-api-access-r4gpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:04:11.984130 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.984110    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" (UID: "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:04:11.984271 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.984250    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" (UID: "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:04:11.984316 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:11.984301    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" (UID: "ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:04:12.084323 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.084282    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:12.084323 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.084322    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:12.084556 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.084335    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:12.084556 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.084348    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4gpx\" (UniqueName: \"kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-kube-api-access-r4gpx\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:12.084556 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.084364    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:12.084556 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.084380    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:12.136250 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.136216    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"]
Sep 16 05:04:12.136683 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.136670    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy"
Sep 16 05:04:12.136723 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.136685    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy"
Sep 16 05:04:12.136723 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.136695    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy"
Sep 16 05:04:12.136723 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.136700    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy"
Sep 16 05:04:12.136826 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.136760    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy"
Sep 16 05:04:12.139020 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.139005    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:12.141105 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.141084    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-25f3e8f3\""
Sep 16 05:04:12.141184 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.141121    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-25f3e8f3-dockercfg-nwd7z\""
Sep 16 05:04:12.153245 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.153205    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"]
Sep 16 05:04:12.185193 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.185156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-plugins-config-volume\") pod \"payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p\" (UID: \"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801\") " pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:12.185348 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.185204    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-842dx\" (UniqueName: \"kubernetes.io/projected/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-kube-api-access-842dx\") pod \"payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p\" (UID: \"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801\") " pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:12.286412 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.286316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-plugins-config-volume\") pod \"payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p\" (UID: \"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801\") " pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:12.286412 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.286368    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-842dx\" (UniqueName: \"kubernetes.io/projected/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-kube-api-access-842dx\") pod \"payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p\" (UID: \"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801\") " pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:12.287038 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.287015    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-plugins-config-volume\") pod \"payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p\" (UID: \"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801\") " pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:12.294204 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.294180    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-842dx\" (UniqueName: \"kubernetes.io/projected/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-kube-api-access-842dx\") pod \"payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p\" (UID: \"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801\") " pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:12.327792 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.327760    2559 generic.go:356] "Generic (PLEG): container finished" podID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerID="a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5" exitCode=0
Sep 16 05:04:12.327886 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.327806    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" event={"ID":"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd","Type":"ContainerDied","Data":"a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5"}
Sep 16 05:04:12.327886 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.327858    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5" event={"ID":"ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd","Type":"ContainerDied","Data":"193d9cf0c8041e728df4d7af634dba773ac4d0256bcf0631ff8260eb865e9fa1"}
Sep 16 05:04:12.327886 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.327879    2559 scope.go:117] "RemoveContainer" containerID="a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5"
Sep 16 05:04:12.327997 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.327820    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"
Sep 16 05:04:12.337527 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.337510    2559 scope.go:117] "RemoveContainer" containerID="f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620"
Sep 16 05:04:12.346041 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.346025    2559 scope.go:117] "RemoveContainer" containerID="a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5"
Sep 16 05:04:12.346290 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:04:12.346271    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5\": container with ID starting with a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5 not found: ID does not exist" containerID="a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5"
Sep 16 05:04:12.346357 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.346302    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5"} err="failed to get container status \"a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5\": rpc error: code = NotFound desc = could not find container \"a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5\": container with ID starting with a89f10bbbc95a3845ebd66c83a05f6ba11bcc8b04162a94f5cdb346da447d7d5 not found: ID does not exist"
Sep 16 05:04:12.346357 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.346324    2559 scope.go:117] "RemoveContainer" containerID="f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620"
Sep 16 05:04:12.346781 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:04:12.346687    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620\": container with ID starting with f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620 not found: ID does not exist" containerID="f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620"
Sep 16 05:04:12.346781 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.346740    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620"} err="failed to get container status \"f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620\": rpc error: code = NotFound desc = could not find container \"f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620\": container with ID starting with f0b13b1cfac19514eeaed91a2db5907b94946d8f8f88a2c3b3a1085e2ccea620 not found: ID does not exist"
Sep 16 05:04:12.349328 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.349312    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"]
Sep 16 05:04:12.354977 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.354958    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-70554e75-gw-openshift-default-687789fd4d-qblr5"]
Sep 16 05:04:12.453606 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.453582    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:12.726544 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.726523    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"]
Sep 16 05:04:12.728195 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:04:12.728165    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d43d2a9_ae7d_4dce_b2b4_1e56a3567801.slice/crio-bb84d3862ec7667479764549c11a9125e7c82348a2d0c1819f9dda4f41103d83 WatchSource:0}: Error finding container bb84d3862ec7667479764549c11a9125e7c82348a2d0c1819f9dda4f41103d83: Status 404 returned error can't find the container with id bb84d3862ec7667479764549c11a9125e7c82348a2d0c1819f9dda4f41103d83
Sep 16 05:04:12.787265 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:12.787236    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" path="/var/lib/kubelet/pods/ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd/volumes"
Sep 16 05:04:13.336112 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:13.336074    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p" event={"ID":"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801","Type":"ContainerStarted","Data":"560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49"}
Sep 16 05:04:13.336664 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:13.336159    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:13.336664 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:13.336177    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p" event={"ID":"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801","Type":"ContainerStarted","Data":"bb84d3862ec7667479764549c11a9125e7c82348a2d0c1819f9dda4f41103d83"}
Sep 16 05:04:13.351420 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:13.351368    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p" podStartSLOduration=1.35134741 podStartE2EDuration="1.35134741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:04:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:04:13.349541955 +0000 UTC m=+907.010721132" watchObservedRunningTime="2026-09-16 05:04:13.35134741 +0000 UTC m=+907.012526589"
Sep 16 05:04:24.346034 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:24.345999    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:31.455489 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:31.455456    2559 generic.go:356] "Generic (PLEG): container finished" podID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerID="a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c" exitCode=0
Sep 16 05:04:31.455888 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:31.455515    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" event={"ID":"33f887cc-7148-47f5-bf7d-7bcf709ba54e","Type":"ContainerDied","Data":"a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c"}
Sep 16 05:04:31.455933 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:31.455906    2559 scope.go:117] "RemoveContainer" containerID="a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c"
Sep 16 05:04:31.457005 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:31.456975    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:04:31.457061 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:31.457043    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:04:31.457095 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:31.457074    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:04:32.467595 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:32.467550    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" event={"ID":"33f887cc-7148-47f5-bf7d-7bcf709ba54e","Type":"ContainerStarted","Data":"9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc"}
Sep 16 05:04:32.646372 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:32.646340    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:32.646602 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:32.646580    2559 patch_prober.go:28] interesting pod/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 16 05:04:32.646653 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:32.646628    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 16 05:04:33.646052 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:33.646018    2559 patch_prober.go:28] interesting pod/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 16 05:04:33.646399 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:33.646071    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 16 05:04:34.646399 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:34.646362    2559 patch_prober.go:28] interesting pod/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 16 05:04:34.646804 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:34.646426    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 16 05:04:35.367321 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.367275    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"]
Sep 16 05:04:35.367835 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.367820    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce9986c7-fc16-4f19-8ac7-c1dcee96d7cd" containerName="istio-proxy"
Sep 16 05:04:35.370851 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.370837    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"
Sep 16 05:04:35.372588 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.372566    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:04:35.378197 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.378174    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"]
Sep 16 05:04:35.531771 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.531739    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf5d4b7-7beb-40e3-9970-e4773c34e124-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht\" (UID: \"9cf5d4b7-7beb-40e3-9970-e4773c34e124\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"
Sep 16 05:04:35.632968 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.632887    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf5d4b7-7beb-40e3-9970-e4773c34e124-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht\" (UID: \"9cf5d4b7-7beb-40e3-9970-e4773c34e124\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"
Sep 16 05:04:35.633562 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.633542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf5d4b7-7beb-40e3-9970-e4773c34e124-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht\" (UID: \"9cf5d4b7-7beb-40e3-9970-e4773c34e124\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"
Sep 16 05:04:35.646877 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.646845    2559 patch_prober.go:28] interesting pod/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 16 05:04:35.647182 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.646898    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 16 05:04:35.683399 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.683370    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"
Sep 16 05:04:35.974151 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:35.974126    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"]
Sep 16 05:04:35.976350 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:04:35.976323    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf5d4b7_7beb_40e3_9970_e4773c34e124.slice/crio-3812b6884e70752117cfe2a37a20cee859becf6f4d06e620d8d778c4c6edfde5 WatchSource:0}: Error finding container 3812b6884e70752117cfe2a37a20cee859becf6f4d06e620d8d778c4c6edfde5: Status 404 returned error can't find the container with id 3812b6884e70752117cfe2a37a20cee859becf6f4d06e620d8d778c4c6edfde5
Sep 16 05:04:36.501338 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:36.501296    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht" event={"ID":"9cf5d4b7-7beb-40e3-9970-e4773c34e124","Type":"ContainerStarted","Data":"dce876802168c78217c61d452072226008ddc66c2544e22cb5088ce3d033f386"}
Sep 16 05:04:36.501536 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:36.501365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht" event={"ID":"9cf5d4b7-7beb-40e3-9970-e4773c34e124","Type":"ContainerStarted","Data":"3812b6884e70752117cfe2a37a20cee859becf6f4d06e620d8d778c4c6edfde5"}
Sep 16 05:04:36.519017 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:36.518973    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht" podStartSLOduration=1.5189580070000002 podStartE2EDuration="1.518958007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:04:36.518452891 +0000 UTC m=+930.179632072" watchObservedRunningTime="2026-09-16 05:04:36.518958007 +0000 UTC m=+930.180137184"
Sep 16 05:04:36.646769 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:36.646741    2559 patch_prober.go:28] interesting pod/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 16 05:04:36.646933 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:36.646792    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 16 05:04:37.512672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:37.512631    2559 generic.go:356] "Generic (PLEG): container finished" podID="9cf5d4b7-7beb-40e3-9970-e4773c34e124" containerID="dce876802168c78217c61d452072226008ddc66c2544e22cb5088ce3d033f386" exitCode=0
Sep 16 05:04:37.512873 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:37.512811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht" event={"ID":"9cf5d4b7-7beb-40e3-9970-e4773c34e124","Type":"ContainerDied","Data":"dce876802168c78217c61d452072226008ddc66c2544e22cb5088ce3d033f386"}
Sep 16 05:04:37.646202 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:37.646154    2559 patch_prober.go:28] interesting pod/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 16 05:04:37.646360 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:37.646225    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 16 05:04:38.650288 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:38.650263    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:38.650659 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:38.650642    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:38.651335 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:38.651312    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:38.653212 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:38.653194    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"
Sep 16 05:04:38.763952 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:38.763920    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf5d4b7-7beb-40e3-9970-e4773c34e124-maas-api-service-ca\") pod \"9cf5d4b7-7beb-40e3-9970-e4773c34e124\" (UID: \"9cf5d4b7-7beb-40e3-9970-e4773c34e124\") "
Sep 16 05:04:38.764318 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:38.764284    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf5d4b7-7beb-40e3-9970-e4773c34e124-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9cf5d4b7-7beb-40e3-9970-e4773c34e124" (UID: "9cf5d4b7-7beb-40e3-9970-e4773c34e124"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:04:38.764513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:38.764371    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf5d4b7-7beb-40e3-9970-e4773c34e124-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:39.525533 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:39.525502    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"
Sep 16 05:04:39.525700 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:39.525504    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht" event={"ID":"9cf5d4b7-7beb-40e3-9970-e4773c34e124","Type":"ContainerDied","Data":"3812b6884e70752117cfe2a37a20cee859becf6f4d06e620d8d778c4c6edfde5"}
Sep 16 05:04:39.525700 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:39.525621    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3812b6884e70752117cfe2a37a20cee859becf6f4d06e620d8d778c4c6edfde5"
Sep 16 05:04:40.979466 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:40.979428    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"]
Sep 16 05:04:40.979937 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:40.979638    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p" podUID="4d43d2a9-ae7d-4dce-b2b4-1e56a3567801" containerName="payload-processing" containerID="cri-o://560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49" gracePeriod=30
Sep 16 05:04:41.143937 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.143904    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"]
Sep 16 05:04:41.146882 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.146858    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-25f3e8f3-t7sht"]
Sep 16 05:04:41.254327 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.254259    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:41.290574 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.290546    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-842dx\" (UniqueName: \"kubernetes.io/projected/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-kube-api-access-842dx\") pod \"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801\" (UID: \"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801\") "
Sep 16 05:04:41.290758 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.290606    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-plugins-config-volume\") pod \"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801\" (UID: \"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801\") "
Sep 16 05:04:41.290997 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.290975    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d43d2a9-ae7d-4dce-b2b4-1e56a3567801" (UID: "4d43d2a9-ae7d-4dce-b2b4-1e56a3567801"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:04:41.292797 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.292771    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-kube-api-access-842dx" (OuterVolumeSpecName: "kube-api-access-842dx") pod "4d43d2a9-ae7d-4dce-b2b4-1e56a3567801" (UID: "4d43d2a9-ae7d-4dce-b2b4-1e56a3567801"). InnerVolumeSpecName "kube-api-access-842dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:04:41.392221 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.392182    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-842dx\" (UniqueName: \"kubernetes.io/projected/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-kube-api-access-842dx\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:41.392221 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.392208    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:41.538412 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.538277    2559 generic.go:356] "Generic (PLEG): container finished" podID="4d43d2a9-ae7d-4dce-b2b4-1e56a3567801" containerID="560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49" exitCode=0
Sep 16 05:04:41.538412 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.538325    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"
Sep 16 05:04:41.538671 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.538342    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p" event={"ID":"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801","Type":"ContainerDied","Data":"560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49"}
Sep 16 05:04:41.538671 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.538591    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p" event={"ID":"4d43d2a9-ae7d-4dce-b2b4-1e56a3567801","Type":"ContainerDied","Data":"bb84d3862ec7667479764549c11a9125e7c82348a2d0c1819f9dda4f41103d83"}
Sep 16 05:04:41.538671 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.538629    2559 scope.go:117] "RemoveContainer" containerID="560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49"
Sep 16 05:04:41.548108 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.548086    2559 scope.go:117] "RemoveContainer" containerID="560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49"
Sep 16 05:04:41.548369 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:04:41.548351    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49\": container with ID starting with 560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49 not found: ID does not exist" containerID="560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49"
Sep 16 05:04:41.548417 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.548378    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49"} err="failed to get container status \"560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49\": rpc error: code = NotFound desc = could not find container \"560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49\": container with ID starting with 560e17cefc4da6d6867b43dfc2e14160afc30950388cc5787e7b9d509a46ca49 not found: ID does not exist"
Sep 16 05:04:41.560159 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.560141    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"]
Sep 16 05:04:41.562188 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:41.562167    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-25f3e8f3-7c5d47767f-s2g2p"]
Sep 16 05:04:42.194670 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.194621    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"]
Sep 16 05:04:42.195121 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.194872    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy" containerID="cri-o://9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc" gracePeriod=30
Sep 16 05:04:42.785733 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.785702    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d43d2a9-ae7d-4dce-b2b4-1e56a3567801" path="/var/lib/kubelet/pods/4d43d2a9-ae7d-4dce-b2b4-1e56a3567801/volumes"
Sep 16 05:04:42.786034 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.786017    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cf5d4b7-7beb-40e3-9970-e4773c34e124" path="/var/lib/kubelet/pods/9cf5d4b7-7beb-40e3-9970-e4773c34e124/volumes"
Sep 16 05:04:42.920748 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.920715    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"]
Sep 16 05:04:42.921436 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.921276    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf5d4b7-7beb-40e3-9970-e4773c34e124" containerName="revoke-keys"
Sep 16 05:04:42.921436 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.921326    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf5d4b7-7beb-40e3-9970-e4773c34e124" containerName="revoke-keys"
Sep 16 05:04:42.921436 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.921355    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d43d2a9-ae7d-4dce-b2b4-1e56a3567801" containerName="payload-processing"
Sep 16 05:04:42.921436 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.921365    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d43d2a9-ae7d-4dce-b2b4-1e56a3567801" containerName="payload-processing"
Sep 16 05:04:42.921780 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.921538    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf5d4b7-7beb-40e3-9970-e4773c34e124" containerName="revoke-keys"
Sep 16 05:04:42.921780 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.921560    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d43d2a9-ae7d-4dce-b2b4-1e56a3567801" containerName="payload-processing"
Sep 16 05:04:42.926512 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.926452    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:42.928286 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.928261    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c9c153e4-openshift-default-dockercfg-w7prq\""
Sep 16 05:04:42.938570 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:42.938551    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"]
Sep 16 05:04:43.012237 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.012207    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-data\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.012354 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.012278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-podinfo\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.012354 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.012313    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-token\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.012354 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.012340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-certs\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.012556 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.012377    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-envoy\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.012556 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.012424    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-credential-socket\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.012556 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.012526    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-socket\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.012665 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.012557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mtwx\" (UniqueName: \"kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-kube-api-access-7mtwx\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.012665 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.012589    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istiod-ca-cert\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114194 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114115    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-credential-socket\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114373 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114202    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-socket\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114373 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114236    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mtwx\" (UniqueName: \"kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-kube-api-access-7mtwx\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114373 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114272    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istiod-ca-cert\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114373 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114340    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-data\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114649 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114393    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-podinfo\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114649 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114627    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-token\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114755 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114671    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-socket\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114755 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114676    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-certs\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114755 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-data\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114755 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114742    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-envoy\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.114946 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114855    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-credential-socket\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.115007 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.114937    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-certs\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.115156 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.115130    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istiod-ca-cert\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.116995 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.116976    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-envoy\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.117251 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.117233    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-podinfo\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.121910 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.121883    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-token\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.122000 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.121888    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mtwx\" (UniqueName: \"kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-kube-api-access-7mtwx\") pod \"e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") " pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.237693 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.237659    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:43.516886 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.516859    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"]
Sep 16 05:04:43.519039 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:04:43.519007    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0df0ab8_cd4c_4992_b5b9_cdaaaeed5c31.slice/crio-f0dbc178f0e04826a9a452bd8a6ad8e87288847ec97984265579c85e385f2bcb WatchSource:0}: Error finding container f0dbc178f0e04826a9a452bd8a6ad8e87288847ec97984265579c85e385f2bcb: Status 404 returned error can't find the container with id f0dbc178f0e04826a9a452bd8a6ad8e87288847ec97984265579c85e385f2bcb
Sep 16 05:04:43.521261 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.521229    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:04:43.521357 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.521290    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:04:43.521357 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.521318    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:04:43.550533 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:43.550502    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" event={"ID":"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31","Type":"ContainerStarted","Data":"f0dbc178f0e04826a9a452bd8a6ad8e87288847ec97984265579c85e385f2bcb"}
Sep 16 05:04:44.558389 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:44.558339    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" event={"ID":"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31","Type":"ContainerStarted","Data":"ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076"}
Sep 16 05:04:44.579080 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:44.579032    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" podStartSLOduration=2.579019427 podStartE2EDuration="2.579019427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:04:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:04:44.577520972 +0000 UTC m=+938.238700146" watchObservedRunningTime="2026-09-16 05:04:44.579019427 +0000 UTC m=+938.240198603"
Sep 16 05:04:45.238388 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:45.238358    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:45.243443 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:45.243417    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:45.564278 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:45.564208    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:45.565026 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:45.565009    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:04:47.452731 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.452702    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:47.556715 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.556682    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istiod-ca-cert\") pod \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") "
Sep 16 05:04:47.556903 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.556732    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-token\") pod \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") "
Sep 16 05:04:47.556903 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.556766    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-credential-socket\") pod \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") "
Sep 16 05:04:47.556903 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.556793    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdt8s\" (UniqueName: \"kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-kube-api-access-hdt8s\") pod \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") "
Sep 16 05:04:47.556903 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.556819    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-data\") pod \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") "
Sep 16 05:04:47.556903 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.556861    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-certs\") pod \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") "
Sep 16 05:04:47.557161 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557069    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "33f887cc-7148-47f5-bf7d-7bcf709ba54e" (UID: "33f887cc-7148-47f5-bf7d-7bcf709ba54e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:04:47.557161 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557125    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "33f887cc-7148-47f5-bf7d-7bcf709ba54e" (UID: "33f887cc-7148-47f5-bf7d-7bcf709ba54e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:04:47.557161 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557139    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "33f887cc-7148-47f5-bf7d-7bcf709ba54e" (UID: "33f887cc-7148-47f5-bf7d-7bcf709ba54e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:04:47.557161 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557146    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-envoy\") pod \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") "
Sep 16 05:04:47.557334 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557230    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-socket\") pod \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") "
Sep 16 05:04:47.557334 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557280    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-podinfo\") pod \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\" (UID: \"33f887cc-7148-47f5-bf7d-7bcf709ba54e\") "
Sep 16 05:04:47.557334 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557226    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-data" (OuterVolumeSpecName: "istio-data") pod "33f887cc-7148-47f5-bf7d-7bcf709ba54e" (UID: "33f887cc-7148-47f5-bf7d-7bcf709ba54e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:04:47.557505 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557414    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "33f887cc-7148-47f5-bf7d-7bcf709ba54e" (UID: "33f887cc-7148-47f5-bf7d-7bcf709ba54e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:04:47.557889 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557858    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:47.558012 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557892    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:47.558012 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557907    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:47.558012 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557920    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:47.558012 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.557933    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:47.559140 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.559114    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-kube-api-access-hdt8s" (OuterVolumeSpecName: "kube-api-access-hdt8s") pod "33f887cc-7148-47f5-bf7d-7bcf709ba54e" (UID: "33f887cc-7148-47f5-bf7d-7bcf709ba54e"). InnerVolumeSpecName "kube-api-access-hdt8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:04:47.559276 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.559258    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "33f887cc-7148-47f5-bf7d-7bcf709ba54e" (UID: "33f887cc-7148-47f5-bf7d-7bcf709ba54e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:04:47.559593 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.559573    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "33f887cc-7148-47f5-bf7d-7bcf709ba54e" (UID: "33f887cc-7148-47f5-bf7d-7bcf709ba54e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:04:47.559593 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.559579    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-token" (OuterVolumeSpecName: "istio-token") pod "33f887cc-7148-47f5-bf7d-7bcf709ba54e" (UID: "33f887cc-7148-47f5-bf7d-7bcf709ba54e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:04:47.581032 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.581005    2559 generic.go:356] "Generic (PLEG): container finished" podID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerID="9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc" exitCode=0
Sep 16 05:04:47.581118 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.581064    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"
Sep 16 05:04:47.581118 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.581090    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" event={"ID":"33f887cc-7148-47f5-bf7d-7bcf709ba54e","Type":"ContainerDied","Data":"9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc"}
Sep 16 05:04:47.581224 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.581139    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5" event={"ID":"33f887cc-7148-47f5-bf7d-7bcf709ba54e","Type":"ContainerDied","Data":"72819c0e2ee5a24a4fed699b035dbb6dba20d676bce3ccc823475138060617b4"}
Sep 16 05:04:47.581224 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.581153    2559 scope.go:117] "RemoveContainer" containerID="9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc"
Sep 16 05:04:47.592435 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.592412    2559 scope.go:117] "RemoveContainer" containerID="a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c"
Sep 16 05:04:47.602560 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.602525    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"]
Sep 16 05:04:47.603076 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.602995    2559 scope.go:117] "RemoveContainer" containerID="9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc"
Sep 16 05:04:47.604065 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:04:47.603944    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc\": container with ID starting with 9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc not found: ID does not exist" containerID="9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc"
Sep 16 05:04:47.604065 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.603977    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc"} err="failed to get container status \"9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc\": rpc error: code = NotFound desc = could not find container \"9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc\": container with ID starting with 9c1b4446667619e06ed1a435bb47a809fa573559cb585e2e1eee7b26c4b66bcc not found: ID does not exist"
Sep 16 05:04:47.604065 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.604001    2559 scope.go:117] "RemoveContainer" containerID="a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c"
Sep 16 05:04:47.606521 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.606178    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-25f3e8f3-openshift-default-b9d6fdf56-qjwd5"]
Sep 16 05:04:47.607770 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:04:47.607742    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c\": container with ID starting with a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c not found: ID does not exist" containerID="a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c"
Sep 16 05:04:47.607867 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.607778    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c"} err="failed to get container status \"a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c\": rpc error: code = NotFound desc = could not find container \"a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c\": container with ID starting with a846f233370f906b1389a8baa79883b36a8028660b2ec0e54f6c41b110921a4c not found: ID does not exist"
Sep 16 05:04:47.658815 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.658783    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:47.658815 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.658813    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdt8s\" (UniqueName: \"kubernetes.io/projected/33f887cc-7148-47f5-bf7d-7bcf709ba54e-kube-api-access-hdt8s\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:47.659030 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.658828    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:47.659030 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:47.658840    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33f887cc-7148-47f5-bf7d-7bcf709ba54e-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:04:48.786537 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:48.786506    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" path="/var/lib/kubelet/pods/33f887cc-7148-47f5-bf7d-7bcf709ba54e/volumes"
Sep 16 05:04:50.564857 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.564823    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"]
Sep 16 05:04:50.565276 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.565263    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy"
Sep 16 05:04:50.565317 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.565277    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy"
Sep 16 05:04:50.565361 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.565354    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy"
Sep 16 05:04:50.569958 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.569942    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:04:50.571948 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.571928    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-c9c153e4-dockercfg-fgwsh\""
Sep 16 05:04:50.572067 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.571972    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-c9c153e4\""
Sep 16 05:04:50.580368 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.580334    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"]
Sep 16 05:04:50.688783 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.688745    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd8vz\" (UniqueName: \"kubernetes.io/projected/b146cc33-39c8-4ad5-815f-b8335f6a119f-kube-api-access-pd8vz\") pod \"payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h\" (UID: \"b146cc33-39c8-4ad5-815f-b8335f6a119f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:04:50.688954 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.688922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b146cc33-39c8-4ad5-815f-b8335f6a119f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h\" (UID: \"b146cc33-39c8-4ad5-815f-b8335f6a119f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:04:50.789750 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.789717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b146cc33-39c8-4ad5-815f-b8335f6a119f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h\" (UID: \"b146cc33-39c8-4ad5-815f-b8335f6a119f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:04:50.789923 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.789779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd8vz\" (UniqueName: \"kubernetes.io/projected/b146cc33-39c8-4ad5-815f-b8335f6a119f-kube-api-access-pd8vz\") pod \"payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h\" (UID: \"b146cc33-39c8-4ad5-815f-b8335f6a119f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:04:50.790462 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.790436    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b146cc33-39c8-4ad5-815f-b8335f6a119f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h\" (UID: \"b146cc33-39c8-4ad5-815f-b8335f6a119f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:04:50.798114 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.798084    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd8vz\" (UniqueName: \"kubernetes.io/projected/b146cc33-39c8-4ad5-815f-b8335f6a119f-kube-api-access-pd8vz\") pod \"payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h\" (UID: \"b146cc33-39c8-4ad5-815f-b8335f6a119f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:04:50.885943 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:50.885870    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:04:51.176311 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:51.176285    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"]
Sep 16 05:04:51.178570 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:04:51.178541    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb146cc33_39c8_4ad5_815f_b8335f6a119f.slice/crio-6fec2e5407f47d0fbf53a26f60b539d5c07d81b462eb8a288ba99534a3244e92 WatchSource:0}: Error finding container 6fec2e5407f47d0fbf53a26f60b539d5c07d81b462eb8a288ba99534a3244e92: Status 404 returned error can't find the container with id 6fec2e5407f47d0fbf53a26f60b539d5c07d81b462eb8a288ba99534a3244e92
Sep 16 05:04:51.610084 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:51.610052    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h" event={"ID":"b146cc33-39c8-4ad5-815f-b8335f6a119f","Type":"ContainerStarted","Data":"30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5"}
Sep 16 05:04:51.610472 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:51.610112    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h" event={"ID":"b146cc33-39c8-4ad5-815f-b8335f6a119f","Type":"ContainerStarted","Data":"6fec2e5407f47d0fbf53a26f60b539d5c07d81b462eb8a288ba99534a3244e92"}
Sep 16 05:04:51.610472 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:51.610138    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:04:51.626774 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:04:51.626721    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h" podStartSLOduration=1.626701453 podStartE2EDuration="1.626701453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:04:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:04:51.624367438 +0000 UTC m=+945.285546616" watchObservedRunningTime="2026-09-16 05:04:51.626701453 +0000 UTC m=+945.287880632"
Sep 16 05:05:02.618597 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:02.618563    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:05:07.703427 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:07.703394    2559 generic.go:356] "Generic (PLEG): container finished" podID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerID="ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076" exitCode=0
Sep 16 05:05:07.703888 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:07.703461    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" event={"ID":"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31","Type":"ContainerDied","Data":"ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076"}
Sep 16 05:05:07.703888 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:07.703869    2559 scope.go:117] "RemoveContainer" containerID="ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076"
Sep 16 05:05:07.705013 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:07.704981    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:05:07.705130 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:07.705060    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:05:07.705130 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:07.705103    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:05:08.714931 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:08.714886    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" event={"ID":"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31","Type":"ContainerStarted","Data":"020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3"}
Sep 16 05:05:09.238430 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:09.238396    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:05:09.238628 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:09.238606    2559 patch_prober.go:28] interesting pod/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 16 05:05:09.238682 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:09.238662    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 16 05:05:10.238800 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:10.238764    2559 patch_prober.go:28] interesting pod/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 16 05:05:10.239229 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:10.238835    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 16 05:05:11.238015 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:11.237982    2559 patch_prober.go:28] interesting pod/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 16 05:05:11.238182 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:11.238036    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 16 05:05:12.238827 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:12.238790    2559 patch_prober.go:28] interesting pod/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 16 05:05:12.239198 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:12.238844    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 16 05:05:13.239067 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:13.239031    2559 patch_prober.go:28] interesting pod/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 16 05:05:13.239440 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:13.239086    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 16 05:05:14.242186 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:14.242157    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:05:14.242579 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:14.242413    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:05:14.243118 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:14.243099    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:05:15.825511 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:15.825468    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"]
Sep 16 05:05:15.825925 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:15.825913    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy"
Sep 16 05:05:15.825972 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:15.825926    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy"
Sep 16 05:05:15.826010 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:15.826006    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="33f887cc-7148-47f5-bf7d-7bcf709ba54e" containerName="istio-proxy"
Sep 16 05:05:15.828153 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:15.828138    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"
Sep 16 05:05:15.829869 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:15.829853    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:05:15.834977 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:15.834947    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"]
Sep 16 05:05:15.945042 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:15.945009    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9257f3c0-56ca-4e38-b277-065ddcae876a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf\" (UID: \"9257f3c0-56ca-4e38-b277-065ddcae876a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"
Sep 16 05:05:16.046825 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:16.046792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9257f3c0-56ca-4e38-b277-065ddcae876a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf\" (UID: \"9257f3c0-56ca-4e38-b277-065ddcae876a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"
Sep 16 05:05:16.047410 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:16.047392    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9257f3c0-56ca-4e38-b277-065ddcae876a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf\" (UID: \"9257f3c0-56ca-4e38-b277-065ddcae876a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"
Sep 16 05:05:16.140522 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:16.140429    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"
Sep 16 05:05:16.409655 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:16.409628    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"]
Sep 16 05:05:16.412042 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:05:16.412017    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9257f3c0_56ca_4e38_b277_065ddcae876a.slice/crio-d0f394ebf1e75a4d9321a2eda177094f84ed35382ba17c58c5dd3f45b3a47f42 WatchSource:0}: Error finding container d0f394ebf1e75a4d9321a2eda177094f84ed35382ba17c58c5dd3f45b3a47f42: Status 404 returned error can't find the container with id d0f394ebf1e75a4d9321a2eda177094f84ed35382ba17c58c5dd3f45b3a47f42
Sep 16 05:05:16.763750 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:16.763723    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf" event={"ID":"9257f3c0-56ca-4e38-b277-065ddcae876a","Type":"ContainerStarted","Data":"b77a07567058c96010d4debc57c190703dc2a252ee1d9e1b170a2ea91c3e3c72"}
Sep 16 05:05:16.763904 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:16.763777    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf" event={"ID":"9257f3c0-56ca-4e38-b277-065ddcae876a","Type":"ContainerStarted","Data":"d0f394ebf1e75a4d9321a2eda177094f84ed35382ba17c58c5dd3f45b3a47f42"}
Sep 16 05:05:16.776898 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:16.776826    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf" podStartSLOduration=1.776811948 podStartE2EDuration="1.776811948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:05:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:05:16.775797398 +0000 UTC m=+970.436976574" watchObservedRunningTime="2026-09-16 05:05:16.776811948 +0000 UTC m=+970.437991124"
Sep 16 05:05:17.771234 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:17.771195    2559 generic.go:356] "Generic (PLEG): container finished" podID="9257f3c0-56ca-4e38-b277-065ddcae876a" containerID="b77a07567058c96010d4debc57c190703dc2a252ee1d9e1b170a2ea91c3e3c72" exitCode=0
Sep 16 05:05:17.771625 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:17.771250    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf" event={"ID":"9257f3c0-56ca-4e38-b277-065ddcae876a","Type":"ContainerDied","Data":"b77a07567058c96010d4debc57c190703dc2a252ee1d9e1b170a2ea91c3e3c72"}
Sep 16 05:05:18.925776 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:18.925748    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"
Sep 16 05:05:18.974631 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:18.974594    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9257f3c0-56ca-4e38-b277-065ddcae876a-maas-api-service-ca\") pod \"9257f3c0-56ca-4e38-b277-065ddcae876a\" (UID: \"9257f3c0-56ca-4e38-b277-065ddcae876a\") "
Sep 16 05:05:18.974923 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:18.974891    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9257f3c0-56ca-4e38-b277-065ddcae876a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9257f3c0-56ca-4e38-b277-065ddcae876a" (UID: "9257f3c0-56ca-4e38-b277-065ddcae876a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:05:19.076192 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:19.076102    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9257f3c0-56ca-4e38-b277-065ddcae876a-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:19.784206 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:19.784177    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"
Sep 16 05:05:19.784383 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:19.784174    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf" event={"ID":"9257f3c0-56ca-4e38-b277-065ddcae876a","Type":"ContainerDied","Data":"d0f394ebf1e75a4d9321a2eda177094f84ed35382ba17c58c5dd3f45b3a47f42"}
Sep 16 05:05:19.784383 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:19.784307    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0f394ebf1e75a4d9321a2eda177094f84ed35382ba17c58c5dd3f45b3a47f42"
Sep 16 05:05:26.959715 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:26.959674    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"]
Sep 16 05:05:26.960407 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:26.960391    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9257f3c0-56ca-4e38-b277-065ddcae876a" containerName="revoke-keys"
Sep 16 05:05:26.960460 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:26.960411    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9257f3c0-56ca-4e38-b277-065ddcae876a" containerName="revoke-keys"
Sep 16 05:05:26.960542 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:26.960531    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9257f3c0-56ca-4e38-b277-065ddcae876a" containerName="revoke-keys"
Sep 16 05:05:26.963151 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:26.963136    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:26.965196 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:26.965173    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c05179\"/\"openshift-service-ca.crt\""
Sep 16 05:05:26.965332 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:26.965207    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c05179\"/\"kube-root-ca.crt\""
Sep 16 05:05:26.965672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:26.965656    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c05179\"/\"test-model-c05179-kserve-self-signed-certs\""
Sep 16 05:05:26.965721 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:26.965690    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c05179\"/\"default-dockercfg-bm9h9\""
Sep 16 05:05:26.971334 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:26.971309    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"]
Sep 16 05:05:27.057307 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.057267    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-home\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.057307 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.057309    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-dshm\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.057568 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.057327    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-model-cache\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.057568 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.057406    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tmp-dir\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.057568 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.057471    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jz7p\" (UniqueName: \"kubernetes.io/projected/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-kube-api-access-4jz7p\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.057679 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.057571    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tls-certs\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.158709 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.158672    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-home\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.158709 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.158710    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-dshm\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.158709 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.158728    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-model-cache\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.158993 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.158766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tmp-dir\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.158993 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.158812    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jz7p\" (UniqueName: \"kubernetes.io/projected/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-kube-api-access-4jz7p\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.158993 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.158856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tls-certs\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.159148 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.159064    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-home\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.159148 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.159097    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-model-cache\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.159240 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.159219    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tmp-dir\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.161048 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.161025    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-dshm\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.161194 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.161178    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tls-certs\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.166145 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.166118    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jz7p\" (UniqueName: \"kubernetes.io/projected/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-kube-api-access-4jz7p\") pod \"test-model-c05179-kserve-597c784b99-g9cgg\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") " pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.273794 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.273727    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:27.543534 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.543510    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"]
Sep 16 05:05:27.545558 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:05:27.545527    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b6bc15d_48a2_496d_94b4_7ebd3f3ee023.slice/crio-6fb07b66595669ccaabb1c62ee3e30735ce01f1188e163af1ce64003856bce62 WatchSource:0}: Error finding container 6fb07b66595669ccaabb1c62ee3e30735ce01f1188e163af1ce64003856bce62: Status 404 returned error can't find the container with id 6fb07b66595669ccaabb1c62ee3e30735ce01f1188e163af1ce64003856bce62
Sep 16 05:05:27.765888 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.765856    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"]
Sep 16 05:05:27.766131 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.766101    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h" podUID="b146cc33-39c8-4ad5-815f-b8335f6a119f" containerName="payload-pre-processing" containerID="cri-o://30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5" gracePeriod=30
Sep 16 05:05:27.828981 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.828896    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg" event={"ID":"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023","Type":"ContainerStarted","Data":"3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1"}
Sep 16 05:05:27.828981 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.828946    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg" event={"ID":"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023","Type":"ContainerStarted","Data":"6fb07b66595669ccaabb1c62ee3e30735ce01f1188e163af1ce64003856bce62"}
Sep 16 05:05:27.844991 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.844945    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg" podStartSLOduration=1.844929861 podStartE2EDuration="1.844929861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:05:27.843708903 +0000 UTC m=+981.504888081" watchObservedRunningTime="2026-09-16 05:05:27.844929861 +0000 UTC m=+981.506109105"
Sep 16 05:05:27.913660 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.913602    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"]
Sep 16 05:05:27.916242 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:27.916217    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c9c153e4-glrsf"]
Sep 16 05:05:28.047253 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.047217    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"]
Sep 16 05:05:28.047638 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.047455    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy" containerID="cri-o://020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3" gracePeriod=30
Sep 16 05:05:28.054341 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.054316    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:05:28.179448 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.177945    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b146cc33-39c8-4ad5-815f-b8335f6a119f-plugins-config-volume\") pod \"b146cc33-39c8-4ad5-815f-b8335f6a119f\" (UID: \"b146cc33-39c8-4ad5-815f-b8335f6a119f\") "
Sep 16 05:05:28.179448 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.178071    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd8vz\" (UniqueName: \"kubernetes.io/projected/b146cc33-39c8-4ad5-815f-b8335f6a119f-kube-api-access-pd8vz\") pod \"b146cc33-39c8-4ad5-815f-b8335f6a119f\" (UID: \"b146cc33-39c8-4ad5-815f-b8335f6a119f\") "
Sep 16 05:05:28.179448 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.179094    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b146cc33-39c8-4ad5-815f-b8335f6a119f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b146cc33-39c8-4ad5-815f-b8335f6a119f" (UID: "b146cc33-39c8-4ad5-815f-b8335f6a119f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:05:28.196734 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.196697    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b146cc33-39c8-4ad5-815f-b8335f6a119f-kube-api-access-pd8vz" (OuterVolumeSpecName: "kube-api-access-pd8vz") pod "b146cc33-39c8-4ad5-815f-b8335f6a119f" (UID: "b146cc33-39c8-4ad5-815f-b8335f6a119f"). InnerVolumeSpecName "kube-api-access-pd8vz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:05:28.279738 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.279706    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd8vz\" (UniqueName: \"kubernetes.io/projected/b146cc33-39c8-4ad5-815f-b8335f6a119f-kube-api-access-pd8vz\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:28.279738 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.279733    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b146cc33-39c8-4ad5-815f-b8335f6a119f-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:28.786629 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.786591    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9257f3c0-56ca-4e38-b277-065ddcae876a" path="/var/lib/kubelet/pods/9257f3c0-56ca-4e38-b277-065ddcae876a/volumes"
Sep 16 05:05:28.835907 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.835875    2559 generic.go:356] "Generic (PLEG): container finished" podID="b146cc33-39c8-4ad5-815f-b8335f6a119f" containerID="30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5" exitCode=0
Sep 16 05:05:28.836046 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.835927    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"
Sep 16 05:05:28.836046 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.835957    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h" event={"ID":"b146cc33-39c8-4ad5-815f-b8335f6a119f","Type":"ContainerDied","Data":"30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5"}
Sep 16 05:05:28.836046 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.836007    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h" event={"ID":"b146cc33-39c8-4ad5-815f-b8335f6a119f","Type":"ContainerDied","Data":"6fec2e5407f47d0fbf53a26f60b539d5c07d81b462eb8a288ba99534a3244e92"}
Sep 16 05:05:28.836046 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.836031    2559 scope.go:117] "RemoveContainer" containerID="30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5"
Sep 16 05:05:28.844923 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.844906    2559 scope.go:117] "RemoveContainer" containerID="30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5"
Sep 16 05:05:28.845199 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:05:28.845179    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5\": container with ID starting with 30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5 not found: ID does not exist" containerID="30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5"
Sep 16 05:05:28.845290 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.845205    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5"} err="failed to get container status \"30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5\": rpc error: code = NotFound desc = could not find container \"30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5\": container with ID starting with 30383cc0699ae375ea180f78ab7b4580e1369c94be7e2f77888575d1e03d6ec5 not found: ID does not exist"
Sep 16 05:05:28.851363 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.851344    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"]
Sep 16 05:05:28.856511 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:28.856489    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-c9c153e4-54fb7666fd-fwn9h"]
Sep 16 05:05:29.244980 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:29.244947    2559 patch_prober.go:28] interesting pod/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 05:05:29.245342 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:29.245012    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 05:05:30.785855 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:30.785822    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b146cc33-39c8-4ad5-815f-b8335f6a119f" path="/var/lib/kubelet/pods/b146cc33-39c8-4ad5-815f-b8335f6a119f/volumes"
Sep 16 05:05:33.309580 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.309555    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:05:33.431285 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431215    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istiod-ca-cert\") pod \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") "
Sep 16 05:05:33.431285 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431251    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-envoy\") pod \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") "
Sep 16 05:05:33.431285 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431278    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-podinfo\") pod \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") "
Sep 16 05:05:33.431592 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431299    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-token\") pod \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") "
Sep 16 05:05:33.431592 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431334    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-socket\") pod \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") "
Sep 16 05:05:33.431592 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431397    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-certs\") pod \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") "
Sep 16 05:05:33.431592 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431428    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mtwx\" (UniqueName: \"kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-kube-api-access-7mtwx\") pod \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") "
Sep 16 05:05:33.431592 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431452    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-credential-socket\") pod \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") "
Sep 16 05:05:33.431592 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431569    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-data\") pod \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\" (UID: \"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31\") "
Sep 16 05:05:33.431902 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431641    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" (UID: "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:05:33.431902 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431679    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" (UID: "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:05:33.431902 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431773    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" (UID: "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:05:33.432079 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431899    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" (UID: "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:05:33.432079 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431980    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:33.432191 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.431979    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-data" (OuterVolumeSpecName: "istio-data") pod "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" (UID: "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:05:33.432191 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.432069    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:33.432468 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.432202    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:33.433763 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.433736    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" (UID: "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:05:33.433889 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.433772    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" (UID: "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:05:33.433889 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.433828    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-token" (OuterVolumeSpecName: "istio-token") pod "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" (UID: "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:05:33.433971 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.433906    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-kube-api-access-7mtwx" (OuterVolumeSpecName: "kube-api-access-7mtwx") pod "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" (UID: "a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31"). InnerVolumeSpecName "kube-api-access-7mtwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:05:33.533738 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.533714    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:33.533738 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.533734    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:33.533910 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.533742    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:33.533910 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.533752    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mtwx\" (UniqueName: \"kubernetes.io/projected/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-kube-api-access-7mtwx\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:33.533910 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.533763    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:33.533910 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.533771    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:33.869956 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.869919    2559 generic.go:356] "Generic (PLEG): container finished" podID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerID="020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3" exitCode=0
Sep 16 05:05:33.870140 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.869974    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"
Sep 16 05:05:33.870140 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.869973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" event={"ID":"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31","Type":"ContainerDied","Data":"020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3"}
Sep 16 05:05:33.870140 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.870046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67" event={"ID":"a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31","Type":"ContainerDied","Data":"f0dbc178f0e04826a9a452bd8a6ad8e87288847ec97984265579c85e385f2bcb"}
Sep 16 05:05:33.870140 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.870080    2559 scope.go:117] "RemoveContainer" containerID="020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3"
Sep 16 05:05:33.880309 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.880290    2559 scope.go:117] "RemoveContainer" containerID="ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076"
Sep 16 05:05:33.888897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.888875    2559 scope.go:117] "RemoveContainer" containerID="020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3"
Sep 16 05:05:33.889164 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:05:33.889144    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3\": container with ID starting with 020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3 not found: ID does not exist" containerID="020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3"
Sep 16 05:05:33.889301 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.889172    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3"} err="failed to get container status \"020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3\": rpc error: code = NotFound desc = could not find container \"020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3\": container with ID starting with 020bbf27485853115aaf648cd8118889a2b06ed252c5d8858f4930088bc135f3 not found: ID does not exist"
Sep 16 05:05:33.889301 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.889188    2559 scope.go:117] "RemoveContainer" containerID="ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076"
Sep 16 05:05:33.889636 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:05:33.889609    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076\": container with ID starting with ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076 not found: ID does not exist" containerID="ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076"
Sep 16 05:05:33.889737 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.889643    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076"} err="failed to get container status \"ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076\": rpc error: code = NotFound desc = could not find container \"ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076\": container with ID starting with ec2fe677d44a4bb39560f935d1fd7feb809729a185d189329d2da4ce4bc09076 not found: ID does not exist"
Sep 16 05:05:33.899848 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.899827    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"]
Sep 16 05:05:33.913410 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:33.913389    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c9c153e4-openshift-default-5db789c4d8-7vj67"]
Sep 16 05:05:34.786224 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:34.786189    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" path="/var/lib/kubelet/pods/a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31/volumes"
Sep 16 05:05:37.274341 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:37.274309    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:37.274764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:37.274506    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:37.286566 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:37.286545    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:37.907348 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:37.907316    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:05:39.144319 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.144281    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"]
Sep 16 05:05:39.144792 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.144763    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy"
Sep 16 05:05:39.144792 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.144777    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy"
Sep 16 05:05:39.144873 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.144810    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy"
Sep 16 05:05:39.144873 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.144817    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy"
Sep 16 05:05:39.144873 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.144836    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b146cc33-39c8-4ad5-815f-b8335f6a119f" containerName="payload-pre-processing"
Sep 16 05:05:39.144873 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.144842    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b146cc33-39c8-4ad5-815f-b8335f6a119f" containerName="payload-pre-processing"
Sep 16 05:05:39.144998 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.144922    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy"
Sep 16 05:05:39.144998 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.144931    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b146cc33-39c8-4ad5-815f-b8335f6a119f" containerName="payload-pre-processing"
Sep 16 05:05:39.149714 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.149697    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"
Sep 16 05:05:39.151547 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.151519    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:05:39.155436 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.155404    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"]
Sep 16 05:05:39.287268 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.287224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7452d3ae-95d1-4289-ab84-af9af104be00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6\" (UID: \"7452d3ae-95d1-4289-ab84-af9af104be00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"
Sep 16 05:05:39.388258 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.388223    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7452d3ae-95d1-4289-ab84-af9af104be00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6\" (UID: \"7452d3ae-95d1-4289-ab84-af9af104be00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"
Sep 16 05:05:39.388882 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.388862    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7452d3ae-95d1-4289-ab84-af9af104be00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6\" (UID: \"7452d3ae-95d1-4289-ab84-af9af104be00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"
Sep 16 05:05:39.461964 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.461903    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"
Sep 16 05:05:39.732981 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.732952    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"]
Sep 16 05:05:39.734396 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:05:39.734369    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7452d3ae_95d1_4289_ab84_af9af104be00.slice/crio-1d04024ccbb6d9f7d2c68562e9d57d2ba3ba713756a49d9181b1cbc6233c9547 WatchSource:0}: Error finding container 1d04024ccbb6d9f7d2c68562e9d57d2ba3ba713756a49d9181b1cbc6233c9547: Status 404 returned error can't find the container with id 1d04024ccbb6d9f7d2c68562e9d57d2ba3ba713756a49d9181b1cbc6233c9547
Sep 16 05:05:39.908737 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:39.908711    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6" event={"ID":"7452d3ae-95d1-4289-ab84-af9af104be00","Type":"ContainerStarted","Data":"1d04024ccbb6d9f7d2c68562e9d57d2ba3ba713756a49d9181b1cbc6233c9547"}
Sep 16 05:05:40.916272 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:40.916241    2559 generic.go:356] "Generic (PLEG): container finished" podID="7452d3ae-95d1-4289-ab84-af9af104be00" containerID="80adf989c680b90d8adffd477a15777d690c4715d812bcd7c27913d2196db66d" exitCode=0
Sep 16 05:05:40.916729 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:40.916297    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6" event={"ID":"7452d3ae-95d1-4289-ab84-af9af104be00","Type":"ContainerDied","Data":"80adf989c680b90d8adffd477a15777d690c4715d812bcd7c27913d2196db66d"}
Sep 16 05:05:42.061534 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:42.061509    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"
Sep 16 05:05:42.215921 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:42.215856    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7452d3ae-95d1-4289-ab84-af9af104be00-maas-api-service-ca\") pod \"7452d3ae-95d1-4289-ab84-af9af104be00\" (UID: \"7452d3ae-95d1-4289-ab84-af9af104be00\") "
Sep 16 05:05:42.216150 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:42.216129    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7452d3ae-95d1-4289-ab84-af9af104be00-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7452d3ae-95d1-4289-ab84-af9af104be00" (UID: "7452d3ae-95d1-4289-ab84-af9af104be00"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:05:42.316984 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:42.316953    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7452d3ae-95d1-4289-ab84-af9af104be00-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:05:42.928853 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:42.928824    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"
Sep 16 05:05:42.928990 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:42.928824    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6" event={"ID":"7452d3ae-95d1-4289-ab84-af9af104be00","Type":"ContainerDied","Data":"1d04024ccbb6d9f7d2c68562e9d57d2ba3ba713756a49d9181b1cbc6233c9547"}
Sep 16 05:05:42.928990 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:42.928948    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d04024ccbb6d9f7d2c68562e9d57d2ba3ba713756a49d9181b1cbc6233c9547"
Sep 16 05:05:49.970893 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:49.970860    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"]
Sep 16 05:05:49.973006 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:49.972979    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-d05eb5-lmnd6"]
Sep 16 05:05:50.785840 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:05:50.785811    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7452d3ae-95d1-4289-ab84-af9af104be00" path="/var/lib/kubelet/pods/7452d3ae-95d1-4289-ab84-af9af104be00/volumes"
Sep 16 05:06:06.874542 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:06.874513    2559 scope.go:117] "RemoveContainer" containerID="a4df38bd121ece9104c5f2e7dc5039004de49a79e5d4f4a799da44b3d0bb0279"
Sep 16 05:06:39.591626 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.591594    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"]
Sep 16 05:06:39.592750 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.592728    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7452d3ae-95d1-4289-ab84-af9af104be00" containerName="revoke-keys"
Sep 16 05:06:39.592750 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.592750    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7452d3ae-95d1-4289-ab84-af9af104be00" containerName="revoke-keys"
Sep 16 05:06:39.592894 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.592834    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7452d3ae-95d1-4289-ab84-af9af104be00" containerName="revoke-keys"
Sep 16 05:06:39.592894 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.592847    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0df0ab8-cd4c-4992-b5b9-cdaaaeed5c31" containerName="istio-proxy"
Sep 16 05:06:39.596034 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.596016    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:06:39.597913 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.597895    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-672f57\""
Sep 16 05:06:39.597979 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.597932    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-672f57-dockercfg-qdcw9\""
Sep 16 05:06:39.604561 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.604535    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"]
Sep 16 05:06:39.639273 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.639249    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"]
Sep 16 05:06:39.642805 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.642790    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:06:39.653427 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.653407    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"]
Sep 16 05:06:39.737239 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.737206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b798039-f720-47a1-9a13-0ff3f1a65ec2-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj\" (UID: \"0b798039-f720-47a1-9a13-0ff3f1a65ec2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:06:39.737390 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.737362    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qkng\" (UniqueName: \"kubernetes.io/projected/0b798039-f720-47a1-9a13-0ff3f1a65ec2-kube-api-access-4qkng\") pod \"payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj\" (UID: \"0b798039-f720-47a1-9a13-0ff3f1a65ec2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:06:39.838892 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.838855    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b798039-f720-47a1-9a13-0ff3f1a65ec2-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj\" (UID: \"0b798039-f720-47a1-9a13-0ff3f1a65ec2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:06:39.839071 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.838953    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23f6446f-ed4f-4964-951c-c490aa269e7c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-672f57-d4c5c7985-vltth\" (UID: \"23f6446f-ed4f-4964-951c-c490aa269e7c\") " pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:06:39.839071 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.838988    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qkng\" (UniqueName: \"kubernetes.io/projected/0b798039-f720-47a1-9a13-0ff3f1a65ec2-kube-api-access-4qkng\") pod \"payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj\" (UID: \"0b798039-f720-47a1-9a13-0ff3f1a65ec2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:06:39.839071 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.839035    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n58pt\" (UniqueName: \"kubernetes.io/projected/23f6446f-ed4f-4964-951c-c490aa269e7c-kube-api-access-n58pt\") pod \"payload-processing-e2e-explicit-672f57-d4c5c7985-vltth\" (UID: \"23f6446f-ed4f-4964-951c-c490aa269e7c\") " pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:06:39.839723 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.839696    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b798039-f720-47a1-9a13-0ff3f1a65ec2-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj\" (UID: \"0b798039-f720-47a1-9a13-0ff3f1a65ec2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:06:39.847565 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.847514    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qkng\" (UniqueName: \"kubernetes.io/projected/0b798039-f720-47a1-9a13-0ff3f1a65ec2-kube-api-access-4qkng\") pod \"payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj\" (UID: \"0b798039-f720-47a1-9a13-0ff3f1a65ec2\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:06:39.909250 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.909218    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:06:39.940066 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.940037    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23f6446f-ed4f-4964-951c-c490aa269e7c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-672f57-d4c5c7985-vltth\" (UID: \"23f6446f-ed4f-4964-951c-c490aa269e7c\") " pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:06:39.940193 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.940140    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n58pt\" (UniqueName: \"kubernetes.io/projected/23f6446f-ed4f-4964-951c-c490aa269e7c-kube-api-access-n58pt\") pod \"payload-processing-e2e-explicit-672f57-d4c5c7985-vltth\" (UID: \"23f6446f-ed4f-4964-951c-c490aa269e7c\") " pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:06:39.940824 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.940800    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23f6446f-ed4f-4964-951c-c490aa269e7c-plugins-config-volume\") pod \"payload-processing-e2e-explicit-672f57-d4c5c7985-vltth\" (UID: \"23f6446f-ed4f-4964-951c-c490aa269e7c\") " pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:06:39.948433 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.948411    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n58pt\" (UniqueName: \"kubernetes.io/projected/23f6446f-ed4f-4964-951c-c490aa269e7c-kube-api-access-n58pt\") pod \"payload-processing-e2e-explicit-672f57-d4c5c7985-vltth\" (UID: \"23f6446f-ed4f-4964-951c-c490aa269e7c\") " pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:06:39.953299 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:39.953276    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:06:40.179193 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:40.179171    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"]
Sep 16 05:06:40.181150 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:06:40.181124    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b798039_f720_47a1_9a13_0ff3f1a65ec2.slice/crio-5d14b4ed5ddeacbaa33aabf115336aaef90c72a3b871a1c0a4d76449631a2818 WatchSource:0}: Error finding container 5d14b4ed5ddeacbaa33aabf115336aaef90c72a3b871a1c0a4d76449631a2818: Status 404 returned error can't find the container with id 5d14b4ed5ddeacbaa33aabf115336aaef90c72a3b871a1c0a4d76449631a2818
Sep 16 05:06:40.238256 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:40.238148    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj" event={"ID":"0b798039-f720-47a1-9a13-0ff3f1a65ec2","Type":"ContainerStarted","Data":"5d14b4ed5ddeacbaa33aabf115336aaef90c72a3b871a1c0a4d76449631a2818"}
Sep 16 05:06:40.241753 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:40.241727    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"]
Sep 16 05:06:40.242087 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:06:40.242061    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f6446f_ed4f_4964_951c_c490aa269e7c.slice/crio-60f86d7df4ccf5d709e0f7331ee66b48fb7fee4007dc3f71cd9c487999fcd7ef WatchSource:0}: Error finding container 60f86d7df4ccf5d709e0f7331ee66b48fb7fee4007dc3f71cd9c487999fcd7ef: Status 404 returned error can't find the container with id 60f86d7df4ccf5d709e0f7331ee66b48fb7fee4007dc3f71cd9c487999fcd7ef
Sep 16 05:06:41.246154 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:41.246121    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj" event={"ID":"0b798039-f720-47a1-9a13-0ff3f1a65ec2","Type":"ContainerStarted","Data":"8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1"}
Sep 16 05:06:41.246609 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:41.246184    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:06:41.247762 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:41.247742    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth" event={"ID":"23f6446f-ed4f-4964-951c-c490aa269e7c","Type":"ContainerStarted","Data":"d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93"}
Sep 16 05:06:41.247831 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:41.247791    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth" event={"ID":"23f6446f-ed4f-4964-951c-c490aa269e7c","Type":"ContainerStarted","Data":"60f86d7df4ccf5d709e0f7331ee66b48fb7fee4007dc3f71cd9c487999fcd7ef"}
Sep 16 05:06:41.247831 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:41.247815    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:06:41.262029 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:41.261983    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj" podStartSLOduration=2.261969448 podStartE2EDuration="2.261969448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:06:41.260348563 +0000 UTC m=+1054.921527739" watchObservedRunningTime="2026-09-16 05:06:41.261969448 +0000 UTC m=+1054.923148625"
Sep 16 05:06:41.278096 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:41.278046    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth" podStartSLOduration=2.278028802 podStartE2EDuration="2.278028802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:06:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:06:41.275597596 +0000 UTC m=+1054.936776787" watchObservedRunningTime="2026-09-16 05:06:41.278028802 +0000 UTC m=+1054.939207986"
Sep 16 05:06:52.255353 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:52.255324    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:06:52.255725 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:06:52.255398    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:07:14.600341 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.600309    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"]
Sep 16 05:07:14.604537 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.604516    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:14.606459 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.606437    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a28799ba\""
Sep 16 05:07:14.606584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.606570    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a28799ba-dockercfg-fchxw\""
Sep 16 05:07:14.614429 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.614405    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"]
Sep 16 05:07:14.640807 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.640785    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"]
Sep 16 05:07:14.644195 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.644181    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:14.655395 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.655373    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"]
Sep 16 05:07:14.761962 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.761926    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f34d6521-249e-4aff-8039-847cb54276a9-plugins-config-volume\") pod \"payload-processing-e2e-mt-a28799ba-6665c554df-56pfg\" (UID: \"f34d6521-249e-4aff-8039-847cb54276a9\") " pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:14.761962 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.761965    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knfcj\" (UniqueName: \"kubernetes.io/projected/aa307658-fa30-4885-a09c-20d227d430aa-kube-api-access-knfcj\") pod \"payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d\" (UID: \"aa307658-fa30-4885-a09c-20d227d430aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:14.762186 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.761989    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrrdk\" (UniqueName: \"kubernetes.io/projected/f34d6521-249e-4aff-8039-847cb54276a9-kube-api-access-rrrdk\") pod \"payload-processing-e2e-mt-a28799ba-6665c554df-56pfg\" (UID: \"f34d6521-249e-4aff-8039-847cb54276a9\") " pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:14.762186 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.762092    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa307658-fa30-4885-a09c-20d227d430aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d\" (UID: \"aa307658-fa30-4885-a09c-20d227d430aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:14.863645 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.863569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f34d6521-249e-4aff-8039-847cb54276a9-plugins-config-volume\") pod \"payload-processing-e2e-mt-a28799ba-6665c554df-56pfg\" (UID: \"f34d6521-249e-4aff-8039-847cb54276a9\") " pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:14.863645 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.863602    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knfcj\" (UniqueName: \"kubernetes.io/projected/aa307658-fa30-4885-a09c-20d227d430aa-kube-api-access-knfcj\") pod \"payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d\" (UID: \"aa307658-fa30-4885-a09c-20d227d430aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:14.863645 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.863624    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrrdk\" (UniqueName: \"kubernetes.io/projected/f34d6521-249e-4aff-8039-847cb54276a9-kube-api-access-rrrdk\") pod \"payload-processing-e2e-mt-a28799ba-6665c554df-56pfg\" (UID: \"f34d6521-249e-4aff-8039-847cb54276a9\") " pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:14.863870 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.863670    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa307658-fa30-4885-a09c-20d227d430aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d\" (UID: \"aa307658-fa30-4885-a09c-20d227d430aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:14.864296 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.864274    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f34d6521-249e-4aff-8039-847cb54276a9-plugins-config-volume\") pod \"payload-processing-e2e-mt-a28799ba-6665c554df-56pfg\" (UID: \"f34d6521-249e-4aff-8039-847cb54276a9\") " pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:14.864392 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.864373    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa307658-fa30-4885-a09c-20d227d430aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d\" (UID: \"aa307658-fa30-4885-a09c-20d227d430aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:14.871327 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.871295    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knfcj\" (UniqueName: \"kubernetes.io/projected/aa307658-fa30-4885-a09c-20d227d430aa-kube-api-access-knfcj\") pod \"payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d\" (UID: \"aa307658-fa30-4885-a09c-20d227d430aa\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:14.871700 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.871685    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrrdk\" (UniqueName: \"kubernetes.io/projected/f34d6521-249e-4aff-8039-847cb54276a9-kube-api-access-rrrdk\") pod \"payload-processing-e2e-mt-a28799ba-6665c554df-56pfg\" (UID: \"f34d6521-249e-4aff-8039-847cb54276a9\") " pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:14.915673 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.915649    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:14.955081 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:14.955026    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:15.190051 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:15.190024    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"]
Sep 16 05:07:15.192198 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:07:15.192173    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa307658_fa30_4885_a09c_20d227d430aa.slice/crio-eed08b9e390ef0a9c585729e49e5bccadd9a6684a9d9839eb984f560a574acc6 WatchSource:0}: Error finding container eed08b9e390ef0a9c585729e49e5bccadd9a6684a9d9839eb984f560a574acc6: Status 404 returned error can't find the container with id eed08b9e390ef0a9c585729e49e5bccadd9a6684a9d9839eb984f560a574acc6
Sep 16 05:07:15.236181 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:15.236161    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"]
Sep 16 05:07:15.245546 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:07:15.245519    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf34d6521_249e_4aff_8039_847cb54276a9.slice/crio-c037e11b11cf6d4fec84851091382baab8dd6e0ac7e5991cad82a458c0629adb WatchSource:0}: Error finding container c037e11b11cf6d4fec84851091382baab8dd6e0ac7e5991cad82a458c0629adb: Status 404 returned error can't find the container with id c037e11b11cf6d4fec84851091382baab8dd6e0ac7e5991cad82a458c0629adb
Sep 16 05:07:15.451557 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:15.451458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg" event={"ID":"f34d6521-249e-4aff-8039-847cb54276a9","Type":"ContainerStarted","Data":"34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2"}
Sep 16 05:07:15.451557 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:15.451528    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg" event={"ID":"f34d6521-249e-4aff-8039-847cb54276a9","Type":"ContainerStarted","Data":"c037e11b11cf6d4fec84851091382baab8dd6e0ac7e5991cad82a458c0629adb"}
Sep 16 05:07:15.451776 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:15.451660    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:15.453194 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:15.453163    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d" event={"ID":"aa307658-fa30-4885-a09c-20d227d430aa","Type":"ContainerStarted","Data":"7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a"}
Sep 16 05:07:15.453312 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:15.453217    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d" event={"ID":"aa307658-fa30-4885-a09c-20d227d430aa","Type":"ContainerStarted","Data":"eed08b9e390ef0a9c585729e49e5bccadd9a6684a9d9839eb984f560a574acc6"}
Sep 16 05:07:15.453312 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:15.453238    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:15.467179 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:15.467137    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg" podStartSLOduration=1.467122909 podStartE2EDuration="1.467122909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:07:15.465928779 +0000 UTC m=+1089.127107957" watchObservedRunningTime="2026-09-16 05:07:15.467122909 +0000 UTC m=+1089.128302094"
Sep 16 05:07:15.481451 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:15.481406    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d" podStartSLOduration=1.481394888 podStartE2EDuration="1.481394888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:07:15.479783578 +0000 UTC m=+1089.140962772" watchObservedRunningTime="2026-09-16 05:07:15.481394888 +0000 UTC m=+1089.142574064"
Sep 16 05:07:26.462682 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:26.462651    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:26.463014 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:26.462723    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:47.090369 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:47.090338    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"]
Sep 16 05:07:47.095112 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:47.095091    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"
Sep 16 05:07:47.097269 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:47.097245    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:07:47.101689 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:47.101618    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"]
Sep 16 05:07:47.258442 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:47.258411    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8703dbbd-569a-4e42-98e9-0230fb6969f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6\" (UID: \"8703dbbd-569a-4e42-98e9-0230fb6969f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"
Sep 16 05:07:47.359915 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:47.359841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8703dbbd-569a-4e42-98e9-0230fb6969f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6\" (UID: \"8703dbbd-569a-4e42-98e9-0230fb6969f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"
Sep 16 05:07:47.360455 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:47.360431    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8703dbbd-569a-4e42-98e9-0230fb6969f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6\" (UID: \"8703dbbd-569a-4e42-98e9-0230fb6969f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"
Sep 16 05:07:47.409114 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:47.409092    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"
Sep 16 05:07:47.679839 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:47.679817    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"]
Sep 16 05:07:47.681438 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:07:47.681415    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8703dbbd_569a_4e42_98e9_0230fb6969f6.slice/crio-97ab04e104912e8b870812fbedda54cf5e6489f4f92b26939b1d917eecbbdda6 WatchSource:0}: Error finding container 97ab04e104912e8b870812fbedda54cf5e6489f4f92b26939b1d917eecbbdda6: Status 404 returned error can't find the container with id 97ab04e104912e8b870812fbedda54cf5e6489f4f92b26939b1d917eecbbdda6
Sep 16 05:07:48.652697 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:48.652606    2559 generic.go:356] "Generic (PLEG): container finished" podID="8703dbbd-569a-4e42-98e9-0230fb6969f6" containerID="6ca7d80401637ec83199b0eb0b8b9792e555ea9a58d6d2706ef876455a8ddcfa" exitCode=0
Sep 16 05:07:48.653133 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:48.652713    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6" event={"ID":"8703dbbd-569a-4e42-98e9-0230fb6969f6","Type":"ContainerDied","Data":"6ca7d80401637ec83199b0eb0b8b9792e555ea9a58d6d2706ef876455a8ddcfa"}
Sep 16 05:07:48.653133 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:48.652773    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6" event={"ID":"8703dbbd-569a-4e42-98e9-0230fb6969f6","Type":"ContainerStarted","Data":"97ab04e104912e8b870812fbedda54cf5e6489f4f92b26939b1d917eecbbdda6"}
Sep 16 05:07:49.813943 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:49.813908    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"
Sep 16 05:07:49.882846 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:49.882817    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8703dbbd-569a-4e42-98e9-0230fb6969f6-maas-api-service-ca\") pod \"8703dbbd-569a-4e42-98e9-0230fb6969f6\" (UID: \"8703dbbd-569a-4e42-98e9-0230fb6969f6\") "
Sep 16 05:07:49.883190 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:49.883166    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8703dbbd-569a-4e42-98e9-0230fb6969f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8703dbbd-569a-4e42-98e9-0230fb6969f6" (UID: "8703dbbd-569a-4e42-98e9-0230fb6969f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:07:49.883435 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:49.883401    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8703dbbd-569a-4e42-98e9-0230fb6969f6-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:07:50.664934 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:50.664904    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"
Sep 16 05:07:50.664934 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:50.664928    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6" event={"ID":"8703dbbd-569a-4e42-98e9-0230fb6969f6","Type":"ContainerDied","Data":"97ab04e104912e8b870812fbedda54cf5e6489f4f92b26939b1d917eecbbdda6"}
Sep 16 05:07:50.665178 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:50.664997    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97ab04e104912e8b870812fbedda54cf5e6489f4f92b26939b1d917eecbbdda6"
Sep 16 05:07:51.664571 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:51.664536    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"]
Sep 16 05:07:51.665019 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:51.665004    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8703dbbd-569a-4e42-98e9-0230fb6969f6" containerName="revoke-keys"
Sep 16 05:07:51.665064 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:51.665020    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8703dbbd-569a-4e42-98e9-0230fb6969f6" containerName="revoke-keys"
Sep 16 05:07:51.665123 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:51.665114    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8703dbbd-569a-4e42-98e9-0230fb6969f6" containerName="revoke-keys"
Sep 16 05:07:51.668533 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:51.668508    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"
Sep 16 05:07:51.670444 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:51.670418    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:07:51.674329 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:51.674288    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"]
Sep 16 05:07:51.801920 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:51.801886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62021750-2306-4693-9642-a624e126c44a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-672f57-qxksx\" (UID: \"62021750-2306-4693-9642-a624e126c44a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"
Sep 16 05:07:51.902971 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:51.902948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62021750-2306-4693-9642-a624e126c44a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-672f57-qxksx\" (UID: \"62021750-2306-4693-9642-a624e126c44a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"
Sep 16 05:07:51.903554 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:51.903535    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62021750-2306-4693-9642-a624e126c44a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-672f57-qxksx\" (UID: \"62021750-2306-4693-9642-a624e126c44a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"
Sep 16 05:07:51.980427 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:51.980411    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"
Sep 16 05:07:52.250780 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:52.250758    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"]
Sep 16 05:07:52.252822 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:07:52.252795    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62021750_2306_4693_9642_a624e126c44a.slice/crio-acdca0059f95a078668ae36d03ff2be1ffcc1bea280a38c950a8c165e91bf692 WatchSource:0}: Error finding container acdca0059f95a078668ae36d03ff2be1ffcc1bea280a38c950a8c165e91bf692: Status 404 returned error can't find the container with id acdca0059f95a078668ae36d03ff2be1ffcc1bea280a38c950a8c165e91bf692
Sep 16 05:07:52.679768 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:52.679732    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx" event={"ID":"62021750-2306-4693-9642-a624e126c44a","Type":"ContainerStarted","Data":"841a37328da71abc3acf270a060d54a708467a7d14c016ad0a1ee4047823ea2b"}
Sep 16 05:07:52.680122 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:52.679787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx" event={"ID":"62021750-2306-4693-9642-a624e126c44a","Type":"ContainerStarted","Data":"acdca0059f95a078668ae36d03ff2be1ffcc1bea280a38c950a8c165e91bf692"}
Sep 16 05:07:52.696867 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:52.696824    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx" podStartSLOduration=1.696807798 podStartE2EDuration="1.696807798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:07:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:07:52.694944775 +0000 UTC m=+1126.356123953" watchObservedRunningTime="2026-09-16 05:07:52.696807798 +0000 UTC m=+1126.357986974"
Sep 16 05:07:53.693950 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:53.693914    2559 generic.go:356] "Generic (PLEG): container finished" podID="62021750-2306-4693-9642-a624e126c44a" containerID="841a37328da71abc3acf270a060d54a708467a7d14c016ad0a1ee4047823ea2b" exitCode=0
Sep 16 05:07:53.694321 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:53.693998    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx" event={"ID":"62021750-2306-4693-9642-a624e126c44a","Type":"ContainerDied","Data":"841a37328da71abc3acf270a060d54a708467a7d14c016ad0a1ee4047823ea2b"}
Sep 16 05:07:54.840206 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:54.840176    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"
Sep 16 05:07:54.931733 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:54.931705    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62021750-2306-4693-9642-a624e126c44a-maas-api-service-ca\") pod \"62021750-2306-4693-9642-a624e126c44a\" (UID: \"62021750-2306-4693-9642-a624e126c44a\") "
Sep 16 05:07:54.932027 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:54.932007    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62021750-2306-4693-9642-a624e126c44a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "62021750-2306-4693-9642-a624e126c44a" (UID: "62021750-2306-4693-9642-a624e126c44a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:07:55.032722 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:55.032687    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62021750-2306-4693-9642-a624e126c44a-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:07:55.712252 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:55.712216    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx" event={"ID":"62021750-2306-4693-9642-a624e126c44a","Type":"ContainerDied","Data":"acdca0059f95a078668ae36d03ff2be1ffcc1bea280a38c950a8c165e91bf692"}
Sep 16 05:07:55.712252 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:55.712279    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acdca0059f95a078668ae36d03ff2be1ffcc1bea280a38c950a8c165e91bf692"
Sep 16 05:07:55.712252 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:55.712231    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"
Sep 16 05:07:57.822648 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:57.822614    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"]
Sep 16 05:07:57.823090 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:57.822845    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg" podUID="f34d6521-249e-4aff-8039-847cb54276a9" containerName="payload-processing" containerID="cri-o://34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2" gracePeriod=30
Sep 16 05:07:57.829734 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:57.828663    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"]
Sep 16 05:07:57.829734 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:57.828850    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d" podUID="aa307658-fa30-4885-a09c-20d227d430aa" containerName="payload-pre-processing" containerID="cri-o://7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a" gracePeriod=30
Sep 16 05:07:57.981972 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:57.981935    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"]
Sep 16 05:07:57.984097 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:57.984070    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a28799ba-wgjm6"]
Sep 16 05:07:58.147638 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.147611    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:58.155620 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.155588    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:58.265705 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.265678    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f34d6521-249e-4aff-8039-847cb54276a9-plugins-config-volume\") pod \"f34d6521-249e-4aff-8039-847cb54276a9\" (UID: \"f34d6521-249e-4aff-8039-847cb54276a9\") "
Sep 16 05:07:58.265705 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.265716    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa307658-fa30-4885-a09c-20d227d430aa-plugins-config-volume\") pod \"aa307658-fa30-4885-a09c-20d227d430aa\" (UID: \"aa307658-fa30-4885-a09c-20d227d430aa\") "
Sep 16 05:07:58.265965 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.265785    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knfcj\" (UniqueName: \"kubernetes.io/projected/aa307658-fa30-4885-a09c-20d227d430aa-kube-api-access-knfcj\") pod \"aa307658-fa30-4885-a09c-20d227d430aa\" (UID: \"aa307658-fa30-4885-a09c-20d227d430aa\") "
Sep 16 05:07:58.265965 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.265872    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrrdk\" (UniqueName: \"kubernetes.io/projected/f34d6521-249e-4aff-8039-847cb54276a9-kube-api-access-rrrdk\") pod \"f34d6521-249e-4aff-8039-847cb54276a9\" (UID: \"f34d6521-249e-4aff-8039-847cb54276a9\") "
Sep 16 05:07:58.266133 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.266108    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f34d6521-249e-4aff-8039-847cb54276a9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f34d6521-249e-4aff-8039-847cb54276a9" (UID: "f34d6521-249e-4aff-8039-847cb54276a9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:07:58.266186 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.266139    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa307658-fa30-4885-a09c-20d227d430aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa307658-fa30-4885-a09c-20d227d430aa" (UID: "aa307658-fa30-4885-a09c-20d227d430aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:07:58.268003 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.267982    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34d6521-249e-4aff-8039-847cb54276a9-kube-api-access-rrrdk" (OuterVolumeSpecName: "kube-api-access-rrrdk") pod "f34d6521-249e-4aff-8039-847cb54276a9" (UID: "f34d6521-249e-4aff-8039-847cb54276a9"). InnerVolumeSpecName "kube-api-access-rrrdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:07:58.268071 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.268024    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa307658-fa30-4885-a09c-20d227d430aa-kube-api-access-knfcj" (OuterVolumeSpecName: "kube-api-access-knfcj") pod "aa307658-fa30-4885-a09c-20d227d430aa" (UID: "aa307658-fa30-4885-a09c-20d227d430aa"). InnerVolumeSpecName "kube-api-access-knfcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:07:58.367703 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.367629    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f34d6521-249e-4aff-8039-847cb54276a9-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:07:58.367703 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.367654    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa307658-fa30-4885-a09c-20d227d430aa-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:07:58.367703 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.367664    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knfcj\" (UniqueName: \"kubernetes.io/projected/aa307658-fa30-4885-a09c-20d227d430aa-kube-api-access-knfcj\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:07:58.367703 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.367672    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrrdk\" (UniqueName: \"kubernetes.io/projected/f34d6521-249e-4aff-8039-847cb54276a9-kube-api-access-rrrdk\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:07:58.731839 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.731802    2559 generic.go:356] "Generic (PLEG): container finished" podID="f34d6521-249e-4aff-8039-847cb54276a9" containerID="34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2" exitCode=0
Sep 16 05:07:58.731989 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.731871    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg" event={"ID":"f34d6521-249e-4aff-8039-847cb54276a9","Type":"ContainerDied","Data":"34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2"}
Sep 16 05:07:58.731989 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.731929    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"
Sep 16 05:07:58.731989 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.731973    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg" event={"ID":"f34d6521-249e-4aff-8039-847cb54276a9","Type":"ContainerDied","Data":"c037e11b11cf6d4fec84851091382baab8dd6e0ac7e5991cad82a458c0629adb"}
Sep 16 05:07:58.732132 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.732013    2559 scope.go:117] "RemoveContainer" containerID="34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2"
Sep 16 05:07:58.733376 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.733348    2559 generic.go:356] "Generic (PLEG): container finished" podID="aa307658-fa30-4885-a09c-20d227d430aa" containerID="7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a" exitCode=0
Sep 16 05:07:58.733516 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.733374    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d" event={"ID":"aa307658-fa30-4885-a09c-20d227d430aa","Type":"ContainerDied","Data":"7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a"}
Sep 16 05:07:58.733516 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.733402    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"
Sep 16 05:07:58.733516 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.733424    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d" event={"ID":"aa307658-fa30-4885-a09c-20d227d430aa","Type":"ContainerDied","Data":"eed08b9e390ef0a9c585729e49e5bccadd9a6684a9d9839eb984f560a574acc6"}
Sep 16 05:07:58.741718 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.741700    2559 scope.go:117] "RemoveContainer" containerID="34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2"
Sep 16 05:07:58.742049 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:07:58.742020    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2\": container with ID starting with 34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2 not found: ID does not exist" containerID="34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2"
Sep 16 05:07:58.742161 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.742059    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2"} err="failed to get container status \"34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2\": rpc error: code = NotFound desc = could not find container \"34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2\": container with ID starting with 34b50ae25954a21e5f051bb8bd9a40c5612c8062ea5006b21ee70cb5c12a0bb2 not found: ID does not exist"
Sep 16 05:07:58.742161 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.742081    2559 scope.go:117] "RemoveContainer" containerID="7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a"
Sep 16 05:07:58.750268 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.750255    2559 scope.go:117] "RemoveContainer" containerID="7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a"
Sep 16 05:07:58.750523 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:07:58.750507    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a\": container with ID starting with 7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a not found: ID does not exist" containerID="7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a"
Sep 16 05:07:58.750562 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.750529    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a"} err="failed to get container status \"7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a\": rpc error: code = NotFound desc = could not find container \"7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a\": container with ID starting with 7a5a8c574f2395d67a68e2f6f4c7b0a9e1437b25ad536e2f8f980769fe201b9a not found: ID does not exist"
Sep 16 05:07:58.757281 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.757260    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"]
Sep 16 05:07:58.764174 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.764150    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a28799ba-67d8bf644b-jbr4d"]
Sep 16 05:07:58.773017 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.772995    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"]
Sep 16 05:07:58.777433 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.777412    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a28799ba-6665c554df-56pfg"]
Sep 16 05:07:58.785744 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.785725    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8703dbbd-569a-4e42-98e9-0230fb6969f6" path="/var/lib/kubelet/pods/8703dbbd-569a-4e42-98e9-0230fb6969f6/volumes"
Sep 16 05:07:58.786068 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.786056    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa307658-fa30-4885-a09c-20d227d430aa" path="/var/lib/kubelet/pods/aa307658-fa30-4885-a09c-20d227d430aa/volumes"
Sep 16 05:07:58.786367 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:07:58.786356    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f34d6521-249e-4aff-8039-847cb54276a9" path="/var/lib/kubelet/pods/f34d6521-249e-4aff-8039-847cb54276a9/volumes"
Sep 16 05:08:02.796704 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:02.796671    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"]
Sep 16 05:08:02.797116 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:02.796918    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth" podUID="23f6446f-ed4f-4964-951c-c490aa269e7c" containerName="payload-processing" containerID="cri-o://d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93" gracePeriod=30
Sep 16 05:08:02.809159 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:02.809137    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"]
Sep 16 05:08:02.809557 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:02.809529    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj" podUID="0b798039-f720-47a1-9a13-0ff3f1a65ec2" containerName="payload-pre-processing" containerID="cri-o://8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1" gracePeriod=30
Sep 16 05:08:02.971171 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:02.971138    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"]
Sep 16 05:08:02.974163 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:02.974134    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-672f57-qxksx"]
Sep 16 05:08:03.087181 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.087157    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:08:03.090010 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.089988    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:08:03.129041 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.129003    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23f6446f-ed4f-4964-951c-c490aa269e7c-plugins-config-volume\") pod \"23f6446f-ed4f-4964-951c-c490aa269e7c\" (UID: \"23f6446f-ed4f-4964-951c-c490aa269e7c\") "
Sep 16 05:08:03.129234 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.129087    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qkng\" (UniqueName: \"kubernetes.io/projected/0b798039-f720-47a1-9a13-0ff3f1a65ec2-kube-api-access-4qkng\") pod \"0b798039-f720-47a1-9a13-0ff3f1a65ec2\" (UID: \"0b798039-f720-47a1-9a13-0ff3f1a65ec2\") "
Sep 16 05:08:03.129234 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.129171    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b798039-f720-47a1-9a13-0ff3f1a65ec2-plugins-config-volume\") pod \"0b798039-f720-47a1-9a13-0ff3f1a65ec2\" (UID: \"0b798039-f720-47a1-9a13-0ff3f1a65ec2\") "
Sep 16 05:08:03.129234 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.129207    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n58pt\" (UniqueName: \"kubernetes.io/projected/23f6446f-ed4f-4964-951c-c490aa269e7c-kube-api-access-n58pt\") pod \"23f6446f-ed4f-4964-951c-c490aa269e7c\" (UID: \"23f6446f-ed4f-4964-951c-c490aa269e7c\") "
Sep 16 05:08:03.133150 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.132276    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23f6446f-ed4f-4964-951c-c490aa269e7c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23f6446f-ed4f-4964-951c-c490aa269e7c" (UID: "23f6446f-ed4f-4964-951c-c490aa269e7c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:08:03.133150 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.132586    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b798039-f720-47a1-9a13-0ff3f1a65ec2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b798039-f720-47a1-9a13-0ff3f1a65ec2" (UID: "0b798039-f720-47a1-9a13-0ff3f1a65ec2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:08:03.133150 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.132646    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23f6446f-ed4f-4964-951c-c490aa269e7c-kube-api-access-n58pt" (OuterVolumeSpecName: "kube-api-access-n58pt") pod "23f6446f-ed4f-4964-951c-c490aa269e7c" (UID: "23f6446f-ed4f-4964-951c-c490aa269e7c"). InnerVolumeSpecName "kube-api-access-n58pt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:08:03.137048 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.135578    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b798039-f720-47a1-9a13-0ff3f1a65ec2-kube-api-access-4qkng" (OuterVolumeSpecName: "kube-api-access-4qkng") pod "0b798039-f720-47a1-9a13-0ff3f1a65ec2" (UID: "0b798039-f720-47a1-9a13-0ff3f1a65ec2"). InnerVolumeSpecName "kube-api-access-4qkng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:08:03.230960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.230932    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23f6446f-ed4f-4964-951c-c490aa269e7c-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:08:03.230960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.230957    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qkng\" (UniqueName: \"kubernetes.io/projected/0b798039-f720-47a1-9a13-0ff3f1a65ec2-kube-api-access-4qkng\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:08:03.231108 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.230973    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b798039-f720-47a1-9a13-0ff3f1a65ec2-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:08:03.231108 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.230987    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n58pt\" (UniqueName: \"kubernetes.io/projected/23f6446f-ed4f-4964-951c-c490aa269e7c-kube-api-access-n58pt\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:08:03.769461 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.769423    2559 generic.go:356] "Generic (PLEG): container finished" podID="0b798039-f720-47a1-9a13-0ff3f1a65ec2" containerID="8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1" exitCode=0
Sep 16 05:08:03.769657 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.769464    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"
Sep 16 05:08:03.769657 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.769524    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj" event={"ID":"0b798039-f720-47a1-9a13-0ff3f1a65ec2","Type":"ContainerDied","Data":"8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1"}
Sep 16 05:08:03.769657 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.769573    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj" event={"ID":"0b798039-f720-47a1-9a13-0ff3f1a65ec2","Type":"ContainerDied","Data":"5d14b4ed5ddeacbaa33aabf115336aaef90c72a3b871a1c0a4d76449631a2818"}
Sep 16 05:08:03.769657 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.769595    2559 scope.go:117] "RemoveContainer" containerID="8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1"
Sep 16 05:08:03.771032 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.771009    2559 generic.go:356] "Generic (PLEG): container finished" podID="23f6446f-ed4f-4964-951c-c490aa269e7c" containerID="d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93" exitCode=0
Sep 16 05:08:03.771157 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.771046    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"
Sep 16 05:08:03.771157 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.771038    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth" event={"ID":"23f6446f-ed4f-4964-951c-c490aa269e7c","Type":"ContainerDied","Data":"d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93"}
Sep 16 05:08:03.771248 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.771174    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth" event={"ID":"23f6446f-ed4f-4964-951c-c490aa269e7c","Type":"ContainerDied","Data":"60f86d7df4ccf5d709e0f7331ee66b48fb7fee4007dc3f71cd9c487999fcd7ef"}
Sep 16 05:08:03.779055 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.779037    2559 scope.go:117] "RemoveContainer" containerID="8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1"
Sep 16 05:08:03.779413 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:08:03.779324    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1\": container with ID starting with 8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1 not found: ID does not exist" containerID="8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1"
Sep 16 05:08:03.779531 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.779409    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1"} err="failed to get container status \"8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1\": rpc error: code = NotFound desc = could not find container \"8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1\": container with ID starting with 8693f16e2882e980d024a688cc679d9ddae728ed60064bbee4024b03bc30f9c1 not found: ID does not exist"
Sep 16 05:08:03.779531 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.779430    2559 scope.go:117] "RemoveContainer" containerID="d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93"
Sep 16 05:08:03.787779 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.787761    2559 scope.go:117] "RemoveContainer" containerID="d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93"
Sep 16 05:08:03.788024 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:08:03.788007    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93\": container with ID starting with d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93 not found: ID does not exist" containerID="d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93"
Sep 16 05:08:03.788081 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.788034    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93"} err="failed to get container status \"d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93\": rpc error: code = NotFound desc = could not find container \"d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93\": container with ID starting with d2b527720219f45c22bd3cbe178282ca15652072c324dbc0118bdc41536c8f93 not found: ID does not exist"
Sep 16 05:08:03.794320 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.794286    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"]
Sep 16 05:08:03.798921 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.798904    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-672f57-85588487c4-j2mpj"]
Sep 16 05:08:03.808533 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.808513    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"]
Sep 16 05:08:03.811746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:03.811726    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-672f57-d4c5c7985-vltth"]
Sep 16 05:08:04.785752 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:04.785721    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b798039-f720-47a1-9a13-0ff3f1a65ec2" path="/var/lib/kubelet/pods/0b798039-f720-47a1-9a13-0ff3f1a65ec2/volumes"
Sep 16 05:08:04.786116 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:04.786101    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23f6446f-ed4f-4964-951c-c490aa269e7c" path="/var/lib/kubelet/pods/23f6446f-ed4f-4964-951c-c490aa269e7c/volumes"
Sep 16 05:08:04.786397 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:04.786385    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62021750-2306-4693-9642-a624e126c44a" path="/var/lib/kubelet/pods/62021750-2306-4693-9642-a624e126c44a/volumes"
Sep 16 05:08:10.724445 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.724415    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"]
Sep 16 05:08:10.724863 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.724849    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f6446f-ed4f-4964-951c-c490aa269e7c" containerName="payload-processing"
Sep 16 05:08:10.724916 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.724865    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f6446f-ed4f-4964-951c-c490aa269e7c" containerName="payload-processing"
Sep 16 05:08:10.724916 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.724878    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62021750-2306-4693-9642-a624e126c44a" containerName="revoke-keys"
Sep 16 05:08:10.724916 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.724884    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="62021750-2306-4693-9642-a624e126c44a" containerName="revoke-keys"
Sep 16 05:08:10.724916 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.724891    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b798039-f720-47a1-9a13-0ff3f1a65ec2" containerName="payload-pre-processing"
Sep 16 05:08:10.724916 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.724896    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b798039-f720-47a1-9a13-0ff3f1a65ec2" containerName="payload-pre-processing"
Sep 16 05:08:10.724916 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.724910    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa307658-fa30-4885-a09c-20d227d430aa" containerName="payload-pre-processing"
Sep 16 05:08:10.724916 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.724916    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa307658-fa30-4885-a09c-20d227d430aa" containerName="payload-pre-processing"
Sep 16 05:08:10.725135 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.724927    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f34d6521-249e-4aff-8039-847cb54276a9" containerName="payload-processing"
Sep 16 05:08:10.725135 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.724932    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f34d6521-249e-4aff-8039-847cb54276a9" containerName="payload-processing"
Sep 16 05:08:10.725135 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.725008    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa307658-fa30-4885-a09c-20d227d430aa" containerName="payload-pre-processing"
Sep 16 05:08:10.725135 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.725015    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f34d6521-249e-4aff-8039-847cb54276a9" containerName="payload-processing"
Sep 16 05:08:10.725135 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.725022    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="62021750-2306-4693-9642-a624e126c44a" containerName="revoke-keys"
Sep 16 05:08:10.725135 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.725030    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="23f6446f-ed4f-4964-951c-c490aa269e7c" containerName="payload-processing"
Sep 16 05:08:10.725135 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.725036    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b798039-f720-47a1-9a13-0ff3f1a65ec2" containerName="payload-pre-processing"
Sep 16 05:08:10.729300 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.729282    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.731205 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.731184    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-748b01-openshift-default-dockercfg-5whlt\""
Sep 16 05:08:10.741836 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.741814    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"]
Sep 16 05:08:10.799751 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.799720    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-podinfo\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.799892 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.799782    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-socket\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.799892 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.799829    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-data\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.799892 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.799859    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-certs\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.799892 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.799879    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-envoy\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.800125 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.799916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-token\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.800125 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.799966    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-credential-socket\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.800125 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.800023    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istiod-ca-cert\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.800125 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.800094    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7274\" (UniqueName: \"kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-kube-api-access-d7274\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.901957 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.901925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-podinfo\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.902774 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.902752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-socket\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.903472 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.903451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-data\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.903659 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.903640    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-certs\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.903851 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.903834    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-envoy\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.904097 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.904070    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-certs\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.904209 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.904088    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-token\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.904404 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.904388    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-credential-socket\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.904866 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.904838    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-credential-socket\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.904966 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.903395    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-socket\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.904966 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.904846    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istiod-ca-cert\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.904966 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.904948    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7274\" (UniqueName: \"kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-kube-api-access-d7274\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.905135 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.904457    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-data\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.909156 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.907887    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-envoy\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.909156 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.907961    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-podinfo\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.909156 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.908062    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istiod-ca-cert\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.921499 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.914546    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-token\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:10.921499 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:10.915176    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7274\" (UniqueName: \"kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-kube-api-access-d7274\") pod \"e2e-noten-748b01-openshift-default-79b7987c64-dgc9w\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") " pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:11.040369 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:11.040300    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:11.321098 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:11.321075    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"]
Sep 16 05:08:11.322825 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:08:11.322798    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da7cd6d_75e1_424e_9c03_4db505e5f43e.slice/crio-769c2e607407d327899afbee101f21d7ddbd6f7fcbfcce2082fffad99514d1fb WatchSource:0}: Error finding container 769c2e607407d327899afbee101f21d7ddbd6f7fcbfcce2082fffad99514d1fb: Status 404 returned error can't find the container with id 769c2e607407d327899afbee101f21d7ddbd6f7fcbfcce2082fffad99514d1fb
Sep 16 05:08:11.325135 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:11.325093    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:08:11.325204 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:11.325185    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:08:11.325258 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:11.325239    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:08:11.827406 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:11.827365    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w" event={"ID":"0da7cd6d-75e1-424e-9c03-4db505e5f43e","Type":"ContainerStarted","Data":"7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c"}
Sep 16 05:08:11.827794 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:11.827453    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w" event={"ID":"0da7cd6d-75e1-424e-9c03-4db505e5f43e","Type":"ContainerStarted","Data":"769c2e607407d327899afbee101f21d7ddbd6f7fcbfcce2082fffad99514d1fb"}
Sep 16 05:08:11.856512 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:11.856450    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w" podStartSLOduration=1.856434994 podStartE2EDuration="1.856434994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:08:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:08:11.854959666 +0000 UTC m=+1145.516138843" watchObservedRunningTime="2026-09-16 05:08:11.856434994 +0000 UTC m=+1145.517614170"
Sep 16 05:08:12.041525 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:12.041459    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:12.046924 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:12.046900    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:12.832159 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:12.832126    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:12.833070 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:12.833053    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:08:25.403903 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.403871    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"]
Sep 16 05:08:25.408551 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.408535    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:08:25.410740 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.410706    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-ad06de-dockercfg-kbtq8\""
Sep 16 05:08:25.410740 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.410713    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-ad06de\""
Sep 16 05:08:25.418924 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.418897    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"]
Sep 16 05:08:25.547110 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.547076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75378087-4606-400d-b58b-29ad1a484a87-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth\" (UID: \"75378087-4606-400d-b58b-29ad1a484a87\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:08:25.547300 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.547210    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf996\" (UniqueName: \"kubernetes.io/projected/75378087-4606-400d-b58b-29ad1a484a87-kube-api-access-jf996\") pod \"payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth\" (UID: \"75378087-4606-400d-b58b-29ad1a484a87\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:08:25.648332 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.648302    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf996\" (UniqueName: \"kubernetes.io/projected/75378087-4606-400d-b58b-29ad1a484a87-kube-api-access-jf996\") pod \"payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth\" (UID: \"75378087-4606-400d-b58b-29ad1a484a87\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:08:25.648470 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.648369    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75378087-4606-400d-b58b-29ad1a484a87-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth\" (UID: \"75378087-4606-400d-b58b-29ad1a484a87\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:08:25.649010 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.648992    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75378087-4606-400d-b58b-29ad1a484a87-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth\" (UID: \"75378087-4606-400d-b58b-29ad1a484a87\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:08:25.657388 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.657327    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf996\" (UniqueName: \"kubernetes.io/projected/75378087-4606-400d-b58b-29ad1a484a87-kube-api-access-jf996\") pod \"payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth\" (UID: \"75378087-4606-400d-b58b-29ad1a484a87\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:08:25.719894 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.719869    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:08:25.989110 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:25.989076    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"]
Sep 16 05:08:25.990431 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:08:25.990402    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75378087_4606_400d_b58b_29ad1a484a87.slice/crio-1acd9825e8a9a092dc02e5fc215d12224cb810cb36e7cac748bb28ce14aa8041 WatchSource:0}: Error finding container 1acd9825e8a9a092dc02e5fc215d12224cb810cb36e7cac748bb28ce14aa8041: Status 404 returned error can't find the container with id 1acd9825e8a9a092dc02e5fc215d12224cb810cb36e7cac748bb28ce14aa8041
Sep 16 05:08:26.915440 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:26.915409    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth" event={"ID":"75378087-4606-400d-b58b-29ad1a484a87","Type":"ContainerStarted","Data":"ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15"}
Sep 16 05:08:26.915820 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:26.915452    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth" event={"ID":"75378087-4606-400d-b58b-29ad1a484a87","Type":"ContainerStarted","Data":"1acd9825e8a9a092dc02e5fc215d12224cb810cb36e7cac748bb28ce14aa8041"}
Sep 16 05:08:26.915820 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:26.915523    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:08:26.931854 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:26.931805    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth" podStartSLOduration=1.931789347 podStartE2EDuration="1.931789347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:08:26.931551259 +0000 UTC m=+1160.592730450" watchObservedRunningTime="2026-09-16 05:08:26.931789347 +0000 UTC m=+1160.592968529"
Sep 16 05:08:34.937823 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:34.937731    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"]
Sep 16 05:08:37.924185 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:37.924154    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:08:49.956950 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:49.956909    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg" podUID="4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" containerName="main" containerID="cri-o://3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1" gracePeriod=45
Sep 16 05:08:50.210537 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.210451    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:08:50.288954 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.288915    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-home\") pod \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") "
Sep 16 05:08:50.289112 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.288970    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tls-certs\") pod \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") "
Sep 16 05:08:50.289112 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.289012    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-model-cache\") pod \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") "
Sep 16 05:08:50.289112 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.289077    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jz7p\" (UniqueName: \"kubernetes.io/projected/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-kube-api-access-4jz7p\") pod \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") "
Sep 16 05:08:50.289112 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.289109    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tmp-dir\") pod \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") "
Sep 16 05:08:50.289361 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.289149    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-home" (OuterVolumeSpecName: "home") pod "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" (UID: "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:08:50.289361 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.289250    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-dshm\") pod \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\" (UID: \"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023\") "
Sep 16 05:08:50.289466 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.289374    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" (UID: "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:08:50.289466 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.289390    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" (UID: "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:08:50.289691 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.289673    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-home\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:08:50.289787 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.289695    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-model-cache\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:08:50.289787 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.289711    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tmp-dir\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:08:50.291452 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.291428    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-dshm" (OuterVolumeSpecName: "dshm") pod "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" (UID: "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:08:50.291763 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.291746    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" (UID: "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 05:08:50.291833 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.291755    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-kube-api-access-4jz7p" (OuterVolumeSpecName: "kube-api-access-4jz7p") pod "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" (UID: "4b6bc15d-48a2-496d-94b4-7ebd3f3ee023"). InnerVolumeSpecName "kube-api-access-4jz7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:08:50.390895 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.390864    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-dshm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:08:50.390895 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.390894    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-tls-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:08:50.391035 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:50.390906    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jz7p\" (UniqueName: \"kubernetes.io/projected/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023-kube-api-access-4jz7p\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:08:51.054451 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:51.054364    2559 generic.go:356] "Generic (PLEG): container finished" podID="4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" containerID="3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1" exitCode=0
Sep 16 05:08:51.054451 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:51.054417    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"
Sep 16 05:08:51.054451 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:51.054437    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg" event={"ID":"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023","Type":"ContainerDied","Data":"3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1"}
Sep 16 05:08:51.055034 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:51.054506    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg" event={"ID":"4b6bc15d-48a2-496d-94b4-7ebd3f3ee023","Type":"ContainerDied","Data":"6fb07b66595669ccaabb1c62ee3e30735ce01f1188e163af1ce64003856bce62"}
Sep 16 05:08:51.055034 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:51.054529    2559 scope.go:117] "RemoveContainer" containerID="3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1"
Sep 16 05:08:51.068978 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:51.068837    2559 scope.go:117] "RemoveContainer" containerID="3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1"
Sep 16 05:08:51.070066 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:08:51.070026    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1\": container with ID starting with 3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1 not found: ID does not exist" containerID="3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1"
Sep 16 05:08:51.070176 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:51.070074    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1"} err="failed to get container status \"3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1\": rpc error: code = NotFound desc = could not find container \"3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1\": container with ID starting with 3a9b297b782ea027922b3440b3449f62a192f67bf86127c2a969b407aaba24d1 not found: ID does not exist"
Sep 16 05:08:51.070353 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:51.070335    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"]
Sep 16 05:08:51.073400 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:51.073376    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c05179/test-model-c05179-kserve-597c784b99-g9cgg"]
Sep 16 05:08:52.322508 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.322452    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"]
Sep 16 05:08:52.322961 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.322944    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" containerName="main"
Sep 16 05:08:52.322961 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.322961    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" containerName="main"
Sep 16 05:08:52.323097 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.323081    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" containerName="main"
Sep 16 05:08:52.326445 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.326420    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.329322 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.329300    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-2ee234-openshift-default-dockercfg-265bm\""
Sep 16 05:08:52.341345 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.341321    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"]
Sep 16 05:08:52.408277 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.408245    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-socket\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.408413 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.408313    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-credential-socket\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.408413 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.408365    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-podinfo\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.408575 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.408412    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51c7f832-81bd-49cc-b065-3d37e1a3b654-istiod-ca-cert\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.408575 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.408442    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-certs\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.408575 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.408467    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-token\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.408575 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.408553    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-envoy\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.408787 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.408576    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-data\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.408787 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.408643    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfrn8\" (UniqueName: \"kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-kube-api-access-kfrn8\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.509907 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.509871    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-envoy\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.509907 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.509906    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-data\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.510144 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.509950    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfrn8\" (UniqueName: \"kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-kube-api-access-kfrn8\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.510144 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.509974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-socket\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.510144 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.510005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-credential-socket\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.510144 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.510133    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-podinfo\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.510346 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.510199    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51c7f832-81bd-49cc-b065-3d37e1a3b654-istiod-ca-cert\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.510346 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.510255    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-certs\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.510346 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.510300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-token\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.510516 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.510347    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-data\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.510946 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.510926    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-credential-socket\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.511018 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.510926    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51c7f832-81bd-49cc-b065-3d37e1a3b654-istiod-ca-cert\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.511074 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.511052    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-socket\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.511300 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.511279    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-certs\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.512351 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.512330    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-envoy\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.512744 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.512726    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-podinfo\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.518341 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.518313    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-token\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.518471 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.518455    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfrn8\" (UniqueName: \"kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-kube-api-access-kfrn8\") pod \"e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") " pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.638627 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.638284    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:52.786002 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.785967    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b6bc15d-48a2-496d-94b4-7ebd3f3ee023" path="/var/lib/kubelet/pods/4b6bc15d-48a2-496d-94b4-7ebd3f3ee023/volumes"
Sep 16 05:08:52.915803 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.915766    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"]
Sep 16 05:08:52.918082 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:08:52.918053    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c7f832_81bd_49cc_b065_3d37e1a3b654.slice/crio-ed663e2b5aae8e218a88f629114450f65b6679e5122c47e4c69881331c987188 WatchSource:0}: Error finding container ed663e2b5aae8e218a88f629114450f65b6679e5122c47e4c69881331c987188: Status 404 returned error can't find the container with id ed663e2b5aae8e218a88f629114450f65b6679e5122c47e4c69881331c987188
Sep 16 05:08:52.920257 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.920225    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:08:52.920323 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.920288    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:08:52.920323 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:52.920319    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:08:53.070360 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:53.070327    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" event={"ID":"51c7f832-81bd-49cc-b065-3d37e1a3b654","Type":"ContainerStarted","Data":"83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6"}
Sep 16 05:08:53.070573 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:53.070391    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" event={"ID":"51c7f832-81bd-49cc-b065-3d37e1a3b654","Type":"ContainerStarted","Data":"ed663e2b5aae8e218a88f629114450f65b6679e5122c47e4c69881331c987188"}
Sep 16 05:08:53.091206 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:53.091147    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" podStartSLOduration=1.091127367 podStartE2EDuration="1.091127367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:08:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:08:53.087731711 +0000 UTC m=+1186.748910887" watchObservedRunningTime="2026-09-16 05:08:53.091127367 +0000 UTC m=+1186.752306544"
Sep 16 05:08:53.639813 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:53.639783    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:53.644793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:53.644766    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:54.076973 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:54.076939    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:08:54.077994 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:08:54.077973    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:09:00.091411 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.091380    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"]
Sep 16 05:09:00.095437 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.095420    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:09:00.098670 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.098643    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-2ee234\""
Sep 16 05:09:00.100695 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.100674    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-2ee234-dockercfg-46gmt\""
Sep 16 05:09:00.106801 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.106777    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"]
Sep 16 05:09:00.134158 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.134123    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"]
Sep 16 05:09:00.137790 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.137768    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:09:00.151379 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.151357    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"]
Sep 16 05:09:00.188373 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.188123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1df1b292-2cef-4bf2-8831-b74262f8d1cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn\" (UID: \"1df1b292-2cef-4bf2-8831-b74262f8d1cb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:09:00.188373 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.188278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdxmf\" (UniqueName: \"kubernetes.io/projected/1df1b292-2cef-4bf2-8831-b74262f8d1cb-kube-api-access-xdxmf\") pod \"payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn\" (UID: \"1df1b292-2cef-4bf2-8831-b74262f8d1cb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:09:00.289409 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.289371    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdxmf\" (UniqueName: \"kubernetes.io/projected/1df1b292-2cef-4bf2-8831-b74262f8d1cb-kube-api-access-xdxmf\") pod \"payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn\" (UID: \"1df1b292-2cef-4bf2-8831-b74262f8d1cb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:09:00.289409 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.289415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec449e7-94d2-4578-aa15-36eaa4237a81-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n\" (UID: \"9ec449e7-94d2-4578-aa15-36eaa4237a81\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:09:00.289720 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.289522    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1df1b292-2cef-4bf2-8831-b74262f8d1cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn\" (UID: \"1df1b292-2cef-4bf2-8831-b74262f8d1cb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:09:00.289720 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.289563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r698j\" (UniqueName: \"kubernetes.io/projected/9ec449e7-94d2-4578-aa15-36eaa4237a81-kube-api-access-r698j\") pod \"payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n\" (UID: \"9ec449e7-94d2-4578-aa15-36eaa4237a81\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:09:00.290258 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.290236    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1df1b292-2cef-4bf2-8831-b74262f8d1cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn\" (UID: \"1df1b292-2cef-4bf2-8831-b74262f8d1cb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:09:00.297021 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.296999    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdxmf\" (UniqueName: \"kubernetes.io/projected/1df1b292-2cef-4bf2-8831-b74262f8d1cb-kube-api-access-xdxmf\") pod \"payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn\" (UID: \"1df1b292-2cef-4bf2-8831-b74262f8d1cb\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:09:00.390773 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.390710    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r698j\" (UniqueName: \"kubernetes.io/projected/9ec449e7-94d2-4578-aa15-36eaa4237a81-kube-api-access-r698j\") pod \"payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n\" (UID: \"9ec449e7-94d2-4578-aa15-36eaa4237a81\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:09:00.390875 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.390783    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec449e7-94d2-4578-aa15-36eaa4237a81-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n\" (UID: \"9ec449e7-94d2-4578-aa15-36eaa4237a81\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:09:00.391445 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.391423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec449e7-94d2-4578-aa15-36eaa4237a81-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n\" (UID: \"9ec449e7-94d2-4578-aa15-36eaa4237a81\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:09:00.398090 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.398073    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r698j\" (UniqueName: \"kubernetes.io/projected/9ec449e7-94d2-4578-aa15-36eaa4237a81-kube-api-access-r698j\") pod \"payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n\" (UID: \"9ec449e7-94d2-4578-aa15-36eaa4237a81\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:09:00.406892 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.406874    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:09:00.447630 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.447599    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:09:00.679738 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.679711    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"]
Sep 16 05:09:00.680796 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:09:00.680769    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df1b292_2cef_4bf2_8831_b74262f8d1cb.slice/crio-cdc8449a4c166c5b783dab2c0e23f0a66af68329026a06b1875d859b92390d20 WatchSource:0}: Error finding container cdc8449a4c166c5b783dab2c0e23f0a66af68329026a06b1875d859b92390d20: Status 404 returned error can't find the container with id cdc8449a4c166c5b783dab2c0e23f0a66af68329026a06b1875d859b92390d20
Sep 16 05:09:00.729283 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:00.729257    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"]
Sep 16 05:09:00.733556 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:09:00.733530    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec449e7_94d2_4578_aa15_36eaa4237a81.slice/crio-6185079d3fa610f9abab93c4ed5a082d6adafae33e47b1c4f7e2382d2b11686f WatchSource:0}: Error finding container 6185079d3fa610f9abab93c4ed5a082d6adafae33e47b1c4f7e2382d2b11686f: Status 404 returned error can't find the container with id 6185079d3fa610f9abab93c4ed5a082d6adafae33e47b1c4f7e2382d2b11686f
Sep 16 05:09:01.120880 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:01.120840    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn" event={"ID":"1df1b292-2cef-4bf2-8831-b74262f8d1cb","Type":"ContainerStarted","Data":"83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43"}
Sep 16 05:09:01.121313 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:01.120971    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:09:01.121313 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:01.120996    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn" event={"ID":"1df1b292-2cef-4bf2-8831-b74262f8d1cb","Type":"ContainerStarted","Data":"cdc8449a4c166c5b783dab2c0e23f0a66af68329026a06b1875d859b92390d20"}
Sep 16 05:09:01.122470 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:01.122441    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n" event={"ID":"9ec449e7-94d2-4578-aa15-36eaa4237a81","Type":"ContainerStarted","Data":"027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf"}
Sep 16 05:09:01.122623 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:01.122529    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:09:01.122623 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:01.122552    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n" event={"ID":"9ec449e7-94d2-4578-aa15-36eaa4237a81","Type":"ContainerStarted","Data":"6185079d3fa610f9abab93c4ed5a082d6adafae33e47b1c4f7e2382d2b11686f"}
Sep 16 05:09:01.137719 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:01.137677    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn" podStartSLOduration=1.137660022 podStartE2EDuration="1.137660022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:09:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:09:01.136524534 +0000 UTC m=+1194.797703897" watchObservedRunningTime="2026-09-16 05:09:01.137660022 +0000 UTC m=+1194.798839199"
Sep 16 05:09:01.157440 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:01.157399    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n" podStartSLOduration=1.157385806 podStartE2EDuration="1.157385806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:09:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:09:01.155942277 +0000 UTC m=+1194.817121455" watchObservedRunningTime="2026-09-16 05:09:01.157385806 +0000 UTC m=+1194.818564983"
Sep 16 05:09:05.832102 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:05.832070    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"]
Sep 16 05:09:05.835772 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:05.835757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"
Sep 16 05:09:05.837536 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:05.837512    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:09:05.844585 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:05.842898    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"]
Sep 16 05:09:05.941981 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:05.941952    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0181bc5e-0674-4f1e-803e-1615b30cea1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c05179-rkt56\" (UID: \"0181bc5e-0674-4f1e-803e-1615b30cea1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"
Sep 16 05:09:06.043464 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:06.043438    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0181bc5e-0674-4f1e-803e-1615b30cea1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c05179-rkt56\" (UID: \"0181bc5e-0674-4f1e-803e-1615b30cea1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"
Sep 16 05:09:06.044015 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:06.043996    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0181bc5e-0674-4f1e-803e-1615b30cea1f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c05179-rkt56\" (UID: \"0181bc5e-0674-4f1e-803e-1615b30cea1f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"
Sep 16 05:09:06.172393 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:06.172327    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"
Sep 16 05:09:06.452406 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:06.452380    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"]
Sep 16 05:09:06.453897 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:09:06.453868    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0181bc5e_0674_4f1e_803e_1615b30cea1f.slice/crio-ef93b424d8d8f19f048553b13ce7ce6d9ae401e58220e346a6b1eddf3d9a3512 WatchSource:0}: Error finding container ef93b424d8d8f19f048553b13ce7ce6d9ae401e58220e346a6b1eddf3d9a3512: Status 404 returned error can't find the container with id ef93b424d8d8f19f048553b13ce7ce6d9ae401e58220e346a6b1eddf3d9a3512
Sep 16 05:09:07.158435 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:07.158392    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56" event={"ID":"0181bc5e-0674-4f1e-803e-1615b30cea1f","Type":"ContainerStarted","Data":"1ea45e78fd4a29b08abc6ecb12e40e0e5438cec1512f3b69283a3d540f643e4b"}
Sep 16 05:09:07.158884 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:07.158457    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56" event={"ID":"0181bc5e-0674-4f1e-803e-1615b30cea1f","Type":"ContainerStarted","Data":"ef93b424d8d8f19f048553b13ce7ce6d9ae401e58220e346a6b1eddf3d9a3512"}
Sep 16 05:09:07.178964 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:07.178919    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56" podStartSLOduration=2.178906461 podStartE2EDuration="2.178906461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:09:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:09:07.178134417 +0000 UTC m=+1200.839313593" watchObservedRunningTime="2026-09-16 05:09:07.178906461 +0000 UTC m=+1200.840085637"
Sep 16 05:09:08.166132 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:08.166092    2559 generic.go:356] "Generic (PLEG): container finished" podID="0181bc5e-0674-4f1e-803e-1615b30cea1f" containerID="1ea45e78fd4a29b08abc6ecb12e40e0e5438cec1512f3b69283a3d540f643e4b" exitCode=0
Sep 16 05:09:08.166582 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:08.166214    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56" event={"ID":"0181bc5e-0674-4f1e-803e-1615b30cea1f","Type":"ContainerDied","Data":"1ea45e78fd4a29b08abc6ecb12e40e0e5438cec1512f3b69283a3d540f643e4b"}
Sep 16 05:09:09.316743 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:09.316716    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"
Sep 16 05:09:09.379524 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:09.379492    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0181bc5e-0674-4f1e-803e-1615b30cea1f-maas-api-service-ca\") pod \"0181bc5e-0674-4f1e-803e-1615b30cea1f\" (UID: \"0181bc5e-0674-4f1e-803e-1615b30cea1f\") "
Sep 16 05:09:09.379856 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:09.379833    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0181bc5e-0674-4f1e-803e-1615b30cea1f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0181bc5e-0674-4f1e-803e-1615b30cea1f" (UID: "0181bc5e-0674-4f1e-803e-1615b30cea1f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:09:09.480782 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:09.480759    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0181bc5e-0674-4f1e-803e-1615b30cea1f-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:10.178663 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:10.178634    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"
Sep 16 05:09:10.178869 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:10.178674    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56" event={"ID":"0181bc5e-0674-4f1e-803e-1615b30cea1f","Type":"ContainerDied","Data":"ef93b424d8d8f19f048553b13ce7ce6d9ae401e58220e346a6b1eddf3d9a3512"}
Sep 16 05:09:10.178869 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:10.178720    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef93b424d8d8f19f048553b13ce7ce6d9ae401e58220e346a6b1eddf3d9a3512"
Sep 16 05:09:12.130184 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:12.130150    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:09:12.130599 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:12.130223    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:09:17.640118 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:17.640073    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"]
Sep 16 05:09:17.640595 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:17.640338    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb" podUID="1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d" containerName="payload-pre-processing" containerID="cri-o://963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1" gracePeriod=30
Sep 16 05:09:17.823235 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:17.823199    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"]
Sep 16 05:09:17.828178 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:17.828121    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c05179-rkt56"]
Sep 16 05:09:17.997987 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:17.997687    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:09:18.065741 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.065713    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-plugins-config-volume\") pod \"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d\" (UID: \"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d\") "
Sep 16 05:09:18.065913 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.065806    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkd86\" (UniqueName: \"kubernetes.io/projected/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-kube-api-access-bkd86\") pod \"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d\" (UID: \"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d\") "
Sep 16 05:09:18.066123 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.066095    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d" (UID: "1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:09:18.066214 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.066200    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:18.067916 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.067894    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-kube-api-access-bkd86" (OuterVolumeSpecName: "kube-api-access-bkd86") pod "1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d" (UID: "1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d"). InnerVolumeSpecName "kube-api-access-bkd86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:09:18.166899 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.166864    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkd86\" (UniqueName: \"kubernetes.io/projected/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d-kube-api-access-bkd86\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:18.236204 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.236165    2559 generic.go:356] "Generic (PLEG): container finished" podID="1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d" containerID="963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1" exitCode=0
Sep 16 05:09:18.236368 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.236273    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"
Sep 16 05:09:18.236368 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.236303    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb" event={"ID":"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d","Type":"ContainerDied","Data":"963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1"}
Sep 16 05:09:18.236368 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.236360    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb" event={"ID":"1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d","Type":"ContainerDied","Data":"04c8af8653bfc640c8c400ed142a7eb2fcbc1095e3485135ff622974056c16d1"}
Sep 16 05:09:18.236624 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.236382    2559 scope.go:117] "RemoveContainer" containerID="963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1"
Sep 16 05:09:18.247533 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.247506    2559 scope.go:117] "RemoveContainer" containerID="963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1"
Sep 16 05:09:18.247818 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:09:18.247800    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1\": container with ID starting with 963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1 not found: ID does not exist" containerID="963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1"
Sep 16 05:09:18.247868 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.247826    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1"} err="failed to get container status \"963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1\": rpc error: code = NotFound desc = could not find container \"963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1\": container with ID starting with 963351996c4d72d88d99300b60472f0b6f4ec44924d660cbea54617d91cf23f1 not found: ID does not exist"
Sep 16 05:09:18.265239 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.265204    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"]
Sep 16 05:09:18.283111 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.283084    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c05179-6445f54878-78jfb"]
Sep 16 05:09:18.786733 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.786698    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0181bc5e-0674-4f1e-803e-1615b30cea1f" path="/var/lib/kubelet/pods/0181bc5e-0674-4f1e-803e-1615b30cea1f/volumes"
Sep 16 05:09:18.787095 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:18.787062    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d" path="/var/lib/kubelet/pods/1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d/volumes"
Sep 16 05:09:24.384306 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.384273    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"]
Sep 16 05:09:24.384722 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.384506    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy" containerID="cri-o://c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739" gracePeriod=30
Sep 16 05:09:24.752505 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.751437    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"]
Sep 16 05:09:24.752505 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.752218    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d" containerName="payload-pre-processing"
Sep 16 05:09:24.752505 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.752239    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d" containerName="payload-pre-processing"
Sep 16 05:09:24.752505 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.752297    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0181bc5e-0674-4f1e-803e-1615b30cea1f" containerName="revoke-keys"
Sep 16 05:09:24.752505 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.752307    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0181bc5e-0674-4f1e-803e-1615b30cea1f" containerName="revoke-keys"
Sep 16 05:09:24.752505 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.752435    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0181bc5e-0674-4f1e-803e-1615b30cea1f" containerName="revoke-keys"
Sep 16 05:09:24.752505 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.752456    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c2b64f9-a4c1-4fdb-a70e-73baa528fc3d" containerName="payload-pre-processing"
Sep 16 05:09:24.757427 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.757406    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"
Sep 16 05:09:24.759854 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.759698    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:09:24.763591 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.763567    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"]
Sep 16 05:09:24.770740 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.770551    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"]
Sep 16 05:09:24.770740 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.770671    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.775431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.775240    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-766a69c0-openshift-default-dockercfg-6jj76\""
Sep 16 05:09:24.794900 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.794870    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"]
Sep 16 05:09:24.842775 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.842742    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgztw\" (UniqueName: \"kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-kube-api-access-zgztw\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.842913 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.842831    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-certs\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.842913 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.842855    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-envoy\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.842913 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.842885    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/931cd88b-8b83-437a-a40d-d304ff616418-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n\" (UID: \"931cd88b-8b83-437a-a40d-d304ff616418\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"
Sep 16 05:09:24.842913 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.842908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-data\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.843041 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.842923    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f004522-7255-4dd8-a348-bcea5fe4b289-istiod-ca-cert\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.843041 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.842958    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-token\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.843041 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.843011    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-podinfo\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.843041 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.843033    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-socket\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.843157 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.843062    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-credential-socket\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.944630 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.944598    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-certs\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.944630 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.944635    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-envoy\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.944869 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.944659    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/931cd88b-8b83-437a-a40d-d304ff616418-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n\" (UID: \"931cd88b-8b83-437a-a40d-d304ff616418\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"
Sep 16 05:09:24.944869 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.944782    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-data\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.944869 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.944812    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f004522-7255-4dd8-a348-bcea5fe4b289-istiod-ca-cert\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.944869 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.944848    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-token\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.945084 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.944897    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-podinfo\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.945084 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.944930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-socket\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.945084 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.945048    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-credential-socket\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.945244 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.945092    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-certs\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.945244 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.945176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgztw\" (UniqueName: \"kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-kube-api-access-zgztw\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.945453 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.945423    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/931cd88b-8b83-437a-a40d-d304ff616418-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n\" (UID: \"931cd88b-8b83-437a-a40d-d304ff616418\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"
Sep 16 05:09:24.945579 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.945524    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f004522-7255-4dd8-a348-bcea5fe4b289-istiod-ca-cert\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.945790 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.945766    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-data\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.945910 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.945855    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-credential-socket\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.946092 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.946011    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-socket\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.947466 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.947442    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-envoy\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.947775 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.947757    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-podinfo\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.954159 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.954133    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-token\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:24.954591 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:24.954573    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgztw\" (UniqueName: \"kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-kube-api-access-zgztw\") pod \"e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") " pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:25.073861 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:25.073788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"
Sep 16 05:09:25.091823 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:25.091791    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:25.118740 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:25.118704    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 05:09:25.118874 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:25.118771    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 05:09:25.358672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:25.358645    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"]
Sep 16 05:09:25.360111 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:09:25.360082    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod931cd88b_8b83_437a_a40d_d304ff616418.slice/crio-a5557f53756d03dc2ce33cc30599f59126792bc00037052fbc480c1f5f2c2f0a WatchSource:0}: Error finding container a5557f53756d03dc2ce33cc30599f59126792bc00037052fbc480c1f5f2c2f0a: Status 404 returned error can't find the container with id a5557f53756d03dc2ce33cc30599f59126792bc00037052fbc480c1f5f2c2f0a
Sep 16 05:09:25.401969 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:25.401946    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"]
Sep 16 05:09:25.404378 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:09:25.404355    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f004522_7255_4dd8_a348_bcea5fe4b289.slice/crio-d5f43db701bf8e47515a54d92475b593b30c4d03ee8b590ef98d1ddcb0b46ce1 WatchSource:0}: Error finding container d5f43db701bf8e47515a54d92475b593b30c4d03ee8b590ef98d1ddcb0b46ce1: Status 404 returned error can't find the container with id d5f43db701bf8e47515a54d92475b593b30c4d03ee8b590ef98d1ddcb0b46ce1
Sep 16 05:09:25.407230 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:25.407188    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:09:25.407328 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:25.407255    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:09:25.407328 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:25.407285    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:09:26.293790 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.293748    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" event={"ID":"2f004522-7255-4dd8-a348-bcea5fe4b289","Type":"ContainerStarted","Data":"a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5"}
Sep 16 05:09:26.293993 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.293843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" event={"ID":"2f004522-7255-4dd8-a348-bcea5fe4b289","Type":"ContainerStarted","Data":"d5f43db701bf8e47515a54d92475b593b30c4d03ee8b590ef98d1ddcb0b46ce1"}
Sep 16 05:09:26.295597 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.295565    2559 generic.go:356] "Generic (PLEG): container finished" podID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerID="83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6" exitCode=0
Sep 16 05:09:26.295697 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.295642    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" event={"ID":"51c7f832-81bd-49cc-b065-3d37e1a3b654","Type":"ContainerDied","Data":"83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6"}
Sep 16 05:09:26.296093 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.296077    2559 scope.go:117] "RemoveContainer" containerID="83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6"
Sep 16 05:09:26.297262 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.297239    2559 generic.go:356] "Generic (PLEG): container finished" podID="931cd88b-8b83-437a-a40d-d304ff616418" containerID="9a2452560dd5047e84fbbea3d36fa7536a7c50f2e092b770bdf31f57eb21eda9" exitCode=0
Sep 16 05:09:26.297352 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.297314    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:09:26.297394 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.297382    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:09:26.297427 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.297414    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:09:26.297460 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.297316    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n" event={"ID":"931cd88b-8b83-437a-a40d-d304ff616418","Type":"ContainerDied","Data":"9a2452560dd5047e84fbbea3d36fa7536a7c50f2e092b770bdf31f57eb21eda9"}
Sep 16 05:09:26.297524 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.297467    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n" event={"ID":"931cd88b-8b83-437a-a40d-d304ff616418","Type":"ContainerStarted","Data":"a5557f53756d03dc2ce33cc30599f59126792bc00037052fbc480c1f5f2c2f0a"}
Sep 16 05:09:26.347009 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:26.346967    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" podStartSLOduration=2.346954066 podStartE2EDuration="2.346954066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:09:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:09:26.328377163 +0000 UTC m=+1219.989556341" watchObservedRunningTime="2026-09-16 05:09:26.346954066 +0000 UTC m=+1220.008133241"
Sep 16 05:09:27.092041 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.092010    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:27.097778 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.097753    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:27.310129 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.310083    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" event={"ID":"51c7f832-81bd-49cc-b065-3d37e1a3b654","Type":"ContainerStarted","Data":"57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c"}
Sep 16 05:09:27.311161 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.311136    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:27.315598 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.315576    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:09:27.494548 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.493854    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"
Sep 16 05:09:27.577077 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.577050    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/931cd88b-8b83-437a-a40d-d304ff616418-maas-api-service-ca\") pod \"931cd88b-8b83-437a-a40d-d304ff616418\" (UID: \"931cd88b-8b83-437a-a40d-d304ff616418\") "
Sep 16 05:09:27.577431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.577407    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/931cd88b-8b83-437a-a40d-d304ff616418-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "931cd88b-8b83-437a-a40d-d304ff616418" (UID: "931cd88b-8b83-437a-a40d-d304ff616418"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:09:27.577555 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.577541    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/931cd88b-8b83-437a-a40d-d304ff616418-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:27.639051 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.638973    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:09:27.639188 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.639151    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 05:09:27.639228 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:27.639194    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 05:09:28.320401 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:28.320371    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"
Sep 16 05:09:28.320828 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:28.320412    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n" event={"ID":"931cd88b-8b83-437a-a40d-d304ff616418","Type":"ContainerDied","Data":"a5557f53756d03dc2ce33cc30599f59126792bc00037052fbc480c1f5f2c2f0a"}
Sep 16 05:09:28.320828 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:28.320463    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5557f53756d03dc2ce33cc30599f59126792bc00037052fbc480c1f5f2c2f0a"
Sep 16 05:09:28.640722 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:28.640623    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 05:09:28.640722 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:28.640698    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 05:09:29.639394 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.639359    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 05:09:29.639857 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.639422    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 05:09:29.676424 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.676398    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:09:29.821617 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821587    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-data\") pod \"b8510fd0-50d4-496e-975c-463bc585f7eb\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") "
Sep 16 05:09:29.821617 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821622    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-certs\") pod \"b8510fd0-50d4-496e-975c-463bc585f7eb\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") "
Sep 16 05:09:29.821846 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821649    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-socket\") pod \"b8510fd0-50d4-496e-975c-463bc585f7eb\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") "
Sep 16 05:09:29.821846 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821672    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnk9x\" (UniqueName: \"kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-kube-api-access-vnk9x\") pod \"b8510fd0-50d4-496e-975c-463bc585f7eb\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") "
Sep 16 05:09:29.821846 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821699    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-podinfo\") pod \"b8510fd0-50d4-496e-975c-463bc585f7eb\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") "
Sep 16 05:09:29.821846 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8510fd0-50d4-496e-975c-463bc585f7eb-istiod-ca-cert\") pod \"b8510fd0-50d4-496e-975c-463bc585f7eb\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") "
Sep 16 05:09:29.821846 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821793    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-token\") pod \"b8510fd0-50d4-496e-975c-463bc585f7eb\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") "
Sep 16 05:09:29.821846 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821814    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-envoy\") pod \"b8510fd0-50d4-496e-975c-463bc585f7eb\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") "
Sep 16 05:09:29.821846 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821833    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8510fd0-50d4-496e-975c-463bc585f7eb" (UID: "b8510fd0-50d4-496e-975c-463bc585f7eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:29.822200 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821852    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8510fd0-50d4-496e-975c-463bc585f7eb" (UID: "b8510fd0-50d4-496e-975c-463bc585f7eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:29.822200 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821885    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-credential-socket\") pod \"b8510fd0-50d4-496e-975c-463bc585f7eb\" (UID: \"b8510fd0-50d4-496e-975c-463bc585f7eb\") "
Sep 16 05:09:29.822200 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.821873    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8510fd0-50d4-496e-975c-463bc585f7eb" (UID: "b8510fd0-50d4-496e-975c-463bc585f7eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:29.822200 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.822106    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8510fd0-50d4-496e-975c-463bc585f7eb" (UID: "b8510fd0-50d4-496e-975c-463bc585f7eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:29.822200 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.822193    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8510fd0-50d4-496e-975c-463bc585f7eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8510fd0-50d4-496e-975c-463bc585f7eb" (UID: "b8510fd0-50d4-496e-975c-463bc585f7eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:09:29.822438 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.822312    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8510fd0-50d4-496e-975c-463bc585f7eb-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:29.822438 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.822332    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:29.822438 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.822346    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:29.822438 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.822360    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:29.822438 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.822372    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:29.824136 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.824089    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8510fd0-50d4-496e-975c-463bc585f7eb" (UID: "b8510fd0-50d4-496e-975c-463bc585f7eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:29.824136 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.824099    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8510fd0-50d4-496e-975c-463bc585f7eb" (UID: "b8510fd0-50d4-496e-975c-463bc585f7eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:09:29.824136 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.824102    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-kube-api-access-vnk9x" (OuterVolumeSpecName: "kube-api-access-vnk9x") pod "b8510fd0-50d4-496e-975c-463bc585f7eb" (UID: "b8510fd0-50d4-496e-975c-463bc585f7eb"). InnerVolumeSpecName "kube-api-access-vnk9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:09:29.824322 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.824303    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8510fd0-50d4-496e-975c-463bc585f7eb" (UID: "b8510fd0-50d4-496e-975c-463bc585f7eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:09:29.923446 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.923375    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:29.923446 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.923397    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:29.923446 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.923406    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8510fd0-50d4-496e-975c-463bc585f7eb-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:29.923446 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:29.923416    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnk9x\" (UniqueName: \"kubernetes.io/projected/b8510fd0-50d4-496e-975c-463bc585f7eb-kube-api-access-vnk9x\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:30.334256 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.334220    2559 generic.go:356] "Generic (PLEG): container finished" podID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerID="c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739" exitCode=0
Sep 16 05:09:30.334466 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.334322    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"
Sep 16 05:09:30.334466 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.334363    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" event={"ID":"b8510fd0-50d4-496e-975c-463bc585f7eb","Type":"ContainerDied","Data":"c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739"}
Sep 16 05:09:30.334466 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.334415    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp" event={"ID":"b8510fd0-50d4-496e-975c-463bc585f7eb","Type":"ContainerDied","Data":"e8537af0840813fc97e6ed7444d218ef0804e0616e93e1c80b9ff24b86a685e7"}
Sep 16 05:09:30.334466 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.334436    2559 scope.go:117] "RemoveContainer" containerID="c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739"
Sep 16 05:09:30.345023 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.345005    2559 scope.go:117] "RemoveContainer" containerID="fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f"
Sep 16 05:09:30.353035 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.353019    2559 scope.go:117] "RemoveContainer" containerID="c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739"
Sep 16 05:09:30.353291 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:09:30.353270    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739\": container with ID starting with c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739 not found: ID does not exist" containerID="c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739"
Sep 16 05:09:30.353351 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.353297    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739"} err="failed to get container status \"c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739\": rpc error: code = NotFound desc = could not find container \"c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739\": container with ID starting with c62a156d22f9ecbd79981993d20f749d0570ce772fef38031f1b228d73c35739 not found: ID does not exist"
Sep 16 05:09:30.353351 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.353314    2559 scope.go:117] "RemoveContainer" containerID="fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f"
Sep 16 05:09:30.353581 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:09:30.353563    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f\": container with ID starting with fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f not found: ID does not exist" containerID="fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f"
Sep 16 05:09:30.353627 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.353587    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f"} err="failed to get container status \"fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f\": rpc error: code = NotFound desc = could not find container \"fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f\": container with ID starting with fc31191f0c8038e00a203bdc40f18064e93b95fdfddbb2be868b913f07299e9f not found: ID does not exist"
Sep 16 05:09:30.359801 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.359778    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"]
Sep 16 05:09:30.371748 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.371729    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c05179-openshift-default-787bdbcb96-mzlsp"]
Sep 16 05:09:30.640172 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.640069    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 05:09:30.640172 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.640145    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 05:09:30.796952 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:30.788765    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" path="/var/lib/kubelet/pods/b8510fd0-50d4-496e-975c-463bc585f7eb/volumes"
Sep 16 05:09:31.640220 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.640185    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 16 05:09:31.640663 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.640244    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 16 05:09:31.972323 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.972251    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"]
Sep 16 05:09:31.972717 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.972703    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy"
Sep 16 05:09:31.972764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.972719    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy"
Sep 16 05:09:31.972764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.972741    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="931cd88b-8b83-437a-a40d-d304ff616418" containerName="revoke-keys"
Sep 16 05:09:31.972764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.972746    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="931cd88b-8b83-437a-a40d-d304ff616418" containerName="revoke-keys"
Sep 16 05:09:31.972764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.972754    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy"
Sep 16 05:09:31.972764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.972761    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy"
Sep 16 05:09:31.972914 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.972827    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="931cd88b-8b83-437a-a40d-d304ff616418" containerName="revoke-keys"
Sep 16 05:09:31.972914 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.972835    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy"
Sep 16 05:09:31.972914 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.972842    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8510fd0-50d4-496e-975c-463bc585f7eb" containerName="istio-proxy"
Sep 16 05:09:31.977595 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.977574    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:09:31.981329 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.981305    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-766a69c0-dockercfg-8x4kj\""
Sep 16 05:09:31.981438 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:31.981401    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-766a69c0\""
Sep 16 05:09:32.005660 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.005633    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"]
Sep 16 05:09:32.058758 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.055373    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c12e73b-5fcd-46f4-8f09-e716125d1c98-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr\" (UID: \"9c12e73b-5fcd-46f4-8f09-e716125d1c98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:09:32.058758 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.055455    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4ttt\" (UniqueName: \"kubernetes.io/projected/9c12e73b-5fcd-46f4-8f09-e716125d1c98-kube-api-access-g4ttt\") pod \"payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr\" (UID: \"9c12e73b-5fcd-46f4-8f09-e716125d1c98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:09:32.156048 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.156011    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c12e73b-5fcd-46f4-8f09-e716125d1c98-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr\" (UID: \"9c12e73b-5fcd-46f4-8f09-e716125d1c98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:09:32.156205 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.156084    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4ttt\" (UniqueName: \"kubernetes.io/projected/9c12e73b-5fcd-46f4-8f09-e716125d1c98-kube-api-access-g4ttt\") pod \"payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr\" (UID: \"9c12e73b-5fcd-46f4-8f09-e716125d1c98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:09:32.156688 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.156669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c12e73b-5fcd-46f4-8f09-e716125d1c98-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr\" (UID: \"9c12e73b-5fcd-46f4-8f09-e716125d1c98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:09:32.167880 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.167860    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4ttt\" (UniqueName: \"kubernetes.io/projected/9c12e73b-5fcd-46f4-8f09-e716125d1c98-kube-api-access-g4ttt\") pod \"payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr\" (UID: \"9c12e73b-5fcd-46f4-8f09-e716125d1c98\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:09:32.287630 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.287599    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:09:32.588799 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.588768    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"]
Sep 16 05:09:32.590028 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:09:32.589756    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c12e73b_5fcd_46f4_8f09_e716125d1c98.slice/crio-b43a4c16bf8537561b163b34d1e0ef908e3ca4d36b32fab01239bf0415cce9ac WatchSource:0}: Error finding container b43a4c16bf8537561b163b34d1e0ef908e3ca4d36b32fab01239bf0415cce9ac: Status 404 returned error can't find the container with id b43a4c16bf8537561b163b34d1e0ef908e3ca4d36b32fab01239bf0415cce9ac
Sep 16 05:09:32.642915 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.642889    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:09:32.643268 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.643216    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:09:32.644123 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:32.644102    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:09:33.365549 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:33.365502    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr" event={"ID":"9c12e73b-5fcd-46f4-8f09-e716125d1c98","Type":"ContainerStarted","Data":"4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9"}
Sep 16 05:09:33.365756 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:33.365562    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr" event={"ID":"9c12e73b-5fcd-46f4-8f09-e716125d1c98","Type":"ContainerStarted","Data":"b43a4c16bf8537561b163b34d1e0ef908e3ca4d36b32fab01239bf0415cce9ac"}
Sep 16 05:09:33.365756 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:33.365740    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:09:33.385353 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:33.385313    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr" podStartSLOduration=2.385301131 podStartE2EDuration="2.385301131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:09:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:09:33.384245871 +0000 UTC m=+1227.045425050" watchObservedRunningTime="2026-09-16 05:09:33.385301131 +0000 UTC m=+1227.046480307"
Sep 16 05:09:35.268927 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:35.268887    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"]
Sep 16 05:09:35.271648 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:35.271623    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1f291-nsg5n"]
Sep 16 05:09:36.785495 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:36.785450    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="931cd88b-8b83-437a-a40d-d304ff616418" path="/var/lib/kubelet/pods/931cd88b-8b83-437a-a40d-d304ff616418/volumes"
Sep 16 05:09:40.164599 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:40.164569    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"]
Sep 16 05:09:40.164952 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:40.164800    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w" podUID="0da7cd6d-75e1-424e-9c03-4db505e5f43e" containerName="istio-proxy" containerID="cri-o://7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c" gracePeriod=30
Sep 16 05:09:42.451231 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:42.451195    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"]
Sep 16 05:09:42.451707 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:42.451462    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy" containerID="cri-o://8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff" gracePeriod=30
Sep 16 05:09:42.835162 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:42.835124    2559 patch_prober.go:28] interesting pod/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 05:09:42.835335 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:42.835188    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w" podUID="0da7cd6d-75e1-424e-9c03-4db505e5f43e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 05:09:44.374027 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:44.373998    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:09:45.413448 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.413423    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:09:45.460739 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.460663    2559 generic.go:356] "Generic (PLEG): container finished" podID="0da7cd6d-75e1-424e-9c03-4db505e5f43e" containerID="7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c" exitCode=0
Sep 16 05:09:45.460739 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.460713    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"
Sep 16 05:09:45.460913 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.460739    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w" event={"ID":"0da7cd6d-75e1-424e-9c03-4db505e5f43e","Type":"ContainerDied","Data":"7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c"}
Sep 16 05:09:45.460913 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.460795    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w" event={"ID":"0da7cd6d-75e1-424e-9c03-4db505e5f43e","Type":"ContainerDied","Data":"769c2e607407d327899afbee101f21d7ddbd6f7fcbfcce2082fffad99514d1fb"}
Sep 16 05:09:45.460913 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.460820    2559 scope.go:117] "RemoveContainer" containerID="7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c"
Sep 16 05:09:45.470507 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.470470    2559 scope.go:117] "RemoveContainer" containerID="7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c"
Sep 16 05:09:45.470801 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:09:45.470780    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c\": container with ID starting with 7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c not found: ID does not exist" containerID="7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c"
Sep 16 05:09:45.470877 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.470813    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c"} err="failed to get container status \"7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c\": rpc error: code = NotFound desc = could not find container \"7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c\": container with ID starting with 7a2b338609864fb4199f3b7f4f244f9fdb11013a22c43de1c4a9210e32f35d3c not found: ID does not exist"
Sep 16 05:09:45.489335 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489313    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-token\") pod \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") "
Sep 16 05:09:45.489454 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489339    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istiod-ca-cert\") pod \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") "
Sep 16 05:09:45.489454 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489362    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-certs\") pod \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") "
Sep 16 05:09:45.489454 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489396    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-podinfo\") pod \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") "
Sep 16 05:09:45.489644 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489534    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-credential-socket\") pod \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") "
Sep 16 05:09:45.489644 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489573    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-envoy\") pod \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") "
Sep 16 05:09:45.489644 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489639    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7274\" (UniqueName: \"kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-kube-api-access-d7274\") pod \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") "
Sep 16 05:09:45.489803 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489670    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0da7cd6d-75e1-424e-9c03-4db505e5f43e" (UID: "0da7cd6d-75e1-424e-9c03-4db505e5f43e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:45.489803 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489725    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-socket\") pod \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") "
Sep 16 05:09:45.489803 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489750    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-data\") pod \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\" (UID: \"0da7cd6d-75e1-424e-9c03-4db505e5f43e\") "
Sep 16 05:09:45.489803 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489770    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0da7cd6d-75e1-424e-9c03-4db505e5f43e" (UID: "0da7cd6d-75e1-424e-9c03-4db505e5f43e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:09:45.490008 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.489865    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0da7cd6d-75e1-424e-9c03-4db505e5f43e" (UID: "0da7cd6d-75e1-424e-9c03-4db505e5f43e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:45.490062 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.490046    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0da7cd6d-75e1-424e-9c03-4db505e5f43e" (UID: "0da7cd6d-75e1-424e-9c03-4db505e5f43e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:45.490115 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.490061    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-data" (OuterVolumeSpecName: "istio-data") pod "0da7cd6d-75e1-424e-9c03-4db505e5f43e" (UID: "0da7cd6d-75e1-424e-9c03-4db505e5f43e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:45.490495 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.490395    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:45.490495 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.490419    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:45.490495 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.490431    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:45.490495 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.490445    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:45.490495 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.490456    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:45.492202 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.492174    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-token" (OuterVolumeSpecName: "istio-token") pod "0da7cd6d-75e1-424e-9c03-4db505e5f43e" (UID: "0da7cd6d-75e1-424e-9c03-4db505e5f43e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:09:45.492339 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.492316    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-kube-api-access-d7274" (OuterVolumeSpecName: "kube-api-access-d7274") pod "0da7cd6d-75e1-424e-9c03-4db505e5f43e" (UID: "0da7cd6d-75e1-424e-9c03-4db505e5f43e"). InnerVolumeSpecName "kube-api-access-d7274". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:09:45.492401 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.492341    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0da7cd6d-75e1-424e-9c03-4db505e5f43e" (UID: "0da7cd6d-75e1-424e-9c03-4db505e5f43e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:09:45.492457 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.492405    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0da7cd6d-75e1-424e-9c03-4db505e5f43e" (UID: "0da7cd6d-75e1-424e-9c03-4db505e5f43e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:45.591781 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.591749    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:45.591781 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.591775    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:45.591781 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.591785    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0da7cd6d-75e1-424e-9c03-4db505e5f43e-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:45.591973 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.591793    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7274\" (UniqueName: \"kubernetes.io/projected/0da7cd6d-75e1-424e-9c03-4db505e5f43e-kube-api-access-d7274\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:45.800473 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.800436    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"]
Sep 16 05:09:45.809710 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:45.809680    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-748b01-openshift-default-79b7987c64-dgc9w"]
Sep 16 05:09:46.786903 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:46.786865    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0da7cd6d-75e1-424e-9c03-4db505e5f43e" path="/var/lib/kubelet/pods/0da7cd6d-75e1-424e-9c03-4db505e5f43e/volumes"
Sep 16 05:09:47.721810 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.721751    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:09:47.815299 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815262    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64l9f\" (UniqueName: \"kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-kube-api-access-64l9f\") pod \"ef233360-7b34-4517-9e06-f7f3a64654ca\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") "
Sep 16 05:09:47.815746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815335    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-token\") pod \"ef233360-7b34-4517-9e06-f7f3a64654ca\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") "
Sep 16 05:09:47.815746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815368    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-credential-socket\") pod \"ef233360-7b34-4517-9e06-f7f3a64654ca\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") "
Sep 16 05:09:47.815746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815520    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-socket\") pod \"ef233360-7b34-4517-9e06-f7f3a64654ca\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") "
Sep 16 05:09:47.815746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815570    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-envoy\") pod \"ef233360-7b34-4517-9e06-f7f3a64654ca\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") "
Sep 16 05:09:47.815746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815602    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-podinfo\") pod \"ef233360-7b34-4517-9e06-f7f3a64654ca\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") "
Sep 16 05:09:47.815746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815628    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef233360-7b34-4517-9e06-f7f3a64654ca-istiod-ca-cert\") pod \"ef233360-7b34-4517-9e06-f7f3a64654ca\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") "
Sep 16 05:09:47.815746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815655    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-data\") pod \"ef233360-7b34-4517-9e06-f7f3a64654ca\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") "
Sep 16 05:09:47.815746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815684    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-certs\") pod \"ef233360-7b34-4517-9e06-f7f3a64654ca\" (UID: \"ef233360-7b34-4517-9e06-f7f3a64654ca\") "
Sep 16 05:09:47.815746 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815690    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ef233360-7b34-4517-9e06-f7f3a64654ca" (UID: "ef233360-7b34-4517-9e06-f7f3a64654ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:47.816192 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815770    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ef233360-7b34-4517-9e06-f7f3a64654ca" (UID: "ef233360-7b34-4517-9e06-f7f3a64654ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:47.816192 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815883    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-data" (OuterVolumeSpecName: "istio-data") pod "ef233360-7b34-4517-9e06-f7f3a64654ca" (UID: "ef233360-7b34-4517-9e06-f7f3a64654ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:47.816192 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815937    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef233360-7b34-4517-9e06-f7f3a64654ca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ef233360-7b34-4517-9e06-f7f3a64654ca" (UID: "ef233360-7b34-4517-9e06-f7f3a64654ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:09:47.816192 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.815978    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ef233360-7b34-4517-9e06-f7f3a64654ca" (UID: "ef233360-7b34-4517-9e06-f7f3a64654ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:47.816404 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.816384    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:47.816449 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.816410    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ef233360-7b34-4517-9e06-f7f3a64654ca-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:47.816449 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.816423    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:47.816449 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.816436    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:47.816600 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.816449    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:47.817731 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.817710    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-token" (OuterVolumeSpecName: "istio-token") pod "ef233360-7b34-4517-9e06-f7f3a64654ca" (UID: "ef233360-7b34-4517-9e06-f7f3a64654ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:09:47.818019 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.818001    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ef233360-7b34-4517-9e06-f7f3a64654ca" (UID: "ef233360-7b34-4517-9e06-f7f3a64654ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:09:47.818241 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.818217    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ef233360-7b34-4517-9e06-f7f3a64654ca" (UID: "ef233360-7b34-4517-9e06-f7f3a64654ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:09:47.818304 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.818223    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-kube-api-access-64l9f" (OuterVolumeSpecName: "kube-api-access-64l9f") pod "ef233360-7b34-4517-9e06-f7f3a64654ca" (UID: "ef233360-7b34-4517-9e06-f7f3a64654ca"). InnerVolumeSpecName "kube-api-access-64l9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:09:47.917720 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.917696    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:47.917720 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.917717    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:47.917864 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.917727    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64l9f\" (UniqueName: \"kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-kube-api-access-64l9f\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:47.917864 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:47.917737    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ef233360-7b34-4517-9e06-f7f3a64654ca-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:09:48.482608 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.482573    2559 generic.go:356] "Generic (PLEG): container finished" podID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerID="8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff" exitCode=0
Sep 16 05:09:48.482783 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.482605    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" event={"ID":"ef233360-7b34-4517-9e06-f7f3a64654ca","Type":"ContainerDied","Data":"8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff"}
Sep 16 05:09:48.482783 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.482624    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"
Sep 16 05:09:48.482783 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.482660    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f" event={"ID":"ef233360-7b34-4517-9e06-f7f3a64654ca","Type":"ContainerDied","Data":"c1f04054924bf51561b9ccb9af22f94564489e07fb20613e444820536f40d493"}
Sep 16 05:09:48.482783 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.482685    2559 scope.go:117] "RemoveContainer" containerID="8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff"
Sep 16 05:09:48.500755 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.500458    2559 scope.go:117] "RemoveContainer" containerID="3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019"
Sep 16 05:09:48.508816 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.508796    2559 scope.go:117] "RemoveContainer" containerID="8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff"
Sep 16 05:09:48.509058 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:09:48.509038    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff\": container with ID starting with 8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff not found: ID does not exist" containerID="8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff"
Sep 16 05:09:48.509102 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.509066    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff"} err="failed to get container status \"8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff\": rpc error: code = NotFound desc = could not find container \"8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff\": container with ID starting with 8d074c9e5ca9dcbfb201f4982d58b52eddcce73bd3066e7f6ed747d633b125ff not found: ID does not exist"
Sep 16 05:09:48.509102 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.509083    2559 scope.go:117] "RemoveContainer" containerID="3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019"
Sep 16 05:09:48.509298 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:09:48.509280    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019\": container with ID starting with 3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019 not found: ID does not exist" containerID="3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019"
Sep 16 05:09:48.509342 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.509304    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019"} err="failed to get container status \"3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019\": rpc error: code = NotFound desc = could not find container \"3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019\": container with ID starting with 3a47dbb3a76d540dfcb6b3dcc5d6ad92b96677369024999c29e0a7cee1c0e019 not found: ID does not exist"
Sep 16 05:09:48.517413 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.517392    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"]
Sep 16 05:09:48.520807 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.520788    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d1f291-openshift-default-79c888d486-2745f"]
Sep 16 05:09:48.785766 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:48.785686    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" path="/var/lib/kubelet/pods/ef233360-7b34-4517-9e06-f7f3a64654ca/volumes"
Sep 16 05:09:52.992264 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:52.992210    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"]
Sep 16 05:09:52.992962 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:52.992939    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy"
Sep 16 05:09:52.992962 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:52.992962    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy"
Sep 16 05:09:52.993141 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:52.992984    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy"
Sep 16 05:09:52.993141 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:52.992992    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy"
Sep 16 05:09:52.993141 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:52.993007    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0da7cd6d-75e1-424e-9c03-4db505e5f43e" containerName="istio-proxy"
Sep 16 05:09:52.993141 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:52.993015    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0da7cd6d-75e1-424e-9c03-4db505e5f43e" containerName="istio-proxy"
Sep 16 05:09:52.993141 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:52.993138    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0da7cd6d-75e1-424e-9c03-4db505e5f43e" containerName="istio-proxy"
Sep 16 05:09:52.993401 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:52.993155    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy"
Sep 16 05:09:52.993401 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:52.993166    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef233360-7b34-4517-9e06-f7f3a64654ca" containerName="istio-proxy"
Sep 16 05:09:53.005501 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.002512    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:09:53.018083 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.016762    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-3784e2-dockercfg-blh4n\""
Sep 16 05:09:53.018083 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.017071    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-3784e2\""
Sep 16 05:09:53.021782 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.020092    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"]
Sep 16 05:09:53.064329 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.064294    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sd5j\" (UniqueName: \"kubernetes.io/projected/05aef53b-20ef-4eb4-a788-03f0e87aa58d-kube-api-access-6sd5j\") pod \"payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm\" (UID: \"05aef53b-20ef-4eb4-a788-03f0e87aa58d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:09:53.064455 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.064363    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05aef53b-20ef-4eb4-a788-03f0e87aa58d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm\" (UID: \"05aef53b-20ef-4eb4-a788-03f0e87aa58d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:09:53.145954 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.145918    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"]
Sep 16 05:09:53.158331 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.158303    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:09:53.161872 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.161835    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"]
Sep 16 05:09:53.165459 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.165300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05aef53b-20ef-4eb4-a788-03f0e87aa58d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm\" (UID: \"05aef53b-20ef-4eb4-a788-03f0e87aa58d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:09:53.165836 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.165761    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sd5j\" (UniqueName: \"kubernetes.io/projected/05aef53b-20ef-4eb4-a788-03f0e87aa58d-kube-api-access-6sd5j\") pod \"payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm\" (UID: \"05aef53b-20ef-4eb4-a788-03f0e87aa58d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:09:53.167440 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.167418    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05aef53b-20ef-4eb4-a788-03f0e87aa58d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm\" (UID: \"05aef53b-20ef-4eb4-a788-03f0e87aa58d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:09:53.178907 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.178881    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sd5j\" (UniqueName: \"kubernetes.io/projected/05aef53b-20ef-4eb4-a788-03f0e87aa58d-kube-api-access-6sd5j\") pod \"payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm\" (UID: \"05aef53b-20ef-4eb4-a788-03f0e87aa58d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:09:53.267631 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.267547    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnhct\" (UniqueName: \"kubernetes.io/projected/92701124-b15e-47ea-abb3-e5bb26f48b25-kube-api-access-dnhct\") pod \"payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6\" (UID: \"92701124-b15e-47ea-abb3-e5bb26f48b25\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:09:53.267631 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.267596    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92701124-b15e-47ea-abb3-e5bb26f48b25-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6\" (UID: \"92701124-b15e-47ea-abb3-e5bb26f48b25\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:09:53.329686 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.329638    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:09:53.368214 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.368181    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92701124-b15e-47ea-abb3-e5bb26f48b25-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6\" (UID: \"92701124-b15e-47ea-abb3-e5bb26f48b25\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:09:53.368346 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.368315    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnhct\" (UniqueName: \"kubernetes.io/projected/92701124-b15e-47ea-abb3-e5bb26f48b25-kube-api-access-dnhct\") pod \"payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6\" (UID: \"92701124-b15e-47ea-abb3-e5bb26f48b25\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:09:53.368934 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.368909    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92701124-b15e-47ea-abb3-e5bb26f48b25-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6\" (UID: \"92701124-b15e-47ea-abb3-e5bb26f48b25\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:09:53.377436 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.377379    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnhct\" (UniqueName: \"kubernetes.io/projected/92701124-b15e-47ea-abb3-e5bb26f48b25-kube-api-access-dnhct\") pod \"payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6\" (UID: \"92701124-b15e-47ea-abb3-e5bb26f48b25\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:09:53.470439 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.470402    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:09:53.628634 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.628610    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"]
Sep 16 05:09:53.629933 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:09:53.629907    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05aef53b_20ef_4eb4_a788_03f0e87aa58d.slice/crio-98c422d4aa8b4e4c672e3ec2da07b6ed32ff635db3097c89b1a3d9852cbd458d WatchSource:0}: Error finding container 98c422d4aa8b4e4c672e3ec2da07b6ed32ff635db3097c89b1a3d9852cbd458d: Status 404 returned error can't find the container with id 98c422d4aa8b4e4c672e3ec2da07b6ed32ff635db3097c89b1a3d9852cbd458d
Sep 16 05:09:53.774970 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:53.774824    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"]
Sep 16 05:09:53.777826 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:09:53.777794    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92701124_b15e_47ea_abb3_e5bb26f48b25.slice/crio-7c61b985b24717d5ed67dea27da5a09f87add8ea1aadc8a0c49c683e4721445e WatchSource:0}: Error finding container 7c61b985b24717d5ed67dea27da5a09f87add8ea1aadc8a0c49c683e4721445e: Status 404 returned error can't find the container with id 7c61b985b24717d5ed67dea27da5a09f87add8ea1aadc8a0c49c683e4721445e
Sep 16 05:09:54.531087 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:54.531050    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6" event={"ID":"92701124-b15e-47ea-abb3-e5bb26f48b25","Type":"ContainerStarted","Data":"e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58"}
Sep 16 05:09:54.531549 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:54.531125    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:09:54.531549 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:54.531152    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6" event={"ID":"92701124-b15e-47ea-abb3-e5bb26f48b25","Type":"ContainerStarted","Data":"7c61b985b24717d5ed67dea27da5a09f87add8ea1aadc8a0c49c683e4721445e"}
Sep 16 05:09:54.532694 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:54.532668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm" event={"ID":"05aef53b-20ef-4eb4-a788-03f0e87aa58d","Type":"ContainerStarted","Data":"6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3"}
Sep 16 05:09:54.533120 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:54.532709    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm" event={"ID":"05aef53b-20ef-4eb4-a788-03f0e87aa58d","Type":"ContainerStarted","Data":"98c422d4aa8b4e4c672e3ec2da07b6ed32ff635db3097c89b1a3d9852cbd458d"}
Sep 16 05:09:54.533120 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:54.532728    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:09:54.552802 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:54.552759    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6" podStartSLOduration=1.55274532 podStartE2EDuration="1.55274532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:09:54.551460011 +0000 UTC m=+1248.212639190" watchObservedRunningTime="2026-09-16 05:09:54.55274532 +0000 UTC m=+1248.213924497"
Sep 16 05:09:54.571548 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:09:54.571506    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm" podStartSLOduration=2.571493668 podStartE2EDuration="2.571493668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:09:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:09:54.569393423 +0000 UTC m=+1248.230572599" watchObservedRunningTime="2026-09-16 05:09:54.571493668 +0000 UTC m=+1248.232672836"
Sep 16 05:10:01.577563 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:01.577461    2559 generic.go:356] "Generic (PLEG): container finished" podID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerID="a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5" exitCode=0
Sep 16 05:10:01.577563 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:01.577540    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" event={"ID":"2f004522-7255-4dd8-a348-bcea5fe4b289","Type":"ContainerDied","Data":"a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5"}
Sep 16 05:10:01.577992 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:01.577969    2559 scope.go:117] "RemoveContainer" containerID="a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5"
Sep 16 05:10:01.579183 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:01.579157    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:10:01.579235 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:01.579224    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:10:01.579269 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:01.579254    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:10:02.585271 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:02.585236    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" event={"ID":"2f004522-7255-4dd8-a348-bcea5fe4b289","Type":"ContainerStarted","Data":"c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b"}
Sep 16 05:10:03.093069 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:03.093028    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:10:03.093473 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:03.093443    2559 patch_prober.go:28] interesting pod/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 16 05:10:03.093623 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:03.093525    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 16 05:10:04.100606 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:04.100111    2559 patch_prober.go:28] interesting pod/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 16 05:10:04.100606 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:04.100180    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 16 05:10:05.092651 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:05.092606    2559 patch_prober.go:28] interesting pod/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 16 05:10:05.092845 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:05.092675    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 16 05:10:05.541352 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:05.541307    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:10:05.541805 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:05.541389    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:10:06.096612 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:06.096572    2559 patch_prober.go:28] interesting pod/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 16 05:10:06.096802 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:06.096650    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 16 05:10:06.952438 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:06.952405    2559 scope.go:117] "RemoveContainer" containerID="46caa67ecdd4aea09f61bfa4aad843090c9cc9ad7c75fe722eac37bffca720c1"
Sep 16 05:10:06.961190 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:06.961171    2559 scope.go:117] "RemoveContainer" containerID="b6ca99b1879c1e7a33d2f0e6d5368d0f69fc9e2d483da1664134970665f3ce92"
Sep 16 05:10:07.099824 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:07.099784    2559 patch_prober.go:28] interesting pod/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 16 05:10:07.099960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:07.099852    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 16 05:10:08.096438 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:08.096413    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:10:08.096812 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:08.096698    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:10:08.097296 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:08.097277    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:10:23.652145 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.652110    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"]
Sep 16 05:10:23.657314 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.657294    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.661452 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.661408    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ee7a60\"/\"default-dockercfg-jzbds\""
Sep 16 05:10:23.661452 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.661419    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ee7a60\"/\"openshift-service-ca.crt\""
Sep 16 05:10:23.661668 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.661545    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ee7a60\"/\"kube-root-ca.crt\""
Sep 16 05:10:23.661668 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.661566    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ee7a60\"/\"distinct-2-w0-ee7a60-kserve-self-signed-certs\""
Sep 16 05:10:23.667678 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.667658    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"]
Sep 16 05:10:23.775546 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.775504    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pvdc\" (UniqueName: \"kubernetes.io/projected/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-kube-api-access-7pvdc\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.775704 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.775562    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tmp-dir\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.775704 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.775596    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-model-cache\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.775704 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.775620    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-dshm\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.775704 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.775663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tls-certs\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.775840 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.775743    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-home\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.876680 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.876654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-home\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.876862 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.876841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pvdc\" (UniqueName: \"kubernetes.io/projected/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-kube-api-access-7pvdc\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.876942 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.876889    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tmp-dir\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.876942 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.876925    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-model-cache\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.877057 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.876962    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-dshm\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.877057 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.877005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tls-certs\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.877154 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.877065    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-home\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.877295 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.877273    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tmp-dir\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.877355 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.877316    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-model-cache\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.879201 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.879183    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-dshm\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.879467 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.879451    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tls-certs\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.883895 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.883872    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pvdc\" (UniqueName: \"kubernetes.io/projected/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-kube-api-access-7pvdc\") pod \"distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") " pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:23.968183 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:23.968105    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:24.244605 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:24.244581    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"]
Sep 16 05:10:24.247371 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:10:24.247343    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26ba5579_5b8a_466b_aa68_2ee2fa77ff80.slice/crio-47059e87805b89541f5a373d46362cb080aeedf047f46b7d130cddfc4a4fc48e WatchSource:0}: Error finding container 47059e87805b89541f5a373d46362cb080aeedf047f46b7d130cddfc4a4fc48e: Status 404 returned error can't find the container with id 47059e87805b89541f5a373d46362cb080aeedf047f46b7d130cddfc4a4fc48e
Sep 16 05:10:24.735063 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:24.735029    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg" event={"ID":"26ba5579-5b8a-466b-aa68-2ee2fa77ff80","Type":"ContainerStarted","Data":"a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9"}
Sep 16 05:10:24.735434 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:24.735074    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg" event={"ID":"26ba5579-5b8a-466b-aa68-2ee2fa77ff80","Type":"ContainerStarted","Data":"47059e87805b89541f5a373d46362cb080aeedf047f46b7d130cddfc4a4fc48e"}
Sep 16 05:10:24.752893 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:24.752840    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg" podStartSLOduration=1.752825732 podStartE2EDuration="1.752825732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:10:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:10:24.750424708 +0000 UTC m=+1278.411603885" watchObservedRunningTime="2026-09-16 05:10:24.752825732 +0000 UTC m=+1278.414004909"
Sep 16 05:10:33.968654 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:33.968604    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:33.968654 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:33.968669    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:33.980885 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:33.980863    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:10:34.807945 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:10:34.807916    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:11:07.030354 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:07.030324    2559 scope.go:117] "RemoveContainer" containerID="dce876802168c78217c61d452072226008ddc66c2544e22cb5088ce3d033f386"
Sep 16 05:11:54.842498 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:54.842452    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"]
Sep 16 05:11:54.846265 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:54.846247    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"
Sep 16 05:11:54.847985 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:54.847963    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:11:54.851897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:54.851874    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"]
Sep 16 05:11:54.948324 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:54.948287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7966357-5b4a-476b-beaf-82e9e5f34860-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8\" (UID: \"f7966357-5b4a-476b-beaf-82e9e5f34860\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"
Sep 16 05:11:55.049410 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:55.049377    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7966357-5b4a-476b-beaf-82e9e5f34860-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8\" (UID: \"f7966357-5b4a-476b-beaf-82e9e5f34860\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"
Sep 16 05:11:55.049963 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:55.049943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7966357-5b4a-476b-beaf-82e9e5f34860-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8\" (UID: \"f7966357-5b4a-476b-beaf-82e9e5f34860\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"
Sep 16 05:11:55.158981 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:55.158920    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"
Sep 16 05:11:55.430834 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:55.430803    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"]
Sep 16 05:11:55.432517 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:11:55.432473    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7966357_5b4a_476b_beaf_82e9e5f34860.slice/crio-1b1551fd4fd2f09e329521ea02082ef245a6f92a854b9c224132c593bb734095 WatchSource:0}: Error finding container 1b1551fd4fd2f09e329521ea02082ef245a6f92a854b9c224132c593bb734095: Status 404 returned error can't find the container with id 1b1551fd4fd2f09e329521ea02082ef245a6f92a854b9c224132c593bb734095
Sep 16 05:11:56.279076 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:56.278997    2559 generic.go:356] "Generic (PLEG): container finished" podID="f7966357-5b4a-476b-beaf-82e9e5f34860" containerID="8d842c9e12ccbaf6401b4aeb34a9ed67a0602d957529437d7c9c41d8ce31c2b6" exitCode=0
Sep 16 05:11:56.279431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:56.279076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8" event={"ID":"f7966357-5b4a-476b-beaf-82e9e5f34860","Type":"ContainerDied","Data":"8d842c9e12ccbaf6401b4aeb34a9ed67a0602d957529437d7c9c41d8ce31c2b6"}
Sep 16 05:11:56.279431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:56.279114    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8" event={"ID":"f7966357-5b4a-476b-beaf-82e9e5f34860","Type":"ContainerStarted","Data":"1b1551fd4fd2f09e329521ea02082ef245a6f92a854b9c224132c593bb734095"}
Sep 16 05:11:57.427390 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:57.427365    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"
Sep 16 05:11:57.577338 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:57.577267    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7966357-5b4a-476b-beaf-82e9e5f34860-maas-api-service-ca\") pod \"f7966357-5b4a-476b-beaf-82e9e5f34860\" (UID: \"f7966357-5b4a-476b-beaf-82e9e5f34860\") "
Sep 16 05:11:57.577687 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:57.577663    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7966357-5b4a-476b-beaf-82e9e5f34860-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f7966357-5b4a-476b-beaf-82e9e5f34860" (UID: "f7966357-5b4a-476b-beaf-82e9e5f34860"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:11:57.577791 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:57.577777    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7966357-5b4a-476b-beaf-82e9e5f34860-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:11:58.293232 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:58.293193    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"
Sep 16 05:11:58.293232 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:58.293224    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8" event={"ID":"f7966357-5b4a-476b-beaf-82e9e5f34860","Type":"ContainerDied","Data":"1b1551fd4fd2f09e329521ea02082ef245a6f92a854b9c224132c593bb734095"}
Sep 16 05:11:58.293439 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:11:58.293272    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b1551fd4fd2f09e329521ea02082ef245a6f92a854b9c224132c593bb734095"
Sep 16 05:12:07.053694 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:07.053662    2559 scope.go:117] "RemoveContainer" containerID="80adf989c680b90d8adffd477a15777d690c4715d812bcd7c27913d2196db66d"
Sep 16 05:12:07.062696 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:07.062674    2559 scope.go:117] "RemoveContainer" containerID="b77a07567058c96010d4debc57c190703dc2a252ee1d9e1b170a2ea91c3e3c72"
Sep 16 05:12:10.579770 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:10.579738    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"]
Sep 16 05:12:10.580175 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:10.579962    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr" podUID="9c12e73b-5fcd-46f4-8f09-e716125d1c98" containerName="payload-pre-processing" containerID="cri-o://4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9" gracePeriod=30
Sep 16 05:12:10.752727 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:10.752699    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"]
Sep 16 05:12:10.756393 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:10.756366    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-766a69c0-dr8k8"]
Sep 16 05:12:10.787864 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:10.787837    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7966357-5b4a-476b-beaf-82e9e5f34860" path="/var/lib/kubelet/pods/f7966357-5b4a-476b-beaf-82e9e5f34860/volumes"
Sep 16 05:12:10.855441 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:10.855363    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:12:10.902002 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:10.901972    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4ttt\" (UniqueName: \"kubernetes.io/projected/9c12e73b-5fcd-46f4-8f09-e716125d1c98-kube-api-access-g4ttt\") pod \"9c12e73b-5fcd-46f4-8f09-e716125d1c98\" (UID: \"9c12e73b-5fcd-46f4-8f09-e716125d1c98\") "
Sep 16 05:12:10.902184 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:10.902011    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c12e73b-5fcd-46f4-8f09-e716125d1c98-plugins-config-volume\") pod \"9c12e73b-5fcd-46f4-8f09-e716125d1c98\" (UID: \"9c12e73b-5fcd-46f4-8f09-e716125d1c98\") "
Sep 16 05:12:10.902400 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:10.902371    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c12e73b-5fcd-46f4-8f09-e716125d1c98-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c12e73b-5fcd-46f4-8f09-e716125d1c98" (UID: "9c12e73b-5fcd-46f4-8f09-e716125d1c98"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:12:10.904222 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:10.904195    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c12e73b-5fcd-46f4-8f09-e716125d1c98-kube-api-access-g4ttt" (OuterVolumeSpecName: "kube-api-access-g4ttt") pod "9c12e73b-5fcd-46f4-8f09-e716125d1c98" (UID: "9c12e73b-5fcd-46f4-8f09-e716125d1c98"). InnerVolumeSpecName "kube-api-access-g4ttt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:12:11.003198 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:11.003171    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4ttt\" (UniqueName: \"kubernetes.io/projected/9c12e73b-5fcd-46f4-8f09-e716125d1c98-kube-api-access-g4ttt\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:12:11.003198 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:11.003197    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c12e73b-5fcd-46f4-8f09-e716125d1c98-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:12:11.372988 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:11.372955    2559 generic.go:356] "Generic (PLEG): container finished" podID="9c12e73b-5fcd-46f4-8f09-e716125d1c98" containerID="4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9" exitCode=0
Sep 16 05:12:11.373167 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:11.372996    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"
Sep 16 05:12:11.373167 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:11.373032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr" event={"ID":"9c12e73b-5fcd-46f4-8f09-e716125d1c98","Type":"ContainerDied","Data":"4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9"}
Sep 16 05:12:11.373167 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:11.373091    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr" event={"ID":"9c12e73b-5fcd-46f4-8f09-e716125d1c98","Type":"ContainerDied","Data":"b43a4c16bf8537561b163b34d1e0ef908e3ca4d36b32fab01239bf0415cce9ac"}
Sep 16 05:12:11.373167 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:11.373114    2559 scope.go:117] "RemoveContainer" containerID="4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9"
Sep 16 05:12:11.382672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:11.382656    2559 scope.go:117] "RemoveContainer" containerID="4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9"
Sep 16 05:12:11.382929 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:12:11.382914    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9\": container with ID starting with 4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9 not found: ID does not exist" containerID="4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9"
Sep 16 05:12:11.382997 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:11.382937    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9"} err="failed to get container status \"4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9\": rpc error: code = NotFound desc = could not find container \"4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9\": container with ID starting with 4a2629828d264b1974661812b20e75b530cc07f0443cb7f977350b54e33f40a9 not found: ID does not exist"
Sep 16 05:12:11.392983 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:11.392963    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"]
Sep 16 05:12:11.397080 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:11.397060    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-766a69c0-7d5d954d4b-rtbcr"]
Sep 16 05:12:12.786034 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:12:12.786000    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c12e73b-5fcd-46f4-8f09-e716125d1c98" path="/var/lib/kubelet/pods/9c12e73b-5fcd-46f4-8f09-e716125d1c98/volumes"
Sep 16 05:13:02.749663 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.749583    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"]
Sep 16 05:13:02.750085 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.750071    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7966357-5b4a-476b-beaf-82e9e5f34860" containerName="revoke-keys"
Sep 16 05:13:02.750085 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.750086    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7966357-5b4a-476b-beaf-82e9e5f34860" containerName="revoke-keys"
Sep 16 05:13:02.750162 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.750109    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c12e73b-5fcd-46f4-8f09-e716125d1c98" containerName="payload-pre-processing"
Sep 16 05:13:02.750162 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.750115    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c12e73b-5fcd-46f4-8f09-e716125d1c98" containerName="payload-pre-processing"
Sep 16 05:13:02.750224 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.750186    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7966357-5b4a-476b-beaf-82e9e5f34860" containerName="revoke-keys"
Sep 16 05:13:02.750224 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.750197    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c12e73b-5fcd-46f4-8f09-e716125d1c98" containerName="payload-pre-processing"
Sep 16 05:13:02.759170 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.759132    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.761294 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.761264    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"]
Sep 16 05:13:02.761417 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.761310    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-12b6c6\"/\"distinct-2-w4-12b6c6-kserve-self-signed-certs\""
Sep 16 05:13:02.888220 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.888191    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tls-certs\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.888361 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.888233    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-home\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.888361 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.888303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-model-cache\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.888361 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.888335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tmp-dir\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.888603 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.888581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvszx\" (UniqueName: \"kubernetes.io/projected/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-kube-api-access-xvszx\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.888699 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.888634    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-dshm\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.990042 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.990018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tls-certs\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.990191 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.990052    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-home\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.990191 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.990081    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-model-cache\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.990191 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.990182    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tmp-dir\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.990360 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.990285    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvszx\" (UniqueName: \"kubernetes.io/projected/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-kube-api-access-xvszx\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.990360 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.990312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-dshm\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.990470 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.990406    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-model-cache\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.990470 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.990456    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-home\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.990584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.990499    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tmp-dir\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.992493 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.992449    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-dshm\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.992670 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.992652    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tls-certs\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:02.998779 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:02.998754    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvszx\" (UniqueName: \"kubernetes.io/projected/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-kube-api-access-xvszx\") pod \"distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") " pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:03.069671 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:03.069592    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:03.342163 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:03.342139    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"]
Sep 16 05:13:03.344345 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:13:03.344317    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e9865e0_c7fa_4b94_b548_15c8be32a6ce.slice/crio-3643d803a8ae8012fc7aa798d20f5486a070e85566aebe9d1ef462766842a06d WatchSource:0}: Error finding container 3643d803a8ae8012fc7aa798d20f5486a070e85566aebe9d1ef462766842a06d: Status 404 returned error can't find the container with id 3643d803a8ae8012fc7aa798d20f5486a070e85566aebe9d1ef462766842a06d
Sep 16 05:13:03.681774 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:03.681690    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw" event={"ID":"1e9865e0-c7fa-4b94-b548-15c8be32a6ce","Type":"ContainerStarted","Data":"803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca"}
Sep 16 05:13:03.681774 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:03.681734    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw" event={"ID":"1e9865e0-c7fa-4b94-b548-15c8be32a6ce","Type":"ContainerStarted","Data":"3643d803a8ae8012fc7aa798d20f5486a070e85566aebe9d1ef462766842a06d"}
Sep 16 05:13:03.700019 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:03.699976    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw" podStartSLOduration=1.699961432 podStartE2EDuration="1.699961432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:13:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:13:03.697117594 +0000 UTC m=+1437.358296771" watchObservedRunningTime="2026-09-16 05:13:03.699961432 +0000 UTC m=+1437.361140609"
Sep 16 05:13:13.070647 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:13.070614    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:13.070993 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:13.070659    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:13.082548 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:13.082527    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:13.747762 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:13.747737    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:13:42.394133 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:42.394096    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"]
Sep 16 05:13:42.394747 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:42.394340    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy" containerID="cri-o://c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b" gracePeriod=30
Sep 16 05:13:47.669382 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.669349    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:13:47.798493 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798448    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-certs\") pod \"2f004522-7255-4dd8-a348-bcea5fe4b289\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") "
Sep 16 05:13:47.798731 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798543    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f004522-7255-4dd8-a348-bcea5fe4b289-istiod-ca-cert\") pod \"2f004522-7255-4dd8-a348-bcea5fe4b289\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") "
Sep 16 05:13:47.798731 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798563    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-envoy\") pod \"2f004522-7255-4dd8-a348-bcea5fe4b289\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") "
Sep 16 05:13:47.798731 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798578    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-credential-socket\") pod \"2f004522-7255-4dd8-a348-bcea5fe4b289\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") "
Sep 16 05:13:47.798731 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798692    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-token\") pod \"2f004522-7255-4dd8-a348-bcea5fe4b289\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") "
Sep 16 05:13:47.798952 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798741    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f004522-7255-4dd8-a348-bcea5fe4b289" (UID: "2f004522-7255-4dd8-a348-bcea5fe4b289"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:13:47.798952 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798826    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgztw\" (UniqueName: \"kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-kube-api-access-zgztw\") pod \"2f004522-7255-4dd8-a348-bcea5fe4b289\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") "
Sep 16 05:13:47.798952 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798847    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f004522-7255-4dd8-a348-bcea5fe4b289" (UID: "2f004522-7255-4dd8-a348-bcea5fe4b289"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:13:47.798952 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798881    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-podinfo\") pod \"2f004522-7255-4dd8-a348-bcea5fe4b289\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") "
Sep 16 05:13:47.798952 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798931    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-data\") pod \"2f004522-7255-4dd8-a348-bcea5fe4b289\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") "
Sep 16 05:13:47.799188 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798961    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-socket\") pod \"2f004522-7255-4dd8-a348-bcea5fe4b289\" (UID: \"2f004522-7255-4dd8-a348-bcea5fe4b289\") "
Sep 16 05:13:47.799188 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.798961    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f004522-7255-4dd8-a348-bcea5fe4b289-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f004522-7255-4dd8-a348-bcea5fe4b289" (UID: "2f004522-7255-4dd8-a348-bcea5fe4b289"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:13:47.799306 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.799238    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f004522-7255-4dd8-a348-bcea5fe4b289" (UID: "2f004522-7255-4dd8-a348-bcea5fe4b289"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:13:47.799306 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.799279    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f004522-7255-4dd8-a348-bcea5fe4b289" (UID: "2f004522-7255-4dd8-a348-bcea5fe4b289"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:13:47.799611 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.799567    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f004522-7255-4dd8-a348-bcea5fe4b289-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:13:47.799611 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.799589    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:13:47.799611 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.799602    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:13:47.799762 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.799615    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:13:47.799762 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.799628    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:13:47.801074 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.801046    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-kube-api-access-zgztw" (OuterVolumeSpecName: "kube-api-access-zgztw") pod "2f004522-7255-4dd8-a348-bcea5fe4b289" (UID: "2f004522-7255-4dd8-a348-bcea5fe4b289"). InnerVolumeSpecName "kube-api-access-zgztw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:13:47.801173 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.801092    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f004522-7255-4dd8-a348-bcea5fe4b289" (UID: "2f004522-7255-4dd8-a348-bcea5fe4b289"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:13:47.801410 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.801386    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f004522-7255-4dd8-a348-bcea5fe4b289" (UID: "2f004522-7255-4dd8-a348-bcea5fe4b289"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:13:47.801410 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.801387    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f004522-7255-4dd8-a348-bcea5fe4b289" (UID: "2f004522-7255-4dd8-a348-bcea5fe4b289"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:13:47.900780 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.900755    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgztw\" (UniqueName: \"kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-kube-api-access-zgztw\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:13:47.900780 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.900776    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:13:47.900917 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.900785    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:13:47.900917 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.900793    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f004522-7255-4dd8-a348-bcea5fe4b289-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:13:47.934001 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.933944    2559 generic.go:356] "Generic (PLEG): container finished" podID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerID="c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b" exitCode=0
Sep 16 05:13:47.934107 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.934008    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"
Sep 16 05:13:47.934107 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.934035    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" event={"ID":"2f004522-7255-4dd8-a348-bcea5fe4b289","Type":"ContainerDied","Data":"c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b"}
Sep 16 05:13:47.934107 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.934093    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk" event={"ID":"2f004522-7255-4dd8-a348-bcea5fe4b289","Type":"ContainerDied","Data":"d5f43db701bf8e47515a54d92475b593b30c4d03ee8b590ef98d1ddcb0b46ce1"}
Sep 16 05:13:47.934260 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.934115    2559 scope.go:117] "RemoveContainer" containerID="c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b"
Sep 16 05:13:47.943735 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.943719    2559 scope.go:117] "RemoveContainer" containerID="a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5"
Sep 16 05:13:47.952281 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.952262    2559 scope.go:117] "RemoveContainer" containerID="c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b"
Sep 16 05:13:47.952573 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:13:47.952555    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b\": container with ID starting with c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b not found: ID does not exist" containerID="c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b"
Sep 16 05:13:47.952649 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.952578    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b"} err="failed to get container status \"c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b\": rpc error: code = NotFound desc = could not find container \"c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b\": container with ID starting with c3045558601bb22d5ca4efc5bb7edb6ead1d4d31bd238a14aef019eea62fb14b not found: ID does not exist"
Sep 16 05:13:47.952649 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.952591    2559 scope.go:117] "RemoveContainer" containerID="a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5"
Sep 16 05:13:47.952830 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:13:47.952814    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5\": container with ID starting with a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5 not found: ID does not exist" containerID="a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5"
Sep 16 05:13:47.952872 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.952833    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5"} err="failed to get container status \"a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5\": rpc error: code = NotFound desc = could not find container \"a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5\": container with ID starting with a764b411022e5326670b3aa32ab18cb3709d5e9b1413f66c201b605a25daa0e5 not found: ID does not exist"
Sep 16 05:13:47.954060 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.954042    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"]
Sep 16 05:13:47.960263 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:47.960243    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-766a69c0-openshift-default-66c978fb96-z5dlk"]
Sep 16 05:13:48.785818 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:13:48.785787    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" path="/var/lib/kubelet/pods/2f004522-7255-4dd8-a348-bcea5fe4b289/volumes"
Sep 16 05:14:07.103982 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:07.103946    2559 scope.go:117] "RemoveContainer" containerID="841a37328da71abc3acf270a060d54a708467a7d14c016ad0a1ee4047823ea2b"
Sep 16 05:14:07.112422 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:07.112406    2559 scope.go:117] "RemoveContainer" containerID="6ca7d80401637ec83199b0eb0b8b9792e555ea9a58d6d2706ef876455a8ddcfa"
Sep 16 05:14:34.844578 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:34.844501    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"]
Sep 16 05:14:34.844997 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:34.844982    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy"
Sep 16 05:14:34.844997 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:34.844996    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy"
Sep 16 05:14:34.845071 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:34.845006    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy"
Sep 16 05:14:34.845071 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:34.845012    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy"
Sep 16 05:14:34.845138 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:34.845090    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy"
Sep 16 05:14:34.845138 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:34.845097    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f004522-7255-4dd8-a348-bcea5fe4b289" containerName="istio-proxy"
Sep 16 05:14:34.848620 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:34.848601    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"
Sep 16 05:14:34.850567 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:34.850549    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:14:34.855453 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:34.855433    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"]
Sep 16 05:14:34.914681 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:34.914653    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32a9d241-3906-4e2b-9d36-4ba2283fd8f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk\" (UID: \"32a9d241-3906-4e2b-9d36-4ba2283fd8f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"
Sep 16 05:14:35.015499 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:35.015448    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32a9d241-3906-4e2b-9d36-4ba2283fd8f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk\" (UID: \"32a9d241-3906-4e2b-9d36-4ba2283fd8f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"
Sep 16 05:14:35.016031 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:35.016008    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32a9d241-3906-4e2b-9d36-4ba2283fd8f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk\" (UID: \"32a9d241-3906-4e2b-9d36-4ba2283fd8f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"
Sep 16 05:14:35.161355 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:35.161292    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"
Sep 16 05:14:35.434068 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:35.434044    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"]
Sep 16 05:14:35.436009 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:14:35.435984    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a9d241_3906_4e2b_9d36_4ba2283fd8f4.slice/crio-8ffe790126cf7f0aa61e53a06ee1f560586edae11983b24433fbbfeb4151e29e WatchSource:0}: Error finding container 8ffe790126cf7f0aa61e53a06ee1f560586edae11983b24433fbbfeb4151e29e: Status 404 returned error can't find the container with id 8ffe790126cf7f0aa61e53a06ee1f560586edae11983b24433fbbfeb4151e29e
Sep 16 05:14:36.216051 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.216024    2559 generic.go:356] "Generic (PLEG): container finished" podID="32a9d241-3906-4e2b-9d36-4ba2283fd8f4" containerID="3155048eeefc7d9f96fdb91e5f1a65e2cceace5688e531b6052c3ab19f471ce9" exitCode=0
Sep 16 05:14:36.216332 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.216105    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk" event={"ID":"32a9d241-3906-4e2b-9d36-4ba2283fd8f4","Type":"ContainerDied","Data":"3155048eeefc7d9f96fdb91e5f1a65e2cceace5688e531b6052c3ab19f471ce9"}
Sep 16 05:14:36.216332 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.216160    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk" event={"ID":"32a9d241-3906-4e2b-9d36-4ba2283fd8f4","Type":"ContainerStarted","Data":"8ffe790126cf7f0aa61e53a06ee1f560586edae11983b24433fbbfeb4151e29e"}
Sep 16 05:14:36.738176 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.738141    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"]
Sep 16 05:14:36.741616 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.741600    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.744353 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.744324    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-75559a-openshift-default-dockercfg-xrq6x\""
Sep 16 05:14:36.757058 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.757034    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"]
Sep 16 05:14:36.831993 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.831955    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-socket\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.832175 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.832053    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-envoy\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.832175 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.832141    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-podinfo\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.832299 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.832227    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ef3735-7f1c-4006-9ab8-abb8a14719af-istiod-ca-cert\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.832299 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.832254    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-data\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.832436 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.832307    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-credential-socket\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.832436 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.832335    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-certs\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.832436 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.832380    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-token\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.832436 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.832412    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t72bl\" (UniqueName: \"kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-kube-api-access-t72bl\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933114 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ef3735-7f1c-4006-9ab8-abb8a14719af-istiod-ca-cert\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933114 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-data\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933374 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933250    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-credential-socket\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933374 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933301    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-certs\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933374 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933354    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-token\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933567 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933394    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t72bl\" (UniqueName: \"kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-kube-api-access-t72bl\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933567 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-socket\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933567 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933535    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-envoy\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933567 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933541    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-data\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933765 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933628    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-podinfo\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933765 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933639    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-certs\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933868 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933798    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-socket\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.933951 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933933    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ef3735-7f1c-4006-9ab8-abb8a14719af-istiod-ca-cert\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.934005 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.933935    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-credential-socket\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.936000 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.935978    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-envoy\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.936369 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.936352    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-podinfo\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.941183 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.941158    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-token\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:36.941599 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:36.941582    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t72bl\" (UniqueName: \"kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-kube-api-access-t72bl\") pod \"e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") " pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:37.051753 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:37.051680    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:37.331217 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:37.331181    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"]
Sep 16 05:14:37.331931 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:14:37.331889    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ef3735_7f1c_4006_9ab8_abb8a14719af.slice/crio-fd0482186f97f493171c2fd4b9be0963c0dba47ce094ff04a29a4e43d46ea0cf WatchSource:0}: Error finding container fd0482186f97f493171c2fd4b9be0963c0dba47ce094ff04a29a4e43d46ea0cf: Status 404 returned error can't find the container with id fd0482186f97f493171c2fd4b9be0963c0dba47ce094ff04a29a4e43d46ea0cf
Sep 16 05:14:37.334597 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:37.334557    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:14:37.334691 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:37.334641    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:14:37.334691 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:37.334679    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:14:37.378545 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:37.378522    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"
Sep 16 05:14:37.438951 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:37.438917    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32a9d241-3906-4e2b-9d36-4ba2283fd8f4-maas-api-service-ca\") pod \"32a9d241-3906-4e2b-9d36-4ba2283fd8f4\" (UID: \"32a9d241-3906-4e2b-9d36-4ba2283fd8f4\") "
Sep 16 05:14:37.439381 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:37.439357    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32a9d241-3906-4e2b-9d36-4ba2283fd8f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "32a9d241-3906-4e2b-9d36-4ba2283fd8f4" (UID: "32a9d241-3906-4e2b-9d36-4ba2283fd8f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:14:37.540679 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:37.540654    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/32a9d241-3906-4e2b-9d36-4ba2283fd8f4-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:14:38.229366 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:38.229332    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"
Sep 16 05:14:38.229569 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:38.229364    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk" event={"ID":"32a9d241-3906-4e2b-9d36-4ba2283fd8f4","Type":"ContainerDied","Data":"8ffe790126cf7f0aa61e53a06ee1f560586edae11983b24433fbbfeb4151e29e"}
Sep 16 05:14:38.229569 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:38.229440    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ffe790126cf7f0aa61e53a06ee1f560586edae11983b24433fbbfeb4151e29e"
Sep 16 05:14:38.231261 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:38.231237    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" event={"ID":"02ef3735-7f1c-4006-9ab8-abb8a14719af","Type":"ContainerStarted","Data":"ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d"}
Sep 16 05:14:38.231388 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:38.231282    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" event={"ID":"02ef3735-7f1c-4006-9ab8-abb8a14719af","Type":"ContainerStarted","Data":"fd0482186f97f493171c2fd4b9be0963c0dba47ce094ff04a29a4e43d46ea0cf"}
Sep 16 05:14:38.253205 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:38.253160    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" podStartSLOduration=2.25314424 podStartE2EDuration="2.25314424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:14:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:14:38.250930257 +0000 UTC m=+1531.912109434" watchObservedRunningTime="2026-09-16 05:14:38.25314424 +0000 UTC m=+1531.914323418"
Sep 16 05:14:39.052782 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:39.052749    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:39.057549 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:39.057522    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:39.236941 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:39.236916    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:39.237821 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:39.237801    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:14:39.725103 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:39.725068    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"]
Sep 16 05:14:42.541023 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.540989    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"]
Sep 16 05:14:42.541712 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.541691    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32a9d241-3906-4e2b-9d36-4ba2283fd8f4" containerName="revoke-keys"
Sep 16 05:14:42.541712 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.541712    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="32a9d241-3906-4e2b-9d36-4ba2283fd8f4" containerName="revoke-keys"
Sep 16 05:14:42.541868 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.541816    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="32a9d241-3906-4e2b-9d36-4ba2283fd8f4" containerName="revoke-keys"
Sep 16 05:14:42.545163 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.545144    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:14:42.547325 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.547300    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-75559a-dockercfg-l762d\""
Sep 16 05:14:42.547439 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.547422    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-75559a\""
Sep 16 05:14:42.556455 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.556434    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"]
Sep 16 05:14:42.692870 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.692835    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05647489-b095-434a-ab13-3921a7b31fb8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt\" (UID: \"05647489-b095-434a-ab13-3921a7b31fb8\") " pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:14:42.693023 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.692884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzk7x\" (UniqueName: \"kubernetes.io/projected/05647489-b095-434a-ab13-3921a7b31fb8-kube-api-access-nzk7x\") pod \"payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt\" (UID: \"05647489-b095-434a-ab13-3921a7b31fb8\") " pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:14:42.794030 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.793947    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05647489-b095-434a-ab13-3921a7b31fb8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt\" (UID: \"05647489-b095-434a-ab13-3921a7b31fb8\") " pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:14:42.794030 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.794000    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzk7x\" (UniqueName: \"kubernetes.io/projected/05647489-b095-434a-ab13-3921a7b31fb8-kube-api-access-nzk7x\") pod \"payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt\" (UID: \"05647489-b095-434a-ab13-3921a7b31fb8\") " pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:14:42.794619 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.794600    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05647489-b095-434a-ab13-3921a7b31fb8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt\" (UID: \"05647489-b095-434a-ab13-3921a7b31fb8\") " pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:14:42.801398 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.801373    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzk7x\" (UniqueName: \"kubernetes.io/projected/05647489-b095-434a-ab13-3921a7b31fb8-kube-api-access-nzk7x\") pod \"payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt\" (UID: \"05647489-b095-434a-ab13-3921a7b31fb8\") " pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:14:42.856900 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:42.856872    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:14:43.133513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:43.133490    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"]
Sep 16 05:14:43.135443 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:14:43.135422    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05647489_b095_434a_ab13_3921a7b31fb8.slice/crio-d2dc508cbc677f8f401f543a53e475c1d008d6b3010a55b42202d0d50236be9d WatchSource:0}: Error finding container d2dc508cbc677f8f401f543a53e475c1d008d6b3010a55b42202d0d50236be9d: Status 404 returned error can't find the container with id d2dc508cbc677f8f401f543a53e475c1d008d6b3010a55b42202d0d50236be9d
Sep 16 05:14:43.260045 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:43.260005    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt" event={"ID":"05647489-b095-434a-ab13-3921a7b31fb8","Type":"ContainerStarted","Data":"3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2"}
Sep 16 05:14:43.260216 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:43.260112    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt" event={"ID":"05647489-b095-434a-ab13-3921a7b31fb8","Type":"ContainerStarted","Data":"d2dc508cbc677f8f401f543a53e475c1d008d6b3010a55b42202d0d50236be9d"}
Sep 16 05:14:43.260216 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:43.260142    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:14:43.277399 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:43.277354    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt" podStartSLOduration=1.277336638 podStartE2EDuration="1.277336638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:14:43.276576781 +0000 UTC m=+1536.937755959" watchObservedRunningTime="2026-09-16 05:14:43.277336638 +0000 UTC m=+1536.938515838"
Sep 16 05:14:52.941498 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:52.941453    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"]
Sep 16 05:14:52.941926 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:52.941711    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn" podUID="2d5333cb-a1e5-4d13-89cc-05f82892af48" containerName="payload-processing" containerID="cri-o://d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457" gracePeriod=30
Sep 16 05:14:53.105285 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.105242    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"]
Sep 16 05:14:53.108191 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.108157    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ee7a60-whbvk"]
Sep 16 05:14:53.209322 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.209230    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:14:53.316826 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.316791    2559 generic.go:356] "Generic (PLEG): container finished" podID="2d5333cb-a1e5-4d13-89cc-05f82892af48" containerID="d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457" exitCode=0
Sep 16 05:14:53.316992 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.316831    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"
Sep 16 05:14:53.316992 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.316872    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn" event={"ID":"2d5333cb-a1e5-4d13-89cc-05f82892af48","Type":"ContainerDied","Data":"d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457"}
Sep 16 05:14:53.316992 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.316923    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn" event={"ID":"2d5333cb-a1e5-4d13-89cc-05f82892af48","Type":"ContainerDied","Data":"df9998b5c0f0e2bf61e30cbd33a701e75acbb069839020f5d8cf5261d4f6d508"}
Sep 16 05:14:53.316992 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.316945    2559 scope.go:117] "RemoveContainer" containerID="d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457"
Sep 16 05:14:53.325660 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.325644    2559 scope.go:117] "RemoveContainer" containerID="d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457"
Sep 16 05:14:53.325902 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:14:53.325885    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457\": container with ID starting with d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457 not found: ID does not exist" containerID="d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457"
Sep 16 05:14:53.325956 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.325910    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457"} err="failed to get container status \"d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457\": rpc error: code = NotFound desc = could not find container \"d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457\": container with ID starting with d569c2bcc8a5b00390119be88327b8cbc80602dbf1409c62003460000819d457 not found: ID does not exist"
Sep 16 05:14:53.397782 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.397755    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhptn\" (UniqueName: \"kubernetes.io/projected/2d5333cb-a1e5-4d13-89cc-05f82892af48-kube-api-access-lhptn\") pod \"2d5333cb-a1e5-4d13-89cc-05f82892af48\" (UID: \"2d5333cb-a1e5-4d13-89cc-05f82892af48\") "
Sep 16 05:14:53.397886 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.397867    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d5333cb-a1e5-4d13-89cc-05f82892af48-plugins-config-volume\") pod \"2d5333cb-a1e5-4d13-89cc-05f82892af48\" (UID: \"2d5333cb-a1e5-4d13-89cc-05f82892af48\") "
Sep 16 05:14:53.398199 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.398176    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d5333cb-a1e5-4d13-89cc-05f82892af48-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d5333cb-a1e5-4d13-89cc-05f82892af48" (UID: "2d5333cb-a1e5-4d13-89cc-05f82892af48"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:14:53.399829 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.399804    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d5333cb-a1e5-4d13-89cc-05f82892af48-kube-api-access-lhptn" (OuterVolumeSpecName: "kube-api-access-lhptn") pod "2d5333cb-a1e5-4d13-89cc-05f82892af48" (UID: "2d5333cb-a1e5-4d13-89cc-05f82892af48"). InnerVolumeSpecName "kube-api-access-lhptn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:14:53.499007 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.498984    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhptn\" (UniqueName: \"kubernetes.io/projected/2d5333cb-a1e5-4d13-89cc-05f82892af48-kube-api-access-lhptn\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:14:53.499007 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.499006    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d5333cb-a1e5-4d13-89cc-05f82892af48-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:14:53.639711 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.639679    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"]
Sep 16 05:14:53.643083 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:53.643062    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ee7a60-75b6fd7c79-cblqn"]
Sep 16 05:14:54.267738 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:54.267704    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:14:54.744313 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:54.744277    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg" podUID="26ba5579-5b8a-466b-aa68-2ee2fa77ff80" containerName="main" containerID="cri-o://a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9" gracePeriod=45
Sep 16 05:14:54.786558 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:54.786525    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d5333cb-a1e5-4d13-89cc-05f82892af48" path="/var/lib/kubelet/pods/2d5333cb-a1e5-4d13-89cc-05f82892af48/volumes"
Sep 16 05:14:54.786881 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:54.786868    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32a9d241-3906-4e2b-9d36-4ba2283fd8f4" path="/var/lib/kubelet/pods/32a9d241-3906-4e2b-9d36-4ba2283fd8f4/volumes"
Sep 16 05:14:54.798013 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:54.797991    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg" podUID="26ba5579-5b8a-466b-aa68-2ee2fa77ff80" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": dial tcp 10.134.0.76:8000: connect: connection refused"
Sep 16 05:14:55.008898 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.008845    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:14:55.115403 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.115372    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-dshm\") pod \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") "
Sep 16 05:14:55.115596 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.115411    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pvdc\" (UniqueName: \"kubernetes.io/projected/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-kube-api-access-7pvdc\") pod \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") "
Sep 16 05:14:55.115596 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.115546    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tmp-dir\") pod \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") "
Sep 16 05:14:55.115596 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.115583    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-model-cache\") pod \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") "
Sep 16 05:14:55.115790 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.115621    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tls-certs\") pod \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") "
Sep 16 05:14:55.115790 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.115637    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-home\") pod \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\" (UID: \"26ba5579-5b8a-466b-aa68-2ee2fa77ff80\") "
Sep 16 05:14:55.115790 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.115771    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "26ba5579-5b8a-466b-aa68-2ee2fa77ff80" (UID: "26ba5579-5b8a-466b-aa68-2ee2fa77ff80"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:14:55.115948 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.115858    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-model-cache" (OuterVolumeSpecName: "model-cache") pod "26ba5579-5b8a-466b-aa68-2ee2fa77ff80" (UID: "26ba5579-5b8a-466b-aa68-2ee2fa77ff80"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:14:55.116007 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.115958    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-home" (OuterVolumeSpecName: "home") pod "26ba5579-5b8a-466b-aa68-2ee2fa77ff80" (UID: "26ba5579-5b8a-466b-aa68-2ee2fa77ff80"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:14:55.116216 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.116034    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-model-cache\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:14:55.116216 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.116049    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-home\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:14:55.116216 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.116058    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tmp-dir\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:14:55.117795 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.117770    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "26ba5579-5b8a-466b-aa68-2ee2fa77ff80" (UID: "26ba5579-5b8a-466b-aa68-2ee2fa77ff80"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 05:14:55.117795 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.117791    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-dshm" (OuterVolumeSpecName: "dshm") pod "26ba5579-5b8a-466b-aa68-2ee2fa77ff80" (UID: "26ba5579-5b8a-466b-aa68-2ee2fa77ff80"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:14:55.117913 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.117871    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-kube-api-access-7pvdc" (OuterVolumeSpecName: "kube-api-access-7pvdc") pod "26ba5579-5b8a-466b-aa68-2ee2fa77ff80" (UID: "26ba5579-5b8a-466b-aa68-2ee2fa77ff80"). InnerVolumeSpecName "kube-api-access-7pvdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:14:55.217631 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.217599    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-tls-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:14:55.217631 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.217632    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-dshm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:14:55.217804 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.217645    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pvdc\" (UniqueName: \"kubernetes.io/projected/26ba5579-5b8a-466b-aa68-2ee2fa77ff80-kube-api-access-7pvdc\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:14:55.332800 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.332723    2559 generic.go:356] "Generic (PLEG): container finished" podID="26ba5579-5b8a-466b-aa68-2ee2fa77ff80" containerID="a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9" exitCode=0
Sep 16 05:14:55.332800 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.332771    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"
Sep 16 05:14:55.333276 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.332812    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg" event={"ID":"26ba5579-5b8a-466b-aa68-2ee2fa77ff80","Type":"ContainerDied","Data":"a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9"}
Sep 16 05:14:55.333276 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.332855    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg" event={"ID":"26ba5579-5b8a-466b-aa68-2ee2fa77ff80","Type":"ContainerDied","Data":"47059e87805b89541f5a373d46362cb080aeedf047f46b7d130cddfc4a4fc48e"}
Sep 16 05:14:55.333276 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.332872    2559 scope.go:117] "RemoveContainer" containerID="a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9"
Sep 16 05:14:55.342276 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.342259    2559 scope.go:117] "RemoveContainer" containerID="a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9"
Sep 16 05:14:55.342556 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:14:55.342539    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9\": container with ID starting with a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9 not found: ID does not exist" containerID="a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9"
Sep 16 05:14:55.342616 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.342569    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9"} err="failed to get container status \"a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9\": rpc error: code = NotFound desc = could not find container \"a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9\": container with ID starting with a0ff15acd811c4efe451df0cfbe7fcdae9620240fbe887841e06b14b08853bc9 not found: ID does not exist"
Sep 16 05:14:55.356958 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.356938    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"]
Sep 16 05:14:55.360314 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:55.360294    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-ee7a60/distinct-2-w0-ee7a60-kserve-5977564fcb-dzxdg"]
Sep 16 05:14:56.787615 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:14:56.787581    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ba5579-5b8a-466b-aa68-2ee2fa77ff80" path="/var/lib/kubelet/pods/26ba5579-5b8a-466b-aa68-2ee2fa77ff80/volumes"
Sep 16 05:15:00.141120 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.141087    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84"]
Sep 16 05:15:00.141852 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.141797    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ba5579-5b8a-466b-aa68-2ee2fa77ff80" containerName="main"
Sep 16 05:15:00.141852 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.141822    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ba5579-5b8a-466b-aa68-2ee2fa77ff80" containerName="main"
Sep 16 05:15:00.141852 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.141837    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d5333cb-a1e5-4d13-89cc-05f82892af48" containerName="payload-processing"
Sep 16 05:15:00.141852 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.141846    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d5333cb-a1e5-4d13-89cc-05f82892af48" containerName="payload-processing"
Sep 16 05:15:00.142225 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.141989    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ba5579-5b8a-466b-aa68-2ee2fa77ff80" containerName="main"
Sep 16 05:15:00.142225 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.142009    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d5333cb-a1e5-4d13-89cc-05f82892af48" containerName="payload-processing"
Sep 16 05:15:00.146834 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.146812    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj"]
Sep 16 05:15:00.146958 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.146922    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84"
Sep 16 05:15:00.148714 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.148696    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:15:00.150354 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.150337    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn"]
Sep 16 05:15:00.150434 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.150422    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj"
Sep 16 05:15:00.154644 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.154625    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv"]
Sep 16 05:15:00.154942 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.154922    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn"
Sep 16 05:15:00.158705 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.158687    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84"]
Sep 16 05:15:00.158835 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.158769    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv"
Sep 16 05:15:00.163089 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.163052    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84"
Sep 16 05:15:00.163270 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.163250    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj"]
Sep 16 05:15:00.168573 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.167879    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn"]
Sep 16 05:15:00.169892 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.169826    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv"]
Sep 16 05:15:00.175863 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.175841    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj"
Sep 16 05:15:00.239780 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.239757    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn"
Sep 16 05:15:00.260891 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.260715    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv"
Sep 16 05:15:00.463008 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.462813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84"]
Sep 16 05:15:00.464328 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:15:00.464303    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3b46ab_b2c8_474c_ac4e_61da0526fe22.slice/crio-61aaa1ed785853fc01802585e77b16fddac9f2deced90ce93c88ec50fb9af330 WatchSource:0}: Error finding container 61aaa1ed785853fc01802585e77b16fddac9f2deced90ce93c88ec50fb9af330: Status 404 returned error can't find the container with id 61aaa1ed785853fc01802585e77b16fddac9f2deced90ce93c88ec50fb9af330
Sep 16 05:15:00.478786 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.478763    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj"]
Sep 16 05:15:00.480339 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:15:00.480315    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod412ba4a1_96bd_4d43_9c2d_92e545121710.slice/crio-98a405c42d37d257f5f834000184d59946ca004746f1dbfb6db89d99183fb914 WatchSource:0}: Error finding container 98a405c42d37d257f5f834000184d59946ca004746f1dbfb6db89d99183fb914: Status 404 returned error can't find the container with id 98a405c42d37d257f5f834000184d59946ca004746f1dbfb6db89d99183fb914
Sep 16 05:15:00.536108 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.536088    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn"]
Sep 16 05:15:00.537869 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:15:00.537836    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35119d3_935e_4ff5_9ce6_cb5fff89b181.slice/crio-c7c91f0352c79d318f8e67b30a4e3b2e8dfb58450605e1133247701c39d5dc83 WatchSource:0}: Error finding container c7c91f0352c79d318f8e67b30a4e3b2e8dfb58450605e1133247701c39d5dc83: Status 404 returned error can't find the container with id c7c91f0352c79d318f8e67b30a4e3b2e8dfb58450605e1133247701c39d5dc83
Sep 16 05:15:00.547261 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:00.547241    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv"]
Sep 16 05:15:00.551174 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:15:00.551153    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d74d6a8_33a0_40a8_96e6_805bddb36377.slice/crio-c2ae4ad2f4faa3c794d46da0aa868f8c6a7184d09a0b9442f83c4acf4d0136f7 WatchSource:0}: Error finding container c2ae4ad2f4faa3c794d46da0aa868f8c6a7184d09a0b9442f83c4acf4d0136f7: Status 404 returned error can't find the container with id c2ae4ad2f4faa3c794d46da0aa868f8c6a7184d09a0b9442f83c4acf4d0136f7
Sep 16 05:15:01.367825 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.367787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84" event={"ID":"0a3b46ab-b2c8-474c-ac4e-61da0526fe22","Type":"ContainerStarted","Data":"b437816d29cbf872ae3ad84d53cfd0af438db79368b9748d9eee9ae1c4704894"}
Sep 16 05:15:01.368262 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.367851    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84" event={"ID":"0a3b46ab-b2c8-474c-ac4e-61da0526fe22","Type":"ContainerStarted","Data":"61aaa1ed785853fc01802585e77b16fddac9f2deced90ce93c88ec50fb9af330"}
Sep 16 05:15:01.369494 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.369450    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn" event={"ID":"d35119d3-935e-4ff5-9ce6-cb5fff89b181","Type":"ContainerStarted","Data":"fe3b1721ba622db5cdb429ef52a9b3ba43d3737aa3f0e7b8ac7cb372ce9203c8"}
Sep 16 05:15:01.369655 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.369531    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn" event={"ID":"d35119d3-935e-4ff5-9ce6-cb5fff89b181","Type":"ContainerStarted","Data":"c7c91f0352c79d318f8e67b30a4e3b2e8dfb58450605e1133247701c39d5dc83"}
Sep 16 05:15:01.402928 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.371046    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj" event={"ID":"412ba4a1-96bd-4d43-9c2d-92e545121710","Type":"ContainerStarted","Data":"91c6221c5e00bfd2d57d9474e28a13b9bc7d75c8798f2f95b740e411b8584b48"}
Sep 16 05:15:01.402928 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.371092    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj" event={"ID":"412ba4a1-96bd-4d43-9c2d-92e545121710","Type":"ContainerStarted","Data":"98a405c42d37d257f5f834000184d59946ca004746f1dbfb6db89d99183fb914"}
Sep 16 05:15:01.402928 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.372861    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv" event={"ID":"6d74d6a8-33a0-40a8-96e6-805bddb36377","Type":"ContainerStarted","Data":"87867e9cce02aaad7523196791809df32cd55cc207d4ff66044e68602b830795"}
Sep 16 05:15:01.402928 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.372897    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv" event={"ID":"6d74d6a8-33a0-40a8-96e6-805bddb36377","Type":"ContainerStarted","Data":"c2ae4ad2f4faa3c794d46da0aa868f8c6a7184d09a0b9442f83c4acf4d0136f7"}
Sep 16 05:15:01.402928 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.386120    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84" podStartSLOduration=1.386106431 podStartE2EDuration="1.386106431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:15:01.383171959 +0000 UTC m=+1555.044351135" watchObservedRunningTime="2026-09-16 05:15:01.386106431 +0000 UTC m=+1555.047285608"
Sep 16 05:15:01.402928 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.399085    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv" podStartSLOduration=1.399072182 podStartE2EDuration="1.399072182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:15:01.397689678 +0000 UTC m=+1555.058868854" watchObservedRunningTime="2026-09-16 05:15:01.399072182 +0000 UTC m=+1555.060251360"
Sep 16 05:15:01.413666 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.413627    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj" podStartSLOduration=1.413616229 podStartE2EDuration="1.413616229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:15:01.412148066 +0000 UTC m=+1555.073327243" watchObservedRunningTime="2026-09-16 05:15:01.413616229 +0000 UTC m=+1555.074795405"
Sep 16 05:15:01.428415 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:01.428380    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn" podStartSLOduration=1.4283737269999999 podStartE2EDuration="1.428373727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:15:01.427325821 +0000 UTC m=+1555.088504998" watchObservedRunningTime="2026-09-16 05:15:01.428373727 +0000 UTC m=+1555.089552904"
Sep 16 05:15:02.380064 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:02.380024    2559 generic.go:356] "Generic (PLEG): container finished" podID="d35119d3-935e-4ff5-9ce6-cb5fff89b181" containerID="fe3b1721ba622db5cdb429ef52a9b3ba43d3737aa3f0e7b8ac7cb372ce9203c8" exitCode=0
Sep 16 05:15:02.380443 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:02.380110    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn" event={"ID":"d35119d3-935e-4ff5-9ce6-cb5fff89b181","Type":"ContainerDied","Data":"fe3b1721ba622db5cdb429ef52a9b3ba43d3737aa3f0e7b8ac7cb372ce9203c8"}
Sep 16 05:15:02.381614 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:02.381589    2559 generic.go:356] "Generic (PLEG): container finished" podID="412ba4a1-96bd-4d43-9c2d-92e545121710" containerID="91c6221c5e00bfd2d57d9474e28a13b9bc7d75c8798f2f95b740e411b8584b48" exitCode=0
Sep 16 05:15:02.381735 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:02.381659    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj" event={"ID":"412ba4a1-96bd-4d43-9c2d-92e545121710","Type":"ContainerDied","Data":"91c6221c5e00bfd2d57d9474e28a13b9bc7d75c8798f2f95b740e411b8584b48"}
Sep 16 05:15:02.383142 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:02.383120    2559 generic.go:356] "Generic (PLEG): container finished" podID="6d74d6a8-33a0-40a8-96e6-805bddb36377" containerID="87867e9cce02aaad7523196791809df32cd55cc207d4ff66044e68602b830795" exitCode=0
Sep 16 05:15:02.383244 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:02.383153    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv" event={"ID":"6d74d6a8-33a0-40a8-96e6-805bddb36377","Type":"ContainerDied","Data":"87867e9cce02aaad7523196791809df32cd55cc207d4ff66044e68602b830795"}
Sep 16 05:15:02.384641 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:02.384617    2559 generic.go:356] "Generic (PLEG): container finished" podID="0a3b46ab-b2c8-474c-ac4e-61da0526fe22" containerID="b437816d29cbf872ae3ad84d53cfd0af438db79368b9748d9eee9ae1c4704894" exitCode=0
Sep 16 05:15:02.384733 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:02.384668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84" event={"ID":"0a3b46ab-b2c8-474c-ac4e-61da0526fe22","Type":"ContainerDied","Data":"b437816d29cbf872ae3ad84d53cfd0af438db79368b9748d9eee9ae1c4704894"}
Sep 16 05:15:03.551383 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:03.551360    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn"
Sep 16 05:15:03.588588 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:03.588560    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84"
Sep 16 05:15:03.629862 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:03.629836    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj"
Sep 16 05:15:03.633188 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:03.633169    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv"
Sep 16 05:15:04.401205 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.401168    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj" event={"ID":"412ba4a1-96bd-4d43-9c2d-92e545121710","Type":"ContainerDied","Data":"98a405c42d37d257f5f834000184d59946ca004746f1dbfb6db89d99183fb914"}
Sep 16 05:15:04.401205 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.401193    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj"
Sep 16 05:15:04.401445 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.401231    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98a405c42d37d257f5f834000184d59946ca004746f1dbfb6db89d99183fb914"
Sep 16 05:15:04.402669 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.402636    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv"
Sep 16 05:15:04.402800 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.402690    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv" event={"ID":"6d74d6a8-33a0-40a8-96e6-805bddb36377","Type":"ContainerDied","Data":"c2ae4ad2f4faa3c794d46da0aa868f8c6a7184d09a0b9442f83c4acf4d0136f7"}
Sep 16 05:15:04.402800 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.402737    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2ae4ad2f4faa3c794d46da0aa868f8c6a7184d09a0b9442f83c4acf4d0136f7"
Sep 16 05:15:04.404141 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.404115    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84"
Sep 16 05:15:04.404248 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.404152    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84" event={"ID":"0a3b46ab-b2c8-474c-ac4e-61da0526fe22","Type":"ContainerDied","Data":"61aaa1ed785853fc01802585e77b16fddac9f2deced90ce93c88ec50fb9af330"}
Sep 16 05:15:04.404248 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.404193    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61aaa1ed785853fc01802585e77b16fddac9f2deced90ce93c88ec50fb9af330"
Sep 16 05:15:04.405543 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.405526    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn" event={"ID":"d35119d3-935e-4ff5-9ce6-cb5fff89b181","Type":"ContainerDied","Data":"c7c91f0352c79d318f8e67b30a4e3b2e8dfb58450605e1133247701c39d5dc83"}
Sep 16 05:15:04.405543 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.405539    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn"
Sep 16 05:15:04.405669 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:04.405556    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7c91f0352c79d318f8e67b30a4e3b2e8dfb58450605e1133247701c39d5dc83"
Sep 16 05:15:07.140630 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:07.140600    2559 scope.go:117] "RemoveContainer" containerID="1ea45e78fd4a29b08abc6ecb12e40e0e5438cec1512f3b69283a3d540f643e4b"
Sep 16 05:15:22.516754 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:22.516724    2559 generic.go:356] "Generic (PLEG): container finished" podID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerID="ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d" exitCode=0
Sep 16 05:15:22.517167 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:22.516804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" event={"ID":"02ef3735-7f1c-4006-9ab8-abb8a14719af","Type":"ContainerDied","Data":"ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d"}
Sep 16 05:15:22.517337 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:22.517320    2559 scope.go:117] "RemoveContainer" containerID="ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d"
Sep 16 05:15:22.518556 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:22.518528    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:15:22.518619 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:22.518597    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:15:22.518655 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:22.518627    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:15:23.532570 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:23.532535    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" event={"ID":"02ef3735-7f1c-4006-9ab8-abb8a14719af","Type":"ContainerStarted","Data":"a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77"}
Sep 16 05:15:24.052397 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:24.052360    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:15:24.053254 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:24.053221    2559 patch_prober.go:28] interesting pod/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 16 05:15:24.053370 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:24.053277    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 16 05:15:24.237091 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:24.237049    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:15:25.052813 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:25.052776    2559 patch_prober.go:28] interesting pod/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 16 05:15:25.053173 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:25.052847    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 16 05:15:26.051986 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:26.051952    2559 patch_prober.go:28] interesting pod/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 16 05:15:26.052147 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:26.052015    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 16 05:15:27.052868 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:27.052833    2559 patch_prober.go:28] interesting pod/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 16 05:15:27.053217 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:27.052895    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 16 05:15:28.052011 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:28.051977    2559 patch_prober.go:28] interesting pod/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 16 05:15:28.052181 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:28.052033    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 16 05:15:29.056722 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:29.056694    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:15:29.057666 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:29.057644    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:15:36.474991 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.474959    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"]
Sep 16 05:15:36.475405 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475393    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a3b46ab-b2c8-474c-ac4e-61da0526fe22" containerName="cleanup"
Sep 16 05:15:36.475445 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475406    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a3b46ab-b2c8-474c-ac4e-61da0526fe22" containerName="cleanup"
Sep 16 05:15:36.475445 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475422    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="412ba4a1-96bd-4d43-9c2d-92e545121710" containerName="cleanup"
Sep 16 05:15:36.475445 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475427    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="412ba4a1-96bd-4d43-9c2d-92e545121710" containerName="cleanup"
Sep 16 05:15:36.475445 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475434    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d74d6a8-33a0-40a8-96e6-805bddb36377" containerName="cleanup"
Sep 16 05:15:36.475445 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475440    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d74d6a8-33a0-40a8-96e6-805bddb36377" containerName="cleanup"
Sep 16 05:15:36.475613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475461    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d35119d3-935e-4ff5-9ce6-cb5fff89b181" containerName="cleanup"
Sep 16 05:15:36.475613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475465    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d35119d3-935e-4ff5-9ce6-cb5fff89b181" containerName="cleanup"
Sep 16 05:15:36.475613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475540    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d74d6a8-33a0-40a8-96e6-805bddb36377" containerName="cleanup"
Sep 16 05:15:36.475613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475548    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d35119d3-935e-4ff5-9ce6-cb5fff89b181" containerName="cleanup"
Sep 16 05:15:36.475613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475554    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a3b46ab-b2c8-474c-ac4e-61da0526fe22" containerName="cleanup"
Sep 16 05:15:36.475613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.475563    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="412ba4a1-96bd-4d43-9c2d-92e545121710" containerName="cleanup"
Sep 16 05:15:36.478172 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.478154    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"
Sep 16 05:15:36.480198 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.480178    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:15:36.487454 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.487432    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"]
Sep 16 05:15:36.528017 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.527981    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24c1ce1b-a91e-4695-8bcb-ffeee97d16ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-75559a-td8dx\" (UID: \"24c1ce1b-a91e-4695-8bcb-ffeee97d16ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"
Sep 16 05:15:36.629692 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.629651    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24c1ce1b-a91e-4695-8bcb-ffeee97d16ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-75559a-td8dx\" (UID: \"24c1ce1b-a91e-4695-8bcb-ffeee97d16ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"
Sep 16 05:15:36.630246 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.630224    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24c1ce1b-a91e-4695-8bcb-ffeee97d16ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-75559a-td8dx\" (UID: \"24c1ce1b-a91e-4695-8bcb-ffeee97d16ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"
Sep 16 05:15:36.790334 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:36.790270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"
Sep 16 05:15:37.060305 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:37.060282    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"]
Sep 16 05:15:37.062257 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:15:37.062227    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c1ce1b_a91e_4695_8bcb_ffeee97d16ec.slice/crio-4670c22ad72206d0037f55e1a376d3ff9ba04e3e25e54b1b183ed165bd0d0a2e WatchSource:0}: Error finding container 4670c22ad72206d0037f55e1a376d3ff9ba04e3e25e54b1b183ed165bd0d0a2e: Status 404 returned error can't find the container with id 4670c22ad72206d0037f55e1a376d3ff9ba04e3e25e54b1b183ed165bd0d0a2e
Sep 16 05:15:37.613220 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:37.613180    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx" event={"ID":"24c1ce1b-a91e-4695-8bcb-ffeee97d16ec","Type":"ContainerStarted","Data":"c91f4bf05e110ff2966ca17c94d2ea6cb971b0f2a79fac89887fe127ca13c8cc"}
Sep 16 05:15:37.613590 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:37.613249    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx" event={"ID":"24c1ce1b-a91e-4695-8bcb-ffeee97d16ec","Type":"ContainerStarted","Data":"4670c22ad72206d0037f55e1a376d3ff9ba04e3e25e54b1b183ed165bd0d0a2e"}
Sep 16 05:15:37.627708 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:37.627661    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx" podStartSLOduration=1.6276473949999999 podStartE2EDuration="1.627647395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:15:37.625629927 +0000 UTC m=+1591.286809117" watchObservedRunningTime="2026-09-16 05:15:37.627647395 +0000 UTC m=+1591.288826572"
Sep 16 05:15:38.620181 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:38.620145    2559 generic.go:356] "Generic (PLEG): container finished" podID="24c1ce1b-a91e-4695-8bcb-ffeee97d16ec" containerID="c91f4bf05e110ff2966ca17c94d2ea6cb971b0f2a79fac89887fe127ca13c8cc" exitCode=0
Sep 16 05:15:38.620646 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:38.620234    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx" event={"ID":"24c1ce1b-a91e-4695-8bcb-ffeee97d16ec","Type":"ContainerDied","Data":"c91f4bf05e110ff2966ca17c94d2ea6cb971b0f2a79fac89887fe127ca13c8cc"}
Sep 16 05:15:39.765295 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:39.765271    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"
Sep 16 05:15:39.857139 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:39.857112    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24c1ce1b-a91e-4695-8bcb-ffeee97d16ec-maas-api-service-ca\") pod \"24c1ce1b-a91e-4695-8bcb-ffeee97d16ec\" (UID: \"24c1ce1b-a91e-4695-8bcb-ffeee97d16ec\") "
Sep 16 05:15:39.857468 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:39.857441    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24c1ce1b-a91e-4695-8bcb-ffeee97d16ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "24c1ce1b-a91e-4695-8bcb-ffeee97d16ec" (UID: "24c1ce1b-a91e-4695-8bcb-ffeee97d16ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:15:39.857842 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:39.857819    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24c1ce1b-a91e-4695-8bcb-ffeee97d16ec-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:15:40.632577 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:40.632551    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"
Sep 16 05:15:40.632761 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:40.632604    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx" event={"ID":"24c1ce1b-a91e-4695-8bcb-ffeee97d16ec","Type":"ContainerDied","Data":"4670c22ad72206d0037f55e1a376d3ff9ba04e3e25e54b1b183ed165bd0d0a2e"}
Sep 16 05:15:40.632761 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:40.632661    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4670c22ad72206d0037f55e1a376d3ff9ba04e3e25e54b1b183ed165bd0d0a2e"
Sep 16 05:15:52.276891 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.276858    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"]
Sep 16 05:15:52.277331 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.277095    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt" podUID="05647489-b095-434a-ab13-3921a7b31fb8" containerName="payload-processing" containerID="cri-o://3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2" gracePeriod=30
Sep 16 05:15:52.455590 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.455557    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"]
Sep 16 05:15:52.458101 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.458077    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-75559a-td8dx"]
Sep 16 05:15:52.523507 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.523466    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:15:52.571548 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.571448    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05647489-b095-434a-ab13-3921a7b31fb8-plugins-config-volume\") pod \"05647489-b095-434a-ab13-3921a7b31fb8\" (UID: \"05647489-b095-434a-ab13-3921a7b31fb8\") "
Sep 16 05:15:52.571548 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.571542    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzk7x\" (UniqueName: \"kubernetes.io/projected/05647489-b095-434a-ab13-3921a7b31fb8-kube-api-access-nzk7x\") pod \"05647489-b095-434a-ab13-3921a7b31fb8\" (UID: \"05647489-b095-434a-ab13-3921a7b31fb8\") "
Sep 16 05:15:52.571890 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.571865    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05647489-b095-434a-ab13-3921a7b31fb8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05647489-b095-434a-ab13-3921a7b31fb8" (UID: "05647489-b095-434a-ab13-3921a7b31fb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:15:52.572064 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.572042    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05647489-b095-434a-ab13-3921a7b31fb8-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:15:52.574098 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.574064    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05647489-b095-434a-ab13-3921a7b31fb8-kube-api-access-nzk7x" (OuterVolumeSpecName: "kube-api-access-nzk7x") pod "05647489-b095-434a-ab13-3921a7b31fb8" (UID: "05647489-b095-434a-ab13-3921a7b31fb8"). InnerVolumeSpecName "kube-api-access-nzk7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:15:52.673068 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.673040    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzk7x\" (UniqueName: \"kubernetes.io/projected/05647489-b095-434a-ab13-3921a7b31fb8-kube-api-access-nzk7x\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:15:52.706143 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.706115    2559 generic.go:356] "Generic (PLEG): container finished" podID="05647489-b095-434a-ab13-3921a7b31fb8" containerID="3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2" exitCode=0
Sep 16 05:15:52.706279 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.706162    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"
Sep 16 05:15:52.706279 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.706186    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt" event={"ID":"05647489-b095-434a-ab13-3921a7b31fb8","Type":"ContainerDied","Data":"3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2"}
Sep 16 05:15:52.706279 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.706244    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt" event={"ID":"05647489-b095-434a-ab13-3921a7b31fb8","Type":"ContainerDied","Data":"d2dc508cbc677f8f401f543a53e475c1d008d6b3010a55b42202d0d50236be9d"}
Sep 16 05:15:52.706279 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.706266    2559 scope.go:117] "RemoveContainer" containerID="3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2"
Sep 16 05:15:52.716147 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.716133    2559 scope.go:117] "RemoveContainer" containerID="3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2"
Sep 16 05:15:52.716432 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:15:52.716414    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2\": container with ID starting with 3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2 not found: ID does not exist" containerID="3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2"
Sep 16 05:15:52.716526 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.716444    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2"} err="failed to get container status \"3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2\": rpc error: code = NotFound desc = could not find container \"3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2\": container with ID starting with 3dc8149cbab1fabc5f1a62f628f95d18de866b391dc32cd1588a85ba29282af2 not found: ID does not exist"
Sep 16 05:15:52.728429 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.728389    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"]
Sep 16 05:15:52.732127 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.732104    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-75559a-676d9dcf47-6kwgt"]
Sep 16 05:15:52.785500 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.785463    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05647489-b095-434a-ab13-3921a7b31fb8" path="/var/lib/kubelet/pods/05647489-b095-434a-ab13-3921a7b31fb8/volumes"
Sep 16 05:15:52.785860 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:52.785846    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24c1ce1b-a91e-4695-8bcb-ffeee97d16ec" path="/var/lib/kubelet/pods/24c1ce1b-a91e-4695-8bcb-ffeee97d16ec/volumes"
Sep 16 05:15:58.905786 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:58.905695    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"]
Sep 16 05:15:58.906258 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:58.905975    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy" containerID="cri-o://a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77" gracePeriod=30
Sep 16 05:15:59.059418 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.059380    2559 patch_prober.go:28] interesting pod/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 05:15:59.059608 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.059455    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 05:15:59.250602 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.250571    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"]
Sep 16 05:15:59.251019 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.251007    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05647489-b095-434a-ab13-3921a7b31fb8" containerName="payload-processing"
Sep 16 05:15:59.251063 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.251021    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05647489-b095-434a-ab13-3921a7b31fb8" containerName="payload-processing"
Sep 16 05:15:59.251063 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.251049    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24c1ce1b-a91e-4695-8bcb-ffeee97d16ec" containerName="revoke-keys"
Sep 16 05:15:59.251063 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.251056    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24c1ce1b-a91e-4695-8bcb-ffeee97d16ec" containerName="revoke-keys"
Sep 16 05:15:59.251159 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.251134    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="05647489-b095-434a-ab13-3921a7b31fb8" containerName="payload-processing"
Sep 16 05:15:59.251159 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.251146    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="24c1ce1b-a91e-4695-8bcb-ffeee97d16ec" containerName="revoke-keys"
Sep 16 05:15:59.253868 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.253852    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"
Sep 16 05:15:59.255710 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.255683    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:15:59.262296 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.262267    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"]
Sep 16 05:15:59.334994 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.334961    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ad50905-c544-429c-9679-f7d34ace93c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-113278-5s5nf\" (UID: \"3ad50905-c544-429c-9679-f7d34ace93c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"
Sep 16 05:15:59.436380 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.436351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ad50905-c544-429c-9679-f7d34ace93c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-113278-5s5nf\" (UID: \"3ad50905-c544-429c-9679-f7d34ace93c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"
Sep 16 05:15:59.437002 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.436979    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ad50905-c544-429c-9679-f7d34ace93c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-113278-5s5nf\" (UID: \"3ad50905-c544-429c-9679-f7d34ace93c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"
Sep 16 05:15:59.564806 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.564729    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"
Sep 16 05:15:59.835197 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:15:59.835032    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"]
Sep 16 05:15:59.837511 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:15:59.837461    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad50905_c544_429c_9679_f7d34ace93c1.slice/crio-4aa7e3c1ffb57d18893d9079a096d520faae7b3908efe0701955713a5744944d WatchSource:0}: Error finding container 4aa7e3c1ffb57d18893d9079a096d520faae7b3908efe0701955713a5744944d: Status 404 returned error can't find the container with id 4aa7e3c1ffb57d18893d9079a096d520faae7b3908efe0701955713a5744944d
Sep 16 05:16:00.755347 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:00.755314    2559 generic.go:356] "Generic (PLEG): container finished" podID="3ad50905-c544-429c-9679-f7d34ace93c1" containerID="6059dc21f20b0e6874b538b72c5eafb9c3c71b063bee714ebacb6dd504a9b249" exitCode=0
Sep 16 05:16:00.755694 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:00.755406    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf" event={"ID":"3ad50905-c544-429c-9679-f7d34ace93c1","Type":"ContainerDied","Data":"6059dc21f20b0e6874b538b72c5eafb9c3c71b063bee714ebacb6dd504a9b249"}
Sep 16 05:16:00.755694 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:00.755492    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf" event={"ID":"3ad50905-c544-429c-9679-f7d34ace93c1","Type":"ContainerStarted","Data":"4aa7e3c1ffb57d18893d9079a096d520faae7b3908efe0701955713a5744944d"}
Sep 16 05:16:01.902741 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:01.902717    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"
Sep 16 05:16:02.064097 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:02.064023    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ad50905-c544-429c-9679-f7d34ace93c1-maas-api-service-ca\") pod \"3ad50905-c544-429c-9679-f7d34ace93c1\" (UID: \"3ad50905-c544-429c-9679-f7d34ace93c1\") "
Sep 16 05:16:02.064348 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:02.064326    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ad50905-c544-429c-9679-f7d34ace93c1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ad50905-c544-429c-9679-f7d34ace93c1" (UID: "3ad50905-c544-429c-9679-f7d34ace93c1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:16:02.165647 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:02.165621    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ad50905-c544-429c-9679-f7d34ace93c1-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:02.768550 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:02.768521    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"
Sep 16 05:16:02.768740 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:02.768554    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf" event={"ID":"3ad50905-c544-429c-9679-f7d34ace93c1","Type":"ContainerDied","Data":"4aa7e3c1ffb57d18893d9079a096d520faae7b3908efe0701955713a5744944d"}
Sep 16 05:16:02.768740 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:02.768599    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4aa7e3c1ffb57d18893d9079a096d520faae7b3908efe0701955713a5744944d"
Sep 16 05:16:04.165529 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.165506    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:16:04.287105 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287077    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-certs\") pod \"02ef3735-7f1c-4006-9ab8-abb8a14719af\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") "
Sep 16 05:16:04.287272 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287122    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-envoy\") pod \"02ef3735-7f1c-4006-9ab8-abb8a14719af\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") "
Sep 16 05:16:04.287272 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287155    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-credential-socket\") pod \"02ef3735-7f1c-4006-9ab8-abb8a14719af\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") "
Sep 16 05:16:04.287272 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287186    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-data\") pod \"02ef3735-7f1c-4006-9ab8-abb8a14719af\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") "
Sep 16 05:16:04.287432 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287286    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-token\") pod \"02ef3735-7f1c-4006-9ab8-abb8a14719af\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") "
Sep 16 05:16:04.287432 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287321    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-podinfo\") pod \"02ef3735-7f1c-4006-9ab8-abb8a14719af\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") "
Sep 16 05:16:04.287432 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287354    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-socket\") pod \"02ef3735-7f1c-4006-9ab8-abb8a14719af\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") "
Sep 16 05:16:04.287432 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287388    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02ef3735-7f1c-4006-9ab8-abb8a14719af" (UID: "02ef3735-7f1c-4006-9ab8-abb8a14719af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:04.287664 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287439    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t72bl\" (UniqueName: \"kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-kube-api-access-t72bl\") pod \"02ef3735-7f1c-4006-9ab8-abb8a14719af\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") "
Sep 16 05:16:04.287664 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287466    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ef3735-7f1c-4006-9ab8-abb8a14719af-istiod-ca-cert\") pod \"02ef3735-7f1c-4006-9ab8-abb8a14719af\" (UID: \"02ef3735-7f1c-4006-9ab8-abb8a14719af\") "
Sep 16 05:16:04.287664 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287514    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02ef3735-7f1c-4006-9ab8-abb8a14719af" (UID: "02ef3735-7f1c-4006-9ab8-abb8a14719af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:04.287664 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287589    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-data" (OuterVolumeSpecName: "istio-data") pod "02ef3735-7f1c-4006-9ab8-abb8a14719af" (UID: "02ef3735-7f1c-4006-9ab8-abb8a14719af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:04.287873 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287666    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02ef3735-7f1c-4006-9ab8-abb8a14719af" (UID: "02ef3735-7f1c-4006-9ab8-abb8a14719af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:04.287917 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287898    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02ef3735-7f1c-4006-9ab8-abb8a14719af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02ef3735-7f1c-4006-9ab8-abb8a14719af" (UID: "02ef3735-7f1c-4006-9ab8-abb8a14719af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:16:04.287966 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287948    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:04.288006 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287972    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:04.288006 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287986    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:04.288006 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.287998    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:04.289850 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.289819    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-kube-api-access-t72bl" (OuterVolumeSpecName: "kube-api-access-t72bl") pod "02ef3735-7f1c-4006-9ab8-abb8a14719af" (UID: "02ef3735-7f1c-4006-9ab8-abb8a14719af"). InnerVolumeSpecName "kube-api-access-t72bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:16:04.289967 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.289854    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02ef3735-7f1c-4006-9ab8-abb8a14719af" (UID: "02ef3735-7f1c-4006-9ab8-abb8a14719af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:16:04.289967 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.289938    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-token" (OuterVolumeSpecName: "istio-token") pod "02ef3735-7f1c-4006-9ab8-abb8a14719af" (UID: "02ef3735-7f1c-4006-9ab8-abb8a14719af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:16:04.289967 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.289947    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02ef3735-7f1c-4006-9ab8-abb8a14719af" (UID: "02ef3735-7f1c-4006-9ab8-abb8a14719af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:04.388850 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.388821    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:04.388850 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.388842    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:04.388850 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.388851    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t72bl\" (UniqueName: \"kubernetes.io/projected/02ef3735-7f1c-4006-9ab8-abb8a14719af-kube-api-access-t72bl\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:04.389035 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.388862    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ef3735-7f1c-4006-9ab8-abb8a14719af-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:04.389035 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.388870    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ef3735-7f1c-4006-9ab8-abb8a14719af-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:04.781250 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.781212    2559 generic.go:356] "Generic (PLEG): container finished" podID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerID="a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77" exitCode=0
Sep 16 05:16:04.781409 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.781294    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"
Sep 16 05:16:04.786680 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.786657    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" event={"ID":"02ef3735-7f1c-4006-9ab8-abb8a14719af","Type":"ContainerDied","Data":"a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77"}
Sep 16 05:16:04.786800 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.786698    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd" event={"ID":"02ef3735-7f1c-4006-9ab8-abb8a14719af","Type":"ContainerDied","Data":"fd0482186f97f493171c2fd4b9be0963c0dba47ce094ff04a29a4e43d46ea0cf"}
Sep 16 05:16:04.786800 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.786728    2559 scope.go:117] "RemoveContainer" containerID="a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77"
Sep 16 05:16:04.799739 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.799718    2559 scope.go:117] "RemoveContainer" containerID="ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d"
Sep 16 05:16:04.806147 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.806116    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"]
Sep 16 05:16:04.809637 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.809603    2559 scope.go:117] "RemoveContainer" containerID="a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77"
Sep 16 05:16:04.810007 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:16:04.809976    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77\": container with ID starting with a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77 not found: ID does not exist" containerID="a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77"
Sep 16 05:16:04.810086 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.810019    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77"} err="failed to get container status \"a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77\": rpc error: code = NotFound desc = could not find container \"a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77\": container with ID starting with a4e9c2688dddbaba9111539196b863bf04176ade23bc9b2bba04566f1bb11a77 not found: ID does not exist"
Sep 16 05:16:04.810086 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.810046    2559 scope.go:117] "RemoveContainer" containerID="ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d"
Sep 16 05:16:04.810365 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:16:04.810332    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d\": container with ID starting with ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d not found: ID does not exist" containerID="ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d"
Sep 16 05:16:04.810427 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.810379    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d"} err="failed to get container status \"ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d\": rpc error: code = NotFound desc = could not find container \"ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d\": container with ID starting with ad0e770328c3129a3ee7efed2acec1bafe7af4ca9be021e428d4c2020829f09d not found: ID does not exist"
Sep 16 05:16:04.811290 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:04.811273    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-75559a-openshift-default-7c6b687bc6-dzsrd"]
Sep 16 05:16:06.786798 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.786771    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" path="/var/lib/kubelet/pods/02ef3735-7f1c-4006-9ab8-abb8a14719af/volumes"
Sep 16 05:16:06.938351 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.938314    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"]
Sep 16 05:16:06.938839 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.938824    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad50905-c544-429c-9679-f7d34ace93c1" containerName="revoke-keys"
Sep 16 05:16:06.938897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.938841    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad50905-c544-429c-9679-f7d34ace93c1" containerName="revoke-keys"
Sep 16 05:16:06.938897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.938858    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy"
Sep 16 05:16:06.938897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.938863    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy"
Sep 16 05:16:06.938897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.938879    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy"
Sep 16 05:16:06.938897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.938884    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy"
Sep 16 05:16:06.939046 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.938943    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy"
Sep 16 05:16:06.939046 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.938955    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ad50905-c544-429c-9679-f7d34ace93c1" containerName="revoke-keys"
Sep 16 05:16:06.941945 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.941926    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"
Sep 16 05:16:06.943827 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.943807    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:16:06.949034 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:06.948950    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"]
Sep 16 05:16:07.114984 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:07.114910    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09d5233-7dcb-4826-a83a-317f2840c581-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf\" (UID: \"a09d5233-7dcb-4826-a83a-317f2840c581\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"
Sep 16 05:16:07.169999 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:07.169975    2559 scope.go:117] "RemoveContainer" containerID="9a2452560dd5047e84fbbea3d36fa7536a7c50f2e092b770bdf31f57eb21eda9"
Sep 16 05:16:07.216183 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:07.216158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09d5233-7dcb-4826-a83a-317f2840c581-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf\" (UID: \"a09d5233-7dcb-4826-a83a-317f2840c581\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"
Sep 16 05:16:07.216732 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:07.216712    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09d5233-7dcb-4826-a83a-317f2840c581-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf\" (UID: \"a09d5233-7dcb-4826-a83a-317f2840c581\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"
Sep 16 05:16:07.253285 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:07.253261    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"
Sep 16 05:16:07.526645 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:07.526621    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"]
Sep 16 05:16:07.528304 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:16:07.528279    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda09d5233_7dcb_4826_a83a_317f2840c581.slice/crio-2532bfa9518f9cad81554712e503bd3ad8eff1b39d87d27cea45d5fb02187976 WatchSource:0}: Error finding container 2532bfa9518f9cad81554712e503bd3ad8eff1b39d87d27cea45d5fb02187976: Status 404 returned error can't find the container with id 2532bfa9518f9cad81554712e503bd3ad8eff1b39d87d27cea45d5fb02187976
Sep 16 05:16:07.800506 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:07.800405    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf" event={"ID":"a09d5233-7dcb-4826-a83a-317f2840c581","Type":"ContainerStarted","Data":"2532bfa9518f9cad81554712e503bd3ad8eff1b39d87d27cea45d5fb02187976"}
Sep 16 05:16:08.810563 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:08.810525    2559 generic.go:356] "Generic (PLEG): container finished" podID="a09d5233-7dcb-4826-a83a-317f2840c581" containerID="26bb02edeaae0322f033ae4b8ed597d4584b5ec02df81d8f35af06606fc567fc" exitCode=0
Sep 16 05:16:08.810968 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:08.810607    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf" event={"ID":"a09d5233-7dcb-4826-a83a-317f2840c581","Type":"ContainerDied","Data":"26bb02edeaae0322f033ae4b8ed597d4584b5ec02df81d8f35af06606fc567fc"}
Sep 16 05:16:09.957222 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:09.957193    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"
Sep 16 05:16:10.043000 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:10.042975    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09d5233-7dcb-4826-a83a-317f2840c581-maas-api-service-ca\") pod \"a09d5233-7dcb-4826-a83a-317f2840c581\" (UID: \"a09d5233-7dcb-4826-a83a-317f2840c581\") "
Sep 16 05:16:10.043291 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:10.043269    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a09d5233-7dcb-4826-a83a-317f2840c581-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a09d5233-7dcb-4826-a83a-317f2840c581" (UID: "a09d5233-7dcb-4826-a83a-317f2840c581"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:16:10.144031 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:10.143957    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a09d5233-7dcb-4826-a83a-317f2840c581-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:10.823682 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:10.823652    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"
Sep 16 05:16:10.823801 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:10.823668    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf" event={"ID":"a09d5233-7dcb-4826-a83a-317f2840c581","Type":"ContainerDied","Data":"2532bfa9518f9cad81554712e503bd3ad8eff1b39d87d27cea45d5fb02187976"}
Sep 16 05:16:10.823801 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:10.823721    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2532bfa9518f9cad81554712e503bd3ad8eff1b39d87d27cea45d5fb02187976"
Sep 16 05:16:11.912473 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:11.912436    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"]
Sep 16 05:16:11.961216 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:11.961182    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"]
Sep 16 05:16:15.202799 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:15.202764    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"]
Sep 16 05:16:15.205099 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:15.205077    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-113278-5s5nf"]
Sep 16 05:16:16.785841 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:16.785801    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ad50905-c544-429c-9679-f7d34ace93c1" path="/var/lib/kubelet/pods/3ad50905-c544-429c-9679-f7d34ace93c1/volumes"
Sep 16 05:16:21.997873 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:21.997836    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"]
Sep 16 05:16:21.998321 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:21.998308    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a09d5233-7dcb-4826-a83a-317f2840c581" containerName="revoke-keys"
Sep 16 05:16:21.998321 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:21.998322    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a09d5233-7dcb-4826-a83a-317f2840c581" containerName="revoke-keys"
Sep 16 05:16:21.998393 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:21.998383    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a09d5233-7dcb-4826-a83a-317f2840c581" containerName="revoke-keys"
Sep 16 05:16:21.998393 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:21.998391    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ef3735-7f1c-4006-9ab8-abb8a14719af" containerName="istio-proxy"
Sep 16 05:16:22.001693 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:22.001676    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"
Sep 16 05:16:22.003742 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:22.003723    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:16:22.008394 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:22.008371    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"]
Sep 16 05:16:22.057206 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:22.057183    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5e60203-b629-4c98-9952-1d20757dadff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt\" (UID: \"f5e60203-b629-4c98-9952-1d20757dadff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"
Sep 16 05:16:22.158402 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:22.158374    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5e60203-b629-4c98-9952-1d20757dadff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt\" (UID: \"f5e60203-b629-4c98-9952-1d20757dadff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"
Sep 16 05:16:22.158974 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:22.158950    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5e60203-b629-4c98-9952-1d20757dadff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt\" (UID: \"f5e60203-b629-4c98-9952-1d20757dadff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"
Sep 16 05:16:22.314420 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:22.314361    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"
Sep 16 05:16:22.597578 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:22.597550    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"]
Sep 16 05:16:22.598046 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:16:22.598019    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5e60203_b629_4c98_9952_1d20757dadff.slice/crio-b8bde01f99da0a647374236b1210d27db31e4e985a0a6d067af1d98cf2b03366 WatchSource:0}: Error finding container b8bde01f99da0a647374236b1210d27db31e4e985a0a6d067af1d98cf2b03366: Status 404 returned error can't find the container with id b8bde01f99da0a647374236b1210d27db31e4e985a0a6d067af1d98cf2b03366
Sep 16 05:16:22.894108 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:22.894079    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt" event={"ID":"f5e60203-b629-4c98-9952-1d20757dadff","Type":"ContainerStarted","Data":"b8bde01f99da0a647374236b1210d27db31e4e985a0a6d067af1d98cf2b03366"}
Sep 16 05:16:23.023546 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.023458    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn"]
Sep 16 05:16:23.025842 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.025821    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-12b6c6-29825595-zv9tn"]
Sep 16 05:16:23.056380 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.056353    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"]
Sep 16 05:16:23.056647 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.056606    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd" podUID="0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd" containerName="payload-pre-processing" containerID="cri-o://7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3" gracePeriod=30
Sep 16 05:16:23.218322 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.218291    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"]
Sep 16 05:16:23.223436 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.223412    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-12b6c6-qkqqf"]
Sep 16 05:16:23.293138 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.293105    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:16:23.369453 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.369416    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbbtl\" (UniqueName: \"kubernetes.io/projected/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-kube-api-access-xbbtl\") pod \"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd\" (UID: \"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd\") "
Sep 16 05:16:23.369647 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.369470    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-plugins-config-volume\") pod \"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd\" (UID: \"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd\") "
Sep 16 05:16:23.369874 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.369849    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd" (UID: "0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:16:23.371953 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.371926    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-kube-api-access-xbbtl" (OuterVolumeSpecName: "kube-api-access-xbbtl") pod "0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd" (UID: "0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd"). InnerVolumeSpecName "kube-api-access-xbbtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:16:23.470387 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.470316    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:23.470387 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.470345    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbbtl\" (UniqueName: \"kubernetes.io/projected/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd-kube-api-access-xbbtl\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:23.900882 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.900848    2559 generic.go:356] "Generic (PLEG): container finished" podID="0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd" containerID="7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3" exitCode=0
Sep 16 05:16:23.901076 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.900890    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"
Sep 16 05:16:23.901076 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.900941    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd" event={"ID":"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd","Type":"ContainerDied","Data":"7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3"}
Sep 16 05:16:23.901076 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.901004    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd" event={"ID":"0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd","Type":"ContainerDied","Data":"f2a6f138bca0b14d5740fb843cd5d662b049736d4a59144e647ef39e6f79c594"}
Sep 16 05:16:23.901076 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.901032    2559 scope.go:117] "RemoveContainer" containerID="7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3"
Sep 16 05:16:23.902999 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.902781    2559 generic.go:356] "Generic (PLEG): container finished" podID="f5e60203-b629-4c98-9952-1d20757dadff" containerID="7c20cd067d3c660966ab8e396b0e7096b9ab2b573a72fcca54aea41043babd19" exitCode=0
Sep 16 05:16:23.902999 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.902949    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt" event={"ID":"f5e60203-b629-4c98-9952-1d20757dadff","Type":"ContainerDied","Data":"7c20cd067d3c660966ab8e396b0e7096b9ab2b573a72fcca54aea41043babd19"}
Sep 16 05:16:23.911726 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.911708    2559 scope.go:117] "RemoveContainer" containerID="7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3"
Sep 16 05:16:23.911978 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:16:23.911959    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3\": container with ID starting with 7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3 not found: ID does not exist" containerID="7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3"
Sep 16 05:16:23.912013 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.911987    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3"} err="failed to get container status \"7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3\": rpc error: code = NotFound desc = could not find container \"7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3\": container with ID starting with 7010155bdc8ebfd4e51da8f20051db1b9f3d49d58a2e89457f023bfca7929ca3 not found: ID does not exist"
Sep 16 05:16:23.932391 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.932370    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"]
Sep 16 05:16:23.940554 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:23.940533    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-12b6c6-b7bf8b67d-dbqjd"]
Sep 16 05:16:24.785753 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:24.785722    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd" path="/var/lib/kubelet/pods/0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd/volumes"
Sep 16 05:16:24.786105 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:24.786034    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a09d5233-7dcb-4826-a83a-317f2840c581" path="/var/lib/kubelet/pods/a09d5233-7dcb-4826-a83a-317f2840c581/volumes"
Sep 16 05:16:24.786278 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:24.786264    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d35119d3-935e-4ff5-9ce6-cb5fff89b181" path="/var/lib/kubelet/pods/d35119d3-935e-4ff5-9ce6-cb5fff89b181/volumes"
Sep 16 05:16:25.053137 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:25.053083    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"
Sep 16 05:16:25.084895 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:25.084868    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5e60203-b629-4c98-9952-1d20757dadff-maas-api-service-ca\") pod \"f5e60203-b629-4c98-9952-1d20757dadff\" (UID: \"f5e60203-b629-4c98-9952-1d20757dadff\") "
Sep 16 05:16:25.085276 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:25.085249    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5e60203-b629-4c98-9952-1d20757dadff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f5e60203-b629-4c98-9952-1d20757dadff" (UID: "f5e60203-b629-4c98-9952-1d20757dadff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:16:25.185719 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:25.185692    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5e60203-b629-4c98-9952-1d20757dadff-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:25.917109 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:25.917073    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"
Sep 16 05:16:25.917598 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:25.917073    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt" event={"ID":"f5e60203-b629-4c98-9952-1d20757dadff","Type":"ContainerDied","Data":"b8bde01f99da0a647374236b1210d27db31e4e985a0a6d067af1d98cf2b03366"}
Sep 16 05:16:25.917598 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:25.917195    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8bde01f99da0a647374236b1210d27db31e4e985a0a6d067af1d98cf2b03366"
Sep 16 05:16:26.931867 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:26.931810    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw" podUID="1e9865e0-c7fa-4b94-b548-15c8be32a6ce" containerName="main" containerID="cri-o://803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca" gracePeriod=45
Sep 16 05:16:26.980856 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:26.980827    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs" podUID="df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" containerName="main" containerID="cri-o://1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298" gracePeriod=45
Sep 16 05:16:27.228200 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.228171    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:16:27.269254 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.269215    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:16:27.307207 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307176    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-model-cache\") pod \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") "
Sep 16 05:16:27.307345 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307224    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-home\") pod \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") "
Sep 16 05:16:27.307345 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307274    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-dshm\") pod \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") "
Sep 16 05:16:27.307345 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307300    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tls-certs\") pod \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") "
Sep 16 05:16:27.307345 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307318    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-dshm\") pod \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") "
Sep 16 05:16:27.307606 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307538    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-model-cache" (OuterVolumeSpecName: "model-cache") pod "1e9865e0-c7fa-4b94-b548-15c8be32a6ce" (UID: "1e9865e0-c7fa-4b94-b548-15c8be32a6ce"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:27.307606 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307572    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-home" (OuterVolumeSpecName: "home") pod "1e9865e0-c7fa-4b94-b548-15c8be32a6ce" (UID: "1e9865e0-c7fa-4b94-b548-15c8be32a6ce"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:27.307721 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307646    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-home\") pod \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") "
Sep 16 05:16:27.307721 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307703    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tmp-dir\") pod \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") "
Sep 16 05:16:27.307822 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307741    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tmp-dir\") pod \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") "
Sep 16 05:16:27.307822 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307772    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvszx\" (UniqueName: \"kubernetes.io/projected/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-kube-api-access-xvszx\") pod \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") "
Sep 16 05:16:27.307822 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307798    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-model-cache\") pod \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") "
Sep 16 05:16:27.308128 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307826    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9qlf\" (UniqueName: \"kubernetes.io/projected/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-kube-api-access-h9qlf\") pod \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\" (UID: \"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4\") "
Sep 16 05:16:27.308128 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.307894    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tls-certs\") pod \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\" (UID: \"1e9865e0-c7fa-4b94-b548-15c8be32a6ce\") "
Sep 16 05:16:27.308128 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.308022    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" (UID: "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:27.308288 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.308249    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-home" (OuterVolumeSpecName: "home") pod "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" (UID: "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:27.308639 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.308618    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-model-cache\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.309163 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.309148    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-home\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.309361 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.309348    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-home\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.309541 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.309527    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tmp-dir\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.309658 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.308962    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-model-cache" (OuterVolumeSpecName: "model-cache") pod "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" (UID: "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:27.309755 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.309050    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1e9865e0-c7fa-4b94-b548-15c8be32a6ce" (UID: "1e9865e0-c7fa-4b94-b548-15c8be32a6ce"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:27.310328 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.310294    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-dshm" (OuterVolumeSpecName: "dshm") pod "1e9865e0-c7fa-4b94-b548-15c8be32a6ce" (UID: "1e9865e0-c7fa-4b94-b548-15c8be32a6ce"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:27.310328 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.310307    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-dshm" (OuterVolumeSpecName: "dshm") pod "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" (UID: "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:27.310527 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.310472    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" (UID: "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 05:16:27.311324 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.311297    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-kube-api-access-xvszx" (OuterVolumeSpecName: "kube-api-access-xvszx") pod "1e9865e0-c7fa-4b94-b548-15c8be32a6ce" (UID: "1e9865e0-c7fa-4b94-b548-15c8be32a6ce"). InnerVolumeSpecName "kube-api-access-xvszx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:16:27.312304 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.312279    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1e9865e0-c7fa-4b94-b548-15c8be32a6ce" (UID: "1e9865e0-c7fa-4b94-b548-15c8be32a6ce"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 05:16:27.312304 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.312293    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-kube-api-access-h9qlf" (OuterVolumeSpecName: "kube-api-access-h9qlf") pod "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" (UID: "df7a43ff-35e2-4c4e-b77c-0404e4c38ef4"). InnerVolumeSpecName "kube-api-access-h9qlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:16:27.410347 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.410319    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tmp-dir\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.410347 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.410343    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvszx\" (UniqueName: \"kubernetes.io/projected/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-kube-api-access-xvszx\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.410525 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.410353    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-model-cache\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.410525 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.410362    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9qlf\" (UniqueName: \"kubernetes.io/projected/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-kube-api-access-h9qlf\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.410525 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.410370    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-tls-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.410525 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.410378    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-dshm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.410525 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.410384    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4-tls-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.410525 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.410391    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e9865e0-c7fa-4b94-b548-15c8be32a6ce-dshm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:27.929467 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.929431    2559 generic.go:356] "Generic (PLEG): container finished" podID="1e9865e0-c7fa-4b94-b548-15c8be32a6ce" containerID="803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca" exitCode=0
Sep 16 05:16:27.929467 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.929469    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"
Sep 16 05:16:27.929689 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.929494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw" event={"ID":"1e9865e0-c7fa-4b94-b548-15c8be32a6ce","Type":"ContainerDied","Data":"803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca"}
Sep 16 05:16:27.929689 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.929543    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw" event={"ID":"1e9865e0-c7fa-4b94-b548-15c8be32a6ce","Type":"ContainerDied","Data":"3643d803a8ae8012fc7aa798d20f5486a070e85566aebe9d1ef462766842a06d"}
Sep 16 05:16:27.929689 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.929561    2559 scope.go:117] "RemoveContainer" containerID="803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca"
Sep 16 05:16:27.931229 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.931203    2559 generic.go:356] "Generic (PLEG): container finished" podID="df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" containerID="1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298" exitCode=0
Sep 16 05:16:27.931315 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.931249    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs" event={"ID":"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4","Type":"ContainerDied","Data":"1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298"}
Sep 16 05:16:27.931315 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.931276    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs" event={"ID":"df7a43ff-35e2-4c4e-b77c-0404e4c38ef4","Type":"ContainerDied","Data":"93da428cd600cb001969eb38eb4dd77692a86cabda1133e879cdd02bcb7d3edc"}
Sep 16 05:16:27.931431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.931410    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"
Sep 16 05:16:27.939276 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.939103    2559 scope.go:117] "RemoveContainer" containerID="803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca"
Sep 16 05:16:27.939528 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:16:27.939393    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca\": container with ID starting with 803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca not found: ID does not exist" containerID="803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca"
Sep 16 05:16:27.939528 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.939417    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca"} err="failed to get container status \"803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca\": rpc error: code = NotFound desc = could not find container \"803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca\": container with ID starting with 803f65815a862b29cf6042dd170222f11f8efc2302928afdcb583fd9b6d308ca not found: ID does not exist"
Sep 16 05:16:27.939528 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.939432    2559 scope.go:117] "RemoveContainer" containerID="1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298"
Sep 16 05:16:27.956295 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.956281    2559 scope.go:117] "RemoveContainer" containerID="1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298"
Sep 16 05:16:27.956553 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:16:27.956536    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298\": container with ID starting with 1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298 not found: ID does not exist" containerID="1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298"
Sep 16 05:16:27.956611 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.956560    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298"} err="failed to get container status \"1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298\": rpc error: code = NotFound desc = could not find container \"1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298\": container with ID starting with 1e571a02a251c29c785c1cd46af039a69d8a2138084ee3f5ed2c47328d4b5298 not found: ID does not exist"
Sep 16 05:16:27.963800 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.963781    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"]
Sep 16 05:16:27.969819 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.969801    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/distinct-2-w4-12b6c6-kserve-5cf664d6fd-vcvfw"]
Sep 16 05:16:27.978926 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.978909    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"]
Sep 16 05:16:27.981357 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:27.981337    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-12b6c6/simulator-w4-12b6c6-kserve-54fd86fbc-lrjbs"]
Sep 16 05:16:28.785979 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:28.785945    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e9865e0-c7fa-4b94-b548-15c8be32a6ce" path="/var/lib/kubelet/pods/1e9865e0-c7fa-4b94-b548-15c8be32a6ce/volumes"
Sep 16 05:16:28.786334 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:28.786321    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" path="/var/lib/kubelet/pods/df7a43ff-35e2-4c4e-b77c-0404e4c38ef4/volumes"
Sep 16 05:16:29.528432 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:29.528402    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"]
Sep 16 05:16:29.528920 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:29.528665    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy" containerID="cri-o://d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53" gracePeriod=30
Sep 16 05:16:31.179315 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:31.179274    2559 patch_prober.go:28] interesting pod/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 05:16:31.179836 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:31.179343    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 05:16:33.072745 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.072715    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv"]
Sep 16 05:16:33.076413 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.076388    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-ad06de-29825595-9cbsv"]
Sep 16 05:16:33.117022 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.116993    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"]
Sep 16 05:16:33.117244 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.117215    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth" podUID="75378087-4606-400d-b58b-29ad1a484a87" containerName="payload-pre-processing" containerID="cri-o://ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15" gracePeriod=30
Sep 16 05:16:33.365817 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.365748    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"]
Sep 16 05:16:33.375842 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.375814    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-ad06de-r6mgt"]
Sep 16 05:16:33.392426 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.392394    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:16:33.461833 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.461801    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75378087-4606-400d-b58b-29ad1a484a87-plugins-config-volume\") pod \"75378087-4606-400d-b58b-29ad1a484a87\" (UID: \"75378087-4606-400d-b58b-29ad1a484a87\") "
Sep 16 05:16:33.461995 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.461950    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf996\" (UniqueName: \"kubernetes.io/projected/75378087-4606-400d-b58b-29ad1a484a87-kube-api-access-jf996\") pod \"75378087-4606-400d-b58b-29ad1a484a87\" (UID: \"75378087-4606-400d-b58b-29ad1a484a87\") "
Sep 16 05:16:33.462250 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.462228    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75378087-4606-400d-b58b-29ad1a484a87-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75378087-4606-400d-b58b-29ad1a484a87" (UID: "75378087-4606-400d-b58b-29ad1a484a87"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:16:33.464117 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.464092    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75378087-4606-400d-b58b-29ad1a484a87-kube-api-access-jf996" (OuterVolumeSpecName: "kube-api-access-jf996") pod "75378087-4606-400d-b58b-29ad1a484a87" (UID: "75378087-4606-400d-b58b-29ad1a484a87"). InnerVolumeSpecName "kube-api-access-jf996". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:16:33.563536 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.563512    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75378087-4606-400d-b58b-29ad1a484a87-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:33.563536 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.563532    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf996\" (UniqueName: \"kubernetes.io/projected/75378087-4606-400d-b58b-29ad1a484a87-kube-api-access-jf996\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:33.974859 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.974827    2559 generic.go:356] "Generic (PLEG): container finished" podID="75378087-4606-400d-b58b-29ad1a484a87" containerID="ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15" exitCode=0
Sep 16 05:16:33.975051 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.974865    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"
Sep 16 05:16:33.975051 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.974911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth" event={"ID":"75378087-4606-400d-b58b-29ad1a484a87","Type":"ContainerDied","Data":"ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15"}
Sep 16 05:16:33.975051 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.974958    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth" event={"ID":"75378087-4606-400d-b58b-29ad1a484a87","Type":"ContainerDied","Data":"1acd9825e8a9a092dc02e5fc215d12224cb810cb36e7cac748bb28ce14aa8041"}
Sep 16 05:16:33.975051 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.974978    2559 scope.go:117] "RemoveContainer" containerID="ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15"
Sep 16 05:16:33.984109 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.984089    2559 scope.go:117] "RemoveContainer" containerID="ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15"
Sep 16 05:16:33.984359 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:16:33.984342    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15\": container with ID starting with ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15 not found: ID does not exist" containerID="ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15"
Sep 16 05:16:33.984415 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.984366    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15"} err="failed to get container status \"ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15\": rpc error: code = NotFound desc = could not find container \"ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15\": container with ID starting with ea54760ca4dca24219dd3920d8badf59a6f07de50cef36b9a71230cb38ad9d15 not found: ID does not exist"
Sep 16 05:16:33.999016 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:33.998988    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"]
Sep 16 05:16:34.004690 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.003823    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-ad06de-7dcf7858fd-22kth"]
Sep 16 05:16:34.774796 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.774772    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:16:34.784920 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.784896    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d74d6a8-33a0-40a8-96e6-805bddb36377" path="/var/lib/kubelet/pods/6d74d6a8-33a0-40a8-96e6-805bddb36377/volumes"
Sep 16 05:16:34.785305 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.785290    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75378087-4606-400d-b58b-29ad1a484a87" path="/var/lib/kubelet/pods/75378087-4606-400d-b58b-29ad1a484a87/volumes"
Sep 16 05:16:34.785608 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.785596    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5e60203-b629-4c98-9952-1d20757dadff" path="/var/lib/kubelet/pods/f5e60203-b629-4c98-9952-1d20757dadff/volumes"
Sep 16 05:16:34.876189 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876121    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-certs\") pod \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") "
Sep 16 05:16:34.876189 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876149    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-podinfo\") pod \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") "
Sep 16 05:16:34.876189 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876171    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-token\") pod \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") "
Sep 16 05:16:34.876431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876252    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5hrq\" (UniqueName: \"kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-kube-api-access-m5hrq\") pod \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") "
Sep 16 05:16:34.876431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876295    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-data\") pod \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") "
Sep 16 05:16:34.876431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876317    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istiod-ca-cert\") pod \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") "
Sep 16 05:16:34.876431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876367    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-envoy\") pod \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") "
Sep 16 05:16:34.876431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876384    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-socket\") pod \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") "
Sep 16 05:16:34.876431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876404    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" (UID: "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:34.876758 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876443    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-credential-socket\") pod \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\" (UID: \"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092\") "
Sep 16 05:16:34.876758 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876580    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" (UID: "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:34.876758 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876740    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" (UID: "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:34.876909 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876769    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" (UID: "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:34.876968 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.876922    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" (UID: "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:16:34.877076 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.877012    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:34.877177 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.877079    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:34.877177 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.877093    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:34.877177 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.877106    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:34.878453 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.878428    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" (UID: "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:16:34.878657 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.878637    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-kube-api-access-m5hrq" (OuterVolumeSpecName: "kube-api-access-m5hrq") pod "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" (UID: "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092"). InnerVolumeSpecName "kube-api-access-m5hrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:16:34.878915 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.878893    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" (UID: "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:16:34.878976 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.878897    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" (UID: "bd0b12f0-3a7f-47d0-b8d5-40cd9d161092"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:16:34.978191 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.978169    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5hrq\" (UniqueName: \"kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-kube-api-access-m5hrq\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:34.978191 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.978190    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:34.978318 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.978200    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:34.978318 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.978208    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:34.978318 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.978216    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:34.983227 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.983201    2559 generic.go:356] "Generic (PLEG): container finished" podID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerID="d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53" exitCode=0
Sep 16 05:16:34.983313 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.983256    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"
Sep 16 05:16:34.983313 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.983273    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" event={"ID":"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092","Type":"ContainerDied","Data":"d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53"}
Sep 16 05:16:34.983431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.983319    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf" event={"ID":"bd0b12f0-3a7f-47d0-b8d5-40cd9d161092","Type":"ContainerDied","Data":"75fee7235e0261a416f021fc835778b495cafa73cc772a9ed9d9f5eb28c09cd3"}
Sep 16 05:16:34.983431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.983341    2559 scope.go:117] "RemoveContainer" containerID="d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53"
Sep 16 05:16:34.993038 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:34.993022    2559 scope.go:117] "RemoveContainer" containerID="554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f"
Sep 16 05:16:35.001400 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:35.001382    2559 scope.go:117] "RemoveContainer" containerID="d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53"
Sep 16 05:16:35.001713 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:16:35.001685    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53\": container with ID starting with d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53 not found: ID does not exist" containerID="d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53"
Sep 16 05:16:35.001795 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:35.001722    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53"} err="failed to get container status \"d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53\": rpc error: code = NotFound desc = could not find container \"d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53\": container with ID starting with d85bbc4ee0c47bc7afa290d2fd6014a1936d84a781aa17f2e69ea5761f863e53 not found: ID does not exist"
Sep 16 05:16:35.001795 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:35.001743    2559 scope.go:117] "RemoveContainer" containerID="554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f"
Sep 16 05:16:35.002001 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:16:35.001984    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f\": container with ID starting with 554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f not found: ID does not exist" containerID="554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f"
Sep 16 05:16:35.002048 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:35.002009    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f"} err="failed to get container status \"554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f\": rpc error: code = NotFound desc = could not find container \"554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f\": container with ID starting with 554c10921ff79b0caf7bc1865fe0c4aed4ccbd58cfa6fdc99fcb9a58ec6fe34f not found: ID does not exist"
Sep 16 05:16:35.005047 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:35.005025    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"]
Sep 16 05:16:35.011736 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:35.011713    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-12b6c6-openshift-default-6788d948dd-mf4tf"]
Sep 16 05:16:36.789726 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:36.789695    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" path="/var/lib/kubelet/pods/bd0b12f0-3a7f-47d0-b8d5-40cd9d161092/volumes"
Sep 16 05:16:40.133408 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133374    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"]
Sep 16 05:16:40.133831 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133818    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy"
Sep 16 05:16:40.133831 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133833    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy"
Sep 16 05:16:40.133912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133843    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75378087-4606-400d-b58b-29ad1a484a87" containerName="payload-pre-processing"
Sep 16 05:16:40.133912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133849    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="75378087-4606-400d-b58b-29ad1a484a87" containerName="payload-pre-processing"
Sep 16 05:16:40.133912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133858    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5e60203-b629-4c98-9952-1d20757dadff" containerName="revoke-keys"
Sep 16 05:16:40.133912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133863    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5e60203-b629-4c98-9952-1d20757dadff" containerName="revoke-keys"
Sep 16 05:16:40.133912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133881    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd" containerName="payload-pre-processing"
Sep 16 05:16:40.133912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133887    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd" containerName="payload-pre-processing"
Sep 16 05:16:40.133912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133893    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" containerName="main"
Sep 16 05:16:40.133912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133898    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" containerName="main"
Sep 16 05:16:40.133912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133909    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e9865e0-c7fa-4b94-b548-15c8be32a6ce" containerName="main"
Sep 16 05:16:40.133912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133914    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e9865e0-c7fa-4b94-b548-15c8be32a6ce" containerName="main"
Sep 16 05:16:40.134201 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133971    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5e60203-b629-4c98-9952-1d20757dadff" containerName="revoke-keys"
Sep 16 05:16:40.134201 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133980    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy"
Sep 16 05:16:40.134201 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133986    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy"
Sep 16 05:16:40.134201 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133991    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e9865e0-c7fa-4b94-b548-15c8be32a6ce" containerName="main"
Sep 16 05:16:40.134201 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.133997    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="75378087-4606-400d-b58b-29ad1a484a87" containerName="payload-pre-processing"
Sep 16 05:16:40.134201 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.134003    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="df7a43ff-35e2-4c4e-b77c-0404e4c38ef4" containerName="main"
Sep 16 05:16:40.134201 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.134011    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fdcd8f3-8029-43f8-82d1-0acc90b4bbcd" containerName="payload-pre-processing"
Sep 16 05:16:40.137127 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.137113    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"
Sep 16 05:16:40.139161 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.139140    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:16:40.143400 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.143368    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"]
Sep 16 05:16:40.223376 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.223341    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5de601-96ac-411c-869c-99327f688c38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp\" (UID: \"3c5de601-96ac-411c-869c-99327f688c38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"
Sep 16 05:16:40.324979 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.324946    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5de601-96ac-411c-869c-99327f688c38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp\" (UID: \"3c5de601-96ac-411c-869c-99327f688c38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"
Sep 16 05:16:40.325876 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.325851    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5de601-96ac-411c-869c-99327f688c38-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp\" (UID: \"3c5de601-96ac-411c-869c-99327f688c38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"
Sep 16 05:16:40.448680 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.448600    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"
Sep 16 05:16:40.723591 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:40.723568    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"]
Sep 16 05:16:40.725443 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:16:40.725416    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5de601_96ac_411c_869c_99327f688c38.slice/crio-405cd3379f66467177b61f182c4686dd4fc8642ddf99b864a91f5f53a8775c32 WatchSource:0}: Error finding container 405cd3379f66467177b61f182c4686dd4fc8642ddf99b864a91f5f53a8775c32: Status 404 returned error can't find the container with id 405cd3379f66467177b61f182c4686dd4fc8642ddf99b864a91f5f53a8775c32
Sep 16 05:16:41.021600 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:41.021570    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp" event={"ID":"3c5de601-96ac-411c-869c-99327f688c38","Type":"ContainerStarted","Data":"405cd3379f66467177b61f182c4686dd4fc8642ddf99b864a91f5f53a8775c32"}
Sep 16 05:16:42.028401 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:42.028367    2559 generic.go:356] "Generic (PLEG): container finished" podID="3c5de601-96ac-411c-869c-99327f688c38" containerID="9e4e2b705b988ff9bec1b2d6d8276ffbaf913ada8a67d7ab3a74bec643ed4bef" exitCode=0
Sep 16 05:16:42.028774 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:42.028418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp" event={"ID":"3c5de601-96ac-411c-869c-99327f688c38","Type":"ContainerDied","Data":"9e4e2b705b988ff9bec1b2d6d8276ffbaf913ada8a67d7ab3a74bec643ed4bef"}
Sep 16 05:16:43.157964 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:43.157940    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"
Sep 16 05:16:43.252386 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:43.252358    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5de601-96ac-411c-869c-99327f688c38-maas-api-service-ca\") pod \"3c5de601-96ac-411c-869c-99327f688c38\" (UID: \"3c5de601-96ac-411c-869c-99327f688c38\") "
Sep 16 05:16:43.252764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:43.252744    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c5de601-96ac-411c-869c-99327f688c38-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3c5de601-96ac-411c-869c-99327f688c38" (UID: "3c5de601-96ac-411c-869c-99327f688c38"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:16:43.353357 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:43.353291    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c5de601-96ac-411c-869c-99327f688c38-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:44.040499 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:44.040456    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"
Sep 16 05:16:44.040662 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:44.040505    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp" event={"ID":"3c5de601-96ac-411c-869c-99327f688c38","Type":"ContainerDied","Data":"405cd3379f66467177b61f182c4686dd4fc8642ddf99b864a91f5f53a8775c32"}
Sep 16 05:16:44.040662 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:44.040550    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="405cd3379f66467177b61f182c4686dd4fc8642ddf99b864a91f5f53a8775c32"
Sep 16 05:16:50.718891 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:50.718854    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj"]
Sep 16 05:16:50.726847 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:50.726821    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-2ee234-29825595-k44gj"]
Sep 16 05:16:50.747249 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:50.747083    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"]
Sep 16 05:16:50.747442 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:50.747414    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n" podUID="9ec449e7-94d2-4578-aa15-36eaa4237a81" containerName="payload-processing" containerID="cri-o://027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf" gracePeriod=30
Sep 16 05:16:50.759064 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:50.759039    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"]
Sep 16 05:16:50.759310 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:50.759249    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn" podUID="1df1b292-2cef-4bf2-8831-b74262f8d1cb" containerName="payload-pre-processing" containerID="cri-o://83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43" gracePeriod=30
Sep 16 05:16:50.786712 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:50.786684    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="412ba4a1-96bd-4d43-9c2d-92e545121710" path="/var/lib/kubelet/pods/412ba4a1-96bd-4d43-9c2d-92e545121710/volumes"
Sep 16 05:16:50.918148 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:50.918115    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"]
Sep 16 05:16:50.921307 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:50.921280    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-2ee234-j75cp"]
Sep 16 05:16:51.011553 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.011532    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:16:51.039466 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.039438    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:16:51.095518 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.094297    2559 generic.go:356] "Generic (PLEG): container finished" podID="1df1b292-2cef-4bf2-8831-b74262f8d1cb" containerID="83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43" exitCode=0
Sep 16 05:16:51.095518 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.094453    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn" event={"ID":"1df1b292-2cef-4bf2-8831-b74262f8d1cb","Type":"ContainerDied","Data":"83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43"}
Sep 16 05:16:51.095518 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.094605    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"
Sep 16 05:16:51.095518 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.094836    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn" event={"ID":"1df1b292-2cef-4bf2-8831-b74262f8d1cb","Type":"ContainerDied","Data":"cdc8449a4c166c5b783dab2c0e23f0a66af68329026a06b1875d859b92390d20"}
Sep 16 05:16:51.095518 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.094893    2559 scope.go:117] "RemoveContainer" containerID="83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43"
Sep 16 05:16:51.096987 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.096960    2559 generic.go:356] "Generic (PLEG): container finished" podID="9ec449e7-94d2-4578-aa15-36eaa4237a81" containerID="027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf" exitCode=0
Sep 16 05:16:51.097183 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.096991    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"
Sep 16 05:16:51.097183 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.097033    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n" event={"ID":"9ec449e7-94d2-4578-aa15-36eaa4237a81","Type":"ContainerDied","Data":"027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf"}
Sep 16 05:16:51.097183 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.097089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n" event={"ID":"9ec449e7-94d2-4578-aa15-36eaa4237a81","Type":"ContainerDied","Data":"6185079d3fa610f9abab93c4ed5a082d6adafae33e47b1c4f7e2382d2b11686f"}
Sep 16 05:16:51.107289 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.107257    2559 scope.go:117] "RemoveContainer" containerID="83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43"
Sep 16 05:16:51.107569 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:16:51.107538    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43\": container with ID starting with 83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43 not found: ID does not exist" containerID="83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43"
Sep 16 05:16:51.107628 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.107581    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43"} err="failed to get container status \"83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43\": rpc error: code = NotFound desc = could not find container \"83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43\": container with ID starting with 83318f0a625190dc5769877c63e9b60babdbe6e44cfeaf47a875bd477fb36c43 not found: ID does not exist"
Sep 16 05:16:51.107628 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.107604    2559 scope.go:117] "RemoveContainer" containerID="027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf"
Sep 16 05:16:51.115923 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.115900    2559 scope.go:117] "RemoveContainer" containerID="027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf"
Sep 16 05:16:51.116199 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:16:51.116182    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf\": container with ID starting with 027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf not found: ID does not exist" containerID="027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf"
Sep 16 05:16:51.116251 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.116208    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf"} err="failed to get container status \"027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf\": rpc error: code = NotFound desc = could not find container \"027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf\": container with ID starting with 027abe41a9b91f2e41b42d0e153b4bb66778f9e97a686ac8cd274cdb5f4271bf not found: ID does not exist"
Sep 16 05:16:51.117560 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.117538    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r698j\" (UniqueName: \"kubernetes.io/projected/9ec449e7-94d2-4578-aa15-36eaa4237a81-kube-api-access-r698j\") pod \"9ec449e7-94d2-4578-aa15-36eaa4237a81\" (UID: \"9ec449e7-94d2-4578-aa15-36eaa4237a81\") "
Sep 16 05:16:51.117656 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.117644    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1df1b292-2cef-4bf2-8831-b74262f8d1cb-plugins-config-volume\") pod \"1df1b292-2cef-4bf2-8831-b74262f8d1cb\" (UID: \"1df1b292-2cef-4bf2-8831-b74262f8d1cb\") "
Sep 16 05:16:51.117690 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.117678    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec449e7-94d2-4578-aa15-36eaa4237a81-plugins-config-volume\") pod \"9ec449e7-94d2-4578-aa15-36eaa4237a81\" (UID: \"9ec449e7-94d2-4578-aa15-36eaa4237a81\") "
Sep 16 05:16:51.117758 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.117746    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdxmf\" (UniqueName: \"kubernetes.io/projected/1df1b292-2cef-4bf2-8831-b74262f8d1cb-kube-api-access-xdxmf\") pod \"1df1b292-2cef-4bf2-8831-b74262f8d1cb\" (UID: \"1df1b292-2cef-4bf2-8831-b74262f8d1cb\") "
Sep 16 05:16:51.118010 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.117989    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1df1b292-2cef-4bf2-8831-b74262f8d1cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1df1b292-2cef-4bf2-8831-b74262f8d1cb" (UID: "1df1b292-2cef-4bf2-8831-b74262f8d1cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:16:51.118093 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.118021    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec449e7-94d2-4578-aa15-36eaa4237a81-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ec449e7-94d2-4578-aa15-36eaa4237a81" (UID: "9ec449e7-94d2-4578-aa15-36eaa4237a81"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:16:51.118093 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.118076    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1df1b292-2cef-4bf2-8831-b74262f8d1cb-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:51.120005 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.119983    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec449e7-94d2-4578-aa15-36eaa4237a81-kube-api-access-r698j" (OuterVolumeSpecName: "kube-api-access-r698j") pod "9ec449e7-94d2-4578-aa15-36eaa4237a81" (UID: "9ec449e7-94d2-4578-aa15-36eaa4237a81"). InnerVolumeSpecName "kube-api-access-r698j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:16:51.120005 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.119993    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1df1b292-2cef-4bf2-8831-b74262f8d1cb-kube-api-access-xdxmf" (OuterVolumeSpecName: "kube-api-access-xdxmf") pod "1df1b292-2cef-4bf2-8831-b74262f8d1cb" (UID: "1df1b292-2cef-4bf2-8831-b74262f8d1cb"). InnerVolumeSpecName "kube-api-access-xdxmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:16:51.219578 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.219547    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec449e7-94d2-4578-aa15-36eaa4237a81-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:51.219578 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.219577    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdxmf\" (UniqueName: \"kubernetes.io/projected/1df1b292-2cef-4bf2-8831-b74262f8d1cb-kube-api-access-xdxmf\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:51.219578 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.219587    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r698j\" (UniqueName: \"kubernetes.io/projected/9ec449e7-94d2-4578-aa15-36eaa4237a81-kube-api-access-r698j\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:16:51.417321 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.417279    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"]
Sep 16 05:16:51.419307 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.419280    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-2ee234-78448bfd9d-hbkfn"]
Sep 16 05:16:51.428376 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.428352    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"]
Sep 16 05:16:51.434106 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:51.434084    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-2ee234-c958c799c-vqh8n"]
Sep 16 05:16:52.785123 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:52.785091    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1df1b292-2cef-4bf2-8831-b74262f8d1cb" path="/var/lib/kubelet/pods/1df1b292-2cef-4bf2-8831-b74262f8d1cb/volumes"
Sep 16 05:16:52.785461 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:52.785418    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c5de601-96ac-411c-869c-99327f688c38" path="/var/lib/kubelet/pods/3c5de601-96ac-411c-869c-99327f688c38/volumes"
Sep 16 05:16:52.785780 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:52.785765    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec449e7-94d2-4578-aa15-36eaa4237a81" path="/var/lib/kubelet/pods/9ec449e7-94d2-4578-aa15-36eaa4237a81/volumes"
Sep 16 05:16:57.687593 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:57.687564    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"]
Sep 16 05:16:57.687992 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:16:57.687841    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy" containerID="cri-o://57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c" gracePeriod=30
Sep 16 05:17:02.645908 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:02.645870    2559 patch_prober.go:28] interesting pod/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 05:17:02.646318 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:02.645943    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 05:17:02.931124 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:02.931098    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:17:03.115101 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115071    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-certs\") pod \"51c7f832-81bd-49cc-b065-3d37e1a3b654\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") "
Sep 16 05:17:03.115251 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115123    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51c7f832-81bd-49cc-b065-3d37e1a3b654-istiod-ca-cert\") pod \"51c7f832-81bd-49cc-b065-3d37e1a3b654\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") "
Sep 16 05:17:03.115251 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115191    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfrn8\" (UniqueName: \"kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-kube-api-access-kfrn8\") pod \"51c7f832-81bd-49cc-b065-3d37e1a3b654\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") "
Sep 16 05:17:03.115251 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115226    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-envoy\") pod \"51c7f832-81bd-49cc-b065-3d37e1a3b654\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") "
Sep 16 05:17:03.115462 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115256    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-socket\") pod \"51c7f832-81bd-49cc-b065-3d37e1a3b654\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") "
Sep 16 05:17:03.115462 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115301    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-podinfo\") pod \"51c7f832-81bd-49cc-b065-3d37e1a3b654\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") "
Sep 16 05:17:03.115462 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115331    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-data\") pod \"51c7f832-81bd-49cc-b065-3d37e1a3b654\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") "
Sep 16 05:17:03.115462 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115345    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "51c7f832-81bd-49cc-b065-3d37e1a3b654" (UID: "51c7f832-81bd-49cc-b065-3d37e1a3b654"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:17:03.115462 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115370    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-credential-socket\") pod \"51c7f832-81bd-49cc-b065-3d37e1a3b654\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") "
Sep 16 05:17:03.115462 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115393    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-token\") pod \"51c7f832-81bd-49cc-b065-3d37e1a3b654\" (UID: \"51c7f832-81bd-49cc-b065-3d37e1a3b654\") "
Sep 16 05:17:03.115814 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115590    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "51c7f832-81bd-49cc-b065-3d37e1a3b654" (UID: "51c7f832-81bd-49cc-b065-3d37e1a3b654"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:17:03.115814 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115671    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-data" (OuterVolumeSpecName: "istio-data") pod "51c7f832-81bd-49cc-b065-3d37e1a3b654" (UID: "51c7f832-81bd-49cc-b065-3d37e1a3b654"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:17:03.115814 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115688    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:17:03.115814 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115740    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51c7f832-81bd-49cc-b065-3d37e1a3b654-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "51c7f832-81bd-49cc-b065-3d37e1a3b654" (UID: "51c7f832-81bd-49cc-b065-3d37e1a3b654"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:17:03.115814 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.115748    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "51c7f832-81bd-49cc-b065-3d37e1a3b654" (UID: "51c7f832-81bd-49cc-b065-3d37e1a3b654"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:17:03.117375 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.117352    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-kube-api-access-kfrn8" (OuterVolumeSpecName: "kube-api-access-kfrn8") pod "51c7f832-81bd-49cc-b065-3d37e1a3b654" (UID: "51c7f832-81bd-49cc-b065-3d37e1a3b654"). InnerVolumeSpecName "kube-api-access-kfrn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:17:03.117471 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.117372    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "51c7f832-81bd-49cc-b065-3d37e1a3b654" (UID: "51c7f832-81bd-49cc-b065-3d37e1a3b654"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:17:03.117970 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.117948    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "51c7f832-81bd-49cc-b065-3d37e1a3b654" (UID: "51c7f832-81bd-49cc-b065-3d37e1a3b654"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:17:03.118032 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.117953    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-token" (OuterVolumeSpecName: "istio-token") pod "51c7f832-81bd-49cc-b065-3d37e1a3b654" (UID: "51c7f832-81bd-49cc-b065-3d37e1a3b654"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:17:03.162823 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.162767    2559 generic.go:356] "Generic (PLEG): container finished" podID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerID="57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c" exitCode=0
Sep 16 05:17:03.162823 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.162806    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" event={"ID":"51c7f832-81bd-49cc-b065-3d37e1a3b654","Type":"ContainerDied","Data":"57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c"}
Sep 16 05:17:03.162945 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.162857    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs" event={"ID":"51c7f832-81bd-49cc-b065-3d37e1a3b654","Type":"ContainerDied","Data":"ed663e2b5aae8e218a88f629114450f65b6679e5122c47e4c69881331c987188"}
Sep 16 05:17:03.162945 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.162879    2559 scope.go:117] "RemoveContainer" containerID="57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c"
Sep 16 05:17:03.162945 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.162819    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"
Sep 16 05:17:03.172318 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.172304    2559 scope.go:117] "RemoveContainer" containerID="83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6"
Sep 16 05:17:03.180201 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.180185    2559 scope.go:117] "RemoveContainer" containerID="57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c"
Sep 16 05:17:03.180465 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:17:03.180447    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c\": container with ID starting with 57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c not found: ID does not exist" containerID="57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c"
Sep 16 05:17:03.180530 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.180474    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c"} err="failed to get container status \"57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c\": rpc error: code = NotFound desc = could not find container \"57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c\": container with ID starting with 57220a125affb041dd1350c0bdc701aab025be15e7c342f35462e1485e45419c not found: ID does not exist"
Sep 16 05:17:03.180530 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.180511    2559 scope.go:117] "RemoveContainer" containerID="83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6"
Sep 16 05:17:03.180786 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:17:03.180769    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6\": container with ID starting with 83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6 not found: ID does not exist" containerID="83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6"
Sep 16 05:17:03.180845 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.180791    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6"} err="failed to get container status \"83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6\": rpc error: code = NotFound desc = could not find container \"83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6\": container with ID starting with 83195536fb33ec16be3ea30b9de07837a0ef589cf6e78d22e004c093e917f3a6 not found: ID does not exist"
Sep 16 05:17:03.184699 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.184665    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"]
Sep 16 05:17:03.187041 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.187023    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-2ee234-openshift-default-56d55c9b78-m6qvs"]
Sep 16 05:17:03.216566 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.216546    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:17:03.216566 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.216564    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:17:03.216672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.216575    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:17:03.216672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.216584    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:17:03.216672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.216592    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51c7f832-81bd-49cc-b065-3d37e1a3b654-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:17:03.216672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.216600    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfrn8\" (UniqueName: \"kubernetes.io/projected/51c7f832-81bd-49cc-b065-3d37e1a3b654-kube-api-access-kfrn8\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:17:03.216672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.216610    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:17:03.216672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:03.216618    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51c7f832-81bd-49cc-b065-3d37e1a3b654-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:17:04.785227 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:04.785189    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" path="/var/lib/kubelet/pods/51c7f832-81bd-49cc-b065-3d37e1a3b654/volumes"
Sep 16 05:17:15.364509 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364460    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"]
Sep 16 05:17:15.364897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364884    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c5de601-96ac-411c-869c-99327f688c38" containerName="revoke-keys"
Sep 16 05:17:15.364960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364899    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c5de601-96ac-411c-869c-99327f688c38" containerName="revoke-keys"
Sep 16 05:17:15.364960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364913    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy"
Sep 16 05:17:15.364960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364918    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy"
Sep 16 05:17:15.364960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364925    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy"
Sep 16 05:17:15.364960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364930    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd0b12f0-3a7f-47d0-b8d5-40cd9d161092" containerName="istio-proxy"
Sep 16 05:17:15.364960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364939    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec449e7-94d2-4578-aa15-36eaa4237a81" containerName="payload-processing"
Sep 16 05:17:15.364960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364945    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec449e7-94d2-4578-aa15-36eaa4237a81" containerName="payload-processing"
Sep 16 05:17:15.364960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364955    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy"
Sep 16 05:17:15.364960 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364960    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy"
Sep 16 05:17:15.365230 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364966    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1df1b292-2cef-4bf2-8831-b74262f8d1cb" containerName="payload-pre-processing"
Sep 16 05:17:15.365230 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.364971    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1df1b292-2cef-4bf2-8831-b74262f8d1cb" containerName="payload-pre-processing"
Sep 16 05:17:15.365230 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.365032    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec449e7-94d2-4578-aa15-36eaa4237a81" containerName="payload-processing"
Sep 16 05:17:15.365230 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.365041    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy"
Sep 16 05:17:15.365230 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.365046    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1df1b292-2cef-4bf2-8831-b74262f8d1cb" containerName="payload-pre-processing"
Sep 16 05:17:15.365230 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.365054    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c5de601-96ac-411c-869c-99327f688c38" containerName="revoke-keys"
Sep 16 05:17:15.368094 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.368078    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.370490 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.370450    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3784e2\"/\"default-dockercfg-zr4fr\""
Sep 16 05:17:15.370611 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.370451    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3784e2\"/\"openshift-service-ca.crt\""
Sep 16 05:17:15.370611 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.370452    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-3784e2\"/\"kube-root-ca.crt\""
Sep 16 05:17:15.370611 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.370451    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-3784e2\"/\"sub-test-model-3784e2-kserve-self-signed-certs\""
Sep 16 05:17:15.376688 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.376667    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"]
Sep 16 05:17:15.513613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.513575    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-dshm\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.513809 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.513683    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59ccj\" (UniqueName: \"kubernetes.io/projected/9a397c1e-9f75-485a-8425-917d7d769a78-kube-api-access-59ccj\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.513809 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.513731    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-model-cache\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.513937 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.513814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-tmp-dir\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.513937 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.513864    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-home\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.513937 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.513887    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a397c1e-9f75-485a-8425-917d7d769a78-tls-certs\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.614736 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.614662    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-tmp-dir\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.614736 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.614715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-home\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.614932 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.614754    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a397c1e-9f75-485a-8425-917d7d769a78-tls-certs\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.614932 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.614795    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-dshm\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.614932 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.614846    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59ccj\" (UniqueName: \"kubernetes.io/projected/9a397c1e-9f75-485a-8425-917d7d769a78-kube-api-access-59ccj\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.614932 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.614869    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-model-cache\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.615197 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.615171    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-tmp-dir\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.615331 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.615208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-model-cache\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.615331 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.615268    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-home\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.617127 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.617101    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-dshm\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.617446 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.617428    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a397c1e-9f75-485a-8425-917d7d769a78-tls-certs\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.623973 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.623952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59ccj\" (UniqueName: \"kubernetes.io/projected/9a397c1e-9f75-485a-8425-917d7d769a78-kube-api-access-59ccj\") pod \"sub-test-model-3784e2-kserve-b45f48bf-69rtx\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") " pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.677812 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.677785    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:15.951428 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:15.951403    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"]
Sep 16 05:17:15.954167 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:17:15.954141    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a397c1e_9f75_485a_8425_917d7d769a78.slice/crio-8870386a953964a896c56fae9fe75d0485f8671ee88d6371fae5304f61db7e4f WatchSource:0}: Error finding container 8870386a953964a896c56fae9fe75d0485f8671ee88d6371fae5304f61db7e4f: Status 404 returned error can't find the container with id 8870386a953964a896c56fae9fe75d0485f8671ee88d6371fae5304f61db7e4f
Sep 16 05:17:16.233716 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:16.233683    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx" event={"ID":"9a397c1e-9f75-485a-8425-917d7d769a78","Type":"ContainerStarted","Data":"d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f"}
Sep 16 05:17:16.233859 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:16.233724    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx" event={"ID":"9a397c1e-9f75-485a-8425-917d7d769a78","Type":"ContainerStarted","Data":"8870386a953964a896c56fae9fe75d0485f8671ee88d6371fae5304f61db7e4f"}
Sep 16 05:17:16.249466 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:16.249421    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx" podStartSLOduration=1.249405481 podStartE2EDuration="1.249405481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:17:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:17:16.2487912 +0000 UTC m=+1689.909970381" watchObservedRunningTime="2026-09-16 05:17:16.249405481 +0000 UTC m=+1689.910584657"
Sep 16 05:17:25.678163 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:25.678126    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:25.678548 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:25.678175    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:25.690263 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:25.690243    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:17:26.299360 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:17:26.299328    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:18:07.242679 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:07.242650    2559 scope.go:117] "RemoveContainer" containerID="8d842c9e12ccbaf6401b4aeb34a9ed67a0602d957529437d7c9c41d8ce31c2b6"
Sep 16 05:18:36.464610 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:36.464570    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"]
Sep 16 05:18:51.484394 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.484355    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx" podUID="9a397c1e-9f75-485a-8425-917d7d769a78" containerName="main" containerID="cri-o://d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f" gracePeriod=45
Sep 16 05:18:51.737875 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.737808    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:18:51.740309 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.740280    2559 generic.go:356] "Generic (PLEG): container finished" podID="9a397c1e-9f75-485a-8425-917d7d769a78" containerID="d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f" exitCode=0
Sep 16 05:18:51.740431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.740325    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"
Sep 16 05:18:51.740431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.740344    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx" event={"ID":"9a397c1e-9f75-485a-8425-917d7d769a78","Type":"ContainerDied","Data":"d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f"}
Sep 16 05:18:51.740431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.740378    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx" event={"ID":"9a397c1e-9f75-485a-8425-917d7d769a78","Type":"ContainerDied","Data":"8870386a953964a896c56fae9fe75d0485f8671ee88d6371fae5304f61db7e4f"}
Sep 16 05:18:51.740431 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.740397    2559 scope.go:117] "RemoveContainer" containerID="d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f"
Sep 16 05:18:51.748776 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.748760    2559 scope.go:117] "RemoveContainer" containerID="d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f"
Sep 16 05:18:51.749046 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:18:51.749024    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f\": container with ID starting with d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f not found: ID does not exist" containerID="d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f"
Sep 16 05:18:51.749111 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.749058    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f"} err="failed to get container status \"d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f\": rpc error: code = NotFound desc = could not find container \"d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f\": container with ID starting with d82c72cba37df2c8fb82c7605b4fe38ce02813afdd30c19ddc2869740153939f not found: ID does not exist"
Sep 16 05:18:51.802006 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.801981    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-tmp-dir\") pod \"9a397c1e-9f75-485a-8425-917d7d769a78\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") "
Sep 16 05:18:51.802101 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.802009    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-home\") pod \"9a397c1e-9f75-485a-8425-917d7d769a78\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") "
Sep 16 05:18:51.802101 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.802031    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59ccj\" (UniqueName: \"kubernetes.io/projected/9a397c1e-9f75-485a-8425-917d7d769a78-kube-api-access-59ccj\") pod \"9a397c1e-9f75-485a-8425-917d7d769a78\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") "
Sep 16 05:18:51.802182 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.802118    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a397c1e-9f75-485a-8425-917d7d769a78-tls-certs\") pod \"9a397c1e-9f75-485a-8425-917d7d769a78\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") "
Sep 16 05:18:51.802182 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.802171    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-model-cache\") pod \"9a397c1e-9f75-485a-8425-917d7d769a78\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") "
Sep 16 05:18:51.802279 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.802203    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9a397c1e-9f75-485a-8425-917d7d769a78" (UID: "9a397c1e-9f75-485a-8425-917d7d769a78"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:18:51.802279 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.802220    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-dshm\") pod \"9a397c1e-9f75-485a-8425-917d7d769a78\" (UID: \"9a397c1e-9f75-485a-8425-917d7d769a78\") "
Sep 16 05:18:51.802279 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.802257    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-home" (OuterVolumeSpecName: "home") pod "9a397c1e-9f75-485a-8425-917d7d769a78" (UID: "9a397c1e-9f75-485a-8425-917d7d769a78"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:18:51.802456 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.802433    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-model-cache" (OuterVolumeSpecName: "model-cache") pod "9a397c1e-9f75-485a-8425-917d7d769a78" (UID: "9a397c1e-9f75-485a-8425-917d7d769a78"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:18:51.802579 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.802555    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-tmp-dir\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:18:51.802579 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.802579    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-home\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:18:51.802903 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.802587    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-model-cache\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:18:51.804322 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.804301    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-dshm" (OuterVolumeSpecName: "dshm") pod "9a397c1e-9f75-485a-8425-917d7d769a78" (UID: "9a397c1e-9f75-485a-8425-917d7d769a78"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:18:51.804396 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.804338    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a397c1e-9f75-485a-8425-917d7d769a78-kube-api-access-59ccj" (OuterVolumeSpecName: "kube-api-access-59ccj") pod "9a397c1e-9f75-485a-8425-917d7d769a78" (UID: "9a397c1e-9f75-485a-8425-917d7d769a78"). InnerVolumeSpecName "kube-api-access-59ccj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:18:51.804438 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.804421    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a397c1e-9f75-485a-8425-917d7d769a78-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9a397c1e-9f75-485a-8425-917d7d769a78" (UID: "9a397c1e-9f75-485a-8425-917d7d769a78"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 05:18:51.903225 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.903201    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a397c1e-9f75-485a-8425-917d7d769a78-dshm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:18:51.903225 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.903222    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59ccj\" (UniqueName: \"kubernetes.io/projected/9a397c1e-9f75-485a-8425-917d7d769a78-kube-api-access-59ccj\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:18:51.903342 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:51.903230    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a397c1e-9f75-485a-8425-917d7d769a78-tls-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:18:52.066632 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:52.066586    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"]
Sep 16 05:18:52.068216 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:52.068193    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-3784e2/sub-test-model-3784e2-kserve-b45f48bf-69rtx"]
Sep 16 05:18:52.785234 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:18:52.785193    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a397c1e-9f75-485a-8425-917d7d769a78" path="/var/lib/kubelet/pods/9a397c1e-9f75-485a-8425-917d7d769a78/volumes"
Sep 16 05:19:15.755423 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.755392    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"]
Sep 16 05:19:15.755872 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.755839    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a397c1e-9f75-485a-8425-917d7d769a78" containerName="main"
Sep 16 05:19:15.755872 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.755852    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a397c1e-9f75-485a-8425-917d7d769a78" containerName="main"
Sep 16 05:19:15.755944 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.755924    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="51c7f832-81bd-49cc-b065-3d37e1a3b654" containerName="istio-proxy"
Sep 16 05:19:15.755944 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.755934    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a397c1e-9f75-485a-8425-917d7d769a78" containerName="main"
Sep 16 05:19:15.758910 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.758894    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.761855 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.761831    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-10ee79\"/\"default-dockercfg-7dskn\""
Sep 16 05:19:15.761977 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.761877    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-10ee79\"/\"rate-test-model-10ee79-kserve-self-signed-certs\""
Sep 16 05:19:15.761977 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.761894    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-10ee79\"/\"kube-root-ca.crt\""
Sep 16 05:19:15.761977 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.761835    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-10ee79\"/\"openshift-service-ca.crt\""
Sep 16 05:19:15.769553 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.769531    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"]
Sep 16 05:19:15.891368 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.891333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tls-certs\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.891513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.891385    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-dshm\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.891513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.891418    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-model-cache\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.891513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.891451    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-home\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.891513 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.891505    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tmp-dir\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.891652 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.891563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb25v\" (UniqueName: \"kubernetes.io/projected/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-kube-api-access-cb25v\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.992307 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.992275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-dshm\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.992474 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.992321    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-model-cache\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.992474 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.992355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-home\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.992474 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.992391    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tmp-dir\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.992474 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.992446    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb25v\" (UniqueName: \"kubernetes.io/projected/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-kube-api-access-cb25v\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.992707 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.992571    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tls-certs\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.992822 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.992796    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-model-cache\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.992912 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.992880    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-home\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.992989 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.992966    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tmp-dir\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.994979 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.994962    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-dshm\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:15.995081 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:15.995049    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tls-certs\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:16.000713 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:16.000690    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb25v\" (UniqueName: \"kubernetes.io/projected/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-kube-api-access-cb25v\") pod \"rate-test-model-10ee79-kserve-75859bbbdc-pp4sc\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") " pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:16.068451 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:16.068397    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:16.346070 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:16.346044    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"]
Sep 16 05:19:16.348124 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:19:16.348094    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bd5f7b7_9ca9_40fa_9ea5_c77cd934aa64.slice/crio-b0c81cda9b6c9aeacb5ba008fc4a413758cf75a577cee706d343353ebfb4ceab WatchSource:0}: Error finding container b0c81cda9b6c9aeacb5ba008fc4a413758cf75a577cee706d343353ebfb4ceab: Status 404 returned error can't find the container with id b0c81cda9b6c9aeacb5ba008fc4a413758cf75a577cee706d343353ebfb4ceab
Sep 16 05:19:16.872713 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:16.872682    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc" event={"ID":"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64","Type":"ContainerStarted","Data":"d7025fc8e7a5b782f5b3ec2907a132f02e3e7f43783c4106a66f4c34a418ee22"}
Sep 16 05:19:16.872713 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:16.872718    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc" event={"ID":"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64","Type":"ContainerStarted","Data":"b0c81cda9b6c9aeacb5ba008fc4a413758cf75a577cee706d343353ebfb4ceab"}
Sep 16 05:19:16.889964 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:16.889905    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc" podStartSLOduration=1.889885665 podStartE2EDuration="1.889885665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:19:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:19:16.888363341 +0000 UTC m=+1810.549542518" watchObservedRunningTime="2026-09-16 05:19:16.889885665 +0000 UTC m=+1810.551064843"
Sep 16 05:19:26.068868 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:26.068831    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:26.069238 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:26.068885    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:26.080771 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:26.080744    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:26.933650 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:26.933623    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:19:51.932313 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:51.932283    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"]
Sep 16 05:19:52.655617 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.655588    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"]
Sep 16 05:19:52.659595 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.659571    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.661455 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.661435    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-0653f3-openshift-default-dockercfg-tktm4\""
Sep 16 05:19:52.670798 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.670776    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"]
Sep 16 05:19:52.799422 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.799390    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-certs\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.799584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.799431    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-credential-socket\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.799584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.799470    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-token\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.799584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.799535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-socket\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.799584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.799558    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-data\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.799584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.799578    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-podinfo\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.799826 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.799639    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2d64\" (UniqueName: \"kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-kube-api-access-v2d64\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.799826 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.799673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17d88493-2964-4b95-8ed3-caa3dbc9b734-istiod-ca-cert\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.799826 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.799690    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-envoy\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900111 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900083    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-socket\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900273 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-data\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900273 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900252    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-podinfo\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900393 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900308    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2d64\" (UniqueName: \"kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-kube-api-access-v2d64\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900393 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900357    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17d88493-2964-4b95-8ed3-caa3dbc9b734-istiod-ca-cert\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900393 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900387    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-envoy\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900425    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-certs\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900466    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-socket\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900473    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-credential-socket\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900548    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-data\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900601    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-token\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900758    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-credential-socket\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.900898 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.900838    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-certs\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.901135 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.901117    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17d88493-2964-4b95-8ed3-caa3dbc9b734-istiod-ca-cert\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.902690 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.902669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-envoy\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.902993 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.902978    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-podinfo\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.907751 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.907698    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2d64\" (UniqueName: \"kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-kube-api-access-v2d64\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.907842 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.907820    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-token\") pod \"e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") " pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:52.974037 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:52.974012    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:53.247080 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:53.247055    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"]
Sep 16 05:19:53.248589 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:19:53.248559    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d88493_2964_4b95_8ed3_caa3dbc9b734.slice/crio-07b87371b31f8e74d5138c0eea336f76a839001bff3c51b9859555479a7c3109 WatchSource:0}: Error finding container 07b87371b31f8e74d5138c0eea336f76a839001bff3c51b9859555479a7c3109: Status 404 returned error can't find the container with id 07b87371b31f8e74d5138c0eea336f76a839001bff3c51b9859555479a7c3109
Sep 16 05:19:53.250791 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:53.250756    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:19:53.250887 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:53.250820    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:19:53.250887 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:53.250849    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:19:54.068279 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:54.068242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" event={"ID":"17d88493-2964-4b95-8ed3-caa3dbc9b734","Type":"ContainerStarted","Data":"920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d"}
Sep 16 05:19:54.068706 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:54.068296    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" event={"ID":"17d88493-2964-4b95-8ed3-caa3dbc9b734","Type":"ContainerStarted","Data":"07b87371b31f8e74d5138c0eea336f76a839001bff3c51b9859555479a7c3109"}
Sep 16 05:19:54.086914 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:54.086826    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" podStartSLOduration=2.086805974 podStartE2EDuration="2.086805974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:19:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:19:54.086470343 +0000 UTC m=+1847.747649519" watchObservedRunningTime="2026-09-16 05:19:54.086805974 +0000 UTC m=+1847.747985151"
Sep 16 05:19:54.974640 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:54.974609    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:54.979805 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:54.979783    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:55.073543 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:55.073512    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:19:55.074741 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:19:55.074721    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:20:06.951778 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:06.951737    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc" podUID="5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" containerName="main" containerID="cri-o://d7025fc8e7a5b782f5b3ec2907a132f02e3e7f43783c4106a66f4c34a418ee22" gracePeriod=45
Sep 16 05:20:07.145362 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.145333    2559 generic.go:356] "Generic (PLEG): container finished" podID="5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" containerID="d7025fc8e7a5b782f5b3ec2907a132f02e3e7f43783c4106a66f4c34a418ee22" exitCode=0
Sep 16 05:20:07.145534 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.145414    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc" event={"ID":"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64","Type":"ContainerDied","Data":"d7025fc8e7a5b782f5b3ec2907a132f02e3e7f43783c4106a66f4c34a418ee22"}
Sep 16 05:20:07.241288 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.241264    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:20:07.331611 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.331580    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb25v\" (UniqueName: \"kubernetes.io/projected/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-kube-api-access-cb25v\") pod \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") "
Sep 16 05:20:07.331764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.331624    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-model-cache\") pod \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") "
Sep 16 05:20:07.331764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.331673    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tmp-dir\") pod \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") "
Sep 16 05:20:07.331764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.331716    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-dshm\") pod \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") "
Sep 16 05:20:07.331764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.331745    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-home\") pod \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") "
Sep 16 05:20:07.331998 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.331788    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tls-certs\") pod \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\" (UID: \"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64\") "
Sep 16 05:20:07.331998 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.331903    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-model-cache" (OuterVolumeSpecName: "model-cache") pod "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" (UID: "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:20:07.332104 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.332011    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" (UID: "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:20:07.332104 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.332047    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-home" (OuterVolumeSpecName: "home") pod "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" (UID: "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:20:07.332237 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.332218    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-home\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:20:07.332237 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.332236    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-model-cache\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:20:07.332417 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.332245    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tmp-dir\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:20:07.334366 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.334338    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-kube-api-access-cb25v" (OuterVolumeSpecName: "kube-api-access-cb25v") pod "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" (UID: "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64"). InnerVolumeSpecName "kube-api-access-cb25v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:20:07.334366 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.334351    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" (UID: "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 05:20:07.334641 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.334609    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-dshm" (OuterVolumeSpecName: "dshm") pod "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" (UID: "5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:20:07.432909 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.432881    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb25v\" (UniqueName: \"kubernetes.io/projected/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-kube-api-access-cb25v\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:20:07.432909 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.432908    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-dshm\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:20:07.433096 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:07.432917    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64-tls-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:20:08.152158 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:08.152125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc" event={"ID":"5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64","Type":"ContainerDied","Data":"b0c81cda9b6c9aeacb5ba008fc4a413758cf75a577cee706d343353ebfb4ceab"}
Sep 16 05:20:08.152158 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:08.152150    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"
Sep 16 05:20:08.152672 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:08.152176    2559 scope.go:117] "RemoveContainer" containerID="d7025fc8e7a5b782f5b3ec2907a132f02e3e7f43783c4106a66f4c34a418ee22"
Sep 16 05:20:08.171453 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:08.171422    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"]
Sep 16 05:20:08.175290 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:08.175267    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-10ee79/rate-test-model-10ee79-kserve-75859bbbdc-pp4sc"]
Sep 16 05:20:08.785713 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:08.785683    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" path="/var/lib/kubelet/pods/5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64/volumes"
Sep 16 05:20:11.116677 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:11.116633    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 05:20:11.117167 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:11.116705    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 05:20:12.177822 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:12.177790    2559 generic.go:356] "Generic (PLEG): container finished" podID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerID="920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d" exitCode=0
Sep 16 05:20:12.178245 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:12.177877    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" event={"ID":"17d88493-2964-4b95-8ed3-caa3dbc9b734","Type":"ContainerDied","Data":"920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d"}
Sep 16 05:20:12.178245 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:12.178233    2559 scope.go:117] "RemoveContainer" containerID="920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d"
Sep 16 05:20:12.179271 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:12.179243    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:20:12.179344 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:12.179328    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:20:12.179389 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:12.179376    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:20:13.185391 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:13.185349    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" event={"ID":"17d88493-2964-4b95-8ed3-caa3dbc9b734","Type":"ContainerStarted","Data":"d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6"}
Sep 16 05:20:13.974927 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:13.974892    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:20:13.975108 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:13.975084    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 16 05:20:13.975167 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:13.975148    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 16 05:20:14.975186 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:14.975153    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 16 05:20:14.975687 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:14.975233    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 16 05:20:15.975040 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:15.975004    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 16 05:20:15.975215 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:15.975069    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 16 05:20:16.975232 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:16.975195    2559 patch_prober.go:28] interesting pod/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused" start-of-body=
Sep 16 05:20:16.975712 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:16.975253    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.93:15021/healthz/ready\": dial tcp 10.134.0.93:15021: connect: connection refused"
Sep 16 05:20:17.978397 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:17.978368    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:20:17.978881 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:17.978766    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:20:17.979378 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:17.979361    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:20:26.869348 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.869311    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"]
Sep 16 05:20:26.869948 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.869931    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" containerName="main"
Sep 16 05:20:26.869993 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.869950    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" containerName="main"
Sep 16 05:20:26.870064 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.870034    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bd5f7b7-9ca9-40fa-9ea5-c77cd934aa64" containerName="main"
Sep 16 05:20:26.873827 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.873804    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:26.875755 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.875738    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-afd377-openshift-default-dockercfg-tls4g\""
Sep 16 05:20:26.882804 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.882786    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"]
Sep 16 05:20:26.910450 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.910418    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-token\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:26.910584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.910468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6g4m\" (UniqueName: \"kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-kube-api-access-j6g4m\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:26.910584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.910540    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-credential-socket\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:26.910584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.910569    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-certs\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:26.910754 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.910624    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84de7d62-812d-421c-8b40-c48b55a8bd3f-istiod-ca-cert\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:26.910754 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.910711    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-socket\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:26.910861 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.910760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-data\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:26.910861 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.910798    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-podinfo\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:26.910861 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:26.910847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-envoy\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.011791 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.011760    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-socket\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.011981 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.011808    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-data\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.011981 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.011845    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-podinfo\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.011981 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.011876    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-envoy\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.011981 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.011941    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-token\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.011981 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.011974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6g4m\" (UniqueName: \"kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-kube-api-access-j6g4m\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.012242 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.012005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-credential-socket\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.012242 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.012037    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-certs\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.012242 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.012069    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84de7d62-812d-421c-8b40-c48b55a8bd3f-istiod-ca-cert\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.012242 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.012206    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-socket\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.012242 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.012220    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-data\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.012519 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.012461    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-credential-socket\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.012851 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.012827    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84de7d62-812d-421c-8b40-c48b55a8bd3f-istiod-ca-cert\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.012994 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.012943    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-certs\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.014444 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.014418    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-envoy\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.014580 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.014561    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-podinfo\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.019365 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.019342    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-token\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.019653 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.019636    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6g4m\" (UniqueName: \"kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-kube-api-access-j6g4m\") pod \"e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") " pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.185770 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.185694    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:27.460168 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.460141    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"]
Sep 16 05:20:27.461896 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:20:27.461869    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84de7d62_812d_421c_8b40_c48b55a8bd3f.slice/crio-f14602879c1f34d94ae36ff88b9ade3a68e6d104c61d8ba9ba6c724c5ece61e9 WatchSource:0}: Error finding container f14602879c1f34d94ae36ff88b9ade3a68e6d104c61d8ba9ba6c724c5ece61e9: Status 404 returned error can't find the container with id f14602879c1f34d94ae36ff88b9ade3a68e6d104c61d8ba9ba6c724c5ece61e9
Sep 16 05:20:27.464032 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.463999    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:20:27.464122 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.464069    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:20:27.464122 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:27.464098    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:20:28.278864 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:28.278827    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" event={"ID":"84de7d62-812d-421c-8b40-c48b55a8bd3f","Type":"ContainerStarted","Data":"2e250eb6c86e9225014a059af2ae3123727d9793f6d59e8d4ef173a46118a475"}
Sep 16 05:20:28.279198 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:28.278879    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" event={"ID":"84de7d62-812d-421c-8b40-c48b55a8bd3f","Type":"ContainerStarted","Data":"f14602879c1f34d94ae36ff88b9ade3a68e6d104c61d8ba9ba6c724c5ece61e9"}
Sep 16 05:20:28.299977 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:28.299934    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" podStartSLOduration=2.299919925 podStartE2EDuration="2.299919925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:20:28.297253856 +0000 UTC m=+1881.958433032" watchObservedRunningTime="2026-09-16 05:20:28.299919925 +0000 UTC m=+1881.961099101"
Sep 16 05:20:29.186589 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:29.186554    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:29.191707 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:29.191680    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:29.284157 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:29.284126    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:29.285030 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:29.285013    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:33.215157 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.215118    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"]
Sep 16 05:20:33.218889 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.218873    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:20:33.221124 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.221087    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-afd377-dockercfg-xfm8x\""
Sep 16 05:20:33.221124 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.221108    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-afd377\""
Sep 16 05:20:33.228996 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.228973    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"]
Sep 16 05:20:33.266475 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.266429    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg4sk\" (UniqueName: \"kubernetes.io/projected/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-kube-api-access-sg4sk\") pod \"payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6\" (UID: \"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:20:33.266596 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.266509    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6\" (UID: \"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:20:33.366988 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.366959    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg4sk\" (UniqueName: \"kubernetes.io/projected/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-kube-api-access-sg4sk\") pod \"payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6\" (UID: \"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:20:33.366988 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.366991    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6\" (UID: \"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:20:33.367784 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.367766    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6\" (UID: \"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:20:33.374811 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.374785    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg4sk\" (UniqueName: \"kubernetes.io/projected/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-kube-api-access-sg4sk\") pod \"payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6\" (UID: \"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:20:33.530316 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.530296    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:20:33.800002 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:33.799972    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"]
Sep 16 05:20:33.802099 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:20:33.802062    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50cb0e7_f972_453a_a8ba_b9f63f72ab0a.slice/crio-845e975fb496b655274788f27c556d0c1f37dc22567502b3d1d69936e4d7c494 WatchSource:0}: Error finding container 845e975fb496b655274788f27c556d0c1f37dc22567502b3d1d69936e4d7c494: Status 404 returned error can't find the container with id 845e975fb496b655274788f27c556d0c1f37dc22567502b3d1d69936e4d7c494
Sep 16 05:20:34.312177 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:34.312142    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6" event={"ID":"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a","Type":"ContainerStarted","Data":"6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac"}
Sep 16 05:20:34.312601 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:34.312201    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6" event={"ID":"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a","Type":"ContainerStarted","Data":"845e975fb496b655274788f27c556d0c1f37dc22567502b3d1d69936e4d7c494"}
Sep 16 05:20:34.312601 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:34.312224    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:20:34.327842 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:34.327798    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6" podStartSLOduration=1.327784428 podStartE2EDuration="1.327784428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:20:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:20:34.326266436 +0000 UTC m=+1887.987445620" watchObservedRunningTime="2026-09-16 05:20:34.327784428 +0000 UTC m=+1887.988963674"
Sep 16 05:20:45.321366 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:45.321333    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:20:48.405775 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:48.405743    2559 generic.go:356] "Generic (PLEG): container finished" podID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerID="2e250eb6c86e9225014a059af2ae3123727d9793f6d59e8d4ef173a46118a475" exitCode=0
Sep 16 05:20:48.406144 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:48.405816    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" event={"ID":"84de7d62-812d-421c-8b40-c48b55a8bd3f","Type":"ContainerDied","Data":"2e250eb6c86e9225014a059af2ae3123727d9793f6d59e8d4ef173a46118a475"}
Sep 16 05:20:48.406202 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:48.406187    2559 scope.go:117] "RemoveContainer" containerID="2e250eb6c86e9225014a059af2ae3123727d9793f6d59e8d4ef173a46118a475"
Sep 16 05:20:48.407268 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:48.407241    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:20:48.407326 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:48.407305    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:20:48.407365 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:48.407337    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:20:49.417535 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:49.417494    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" event={"ID":"84de7d62-812d-421c-8b40-c48b55a8bd3f","Type":"ContainerStarted","Data":"d4f6d2182d1c4d0cc30a1dc254adc80033665494680cfd0e9c41d8114be17f7b"}
Sep 16 05:20:50.186316 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:50.186282    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:50.186516 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:50.186465    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 16 05:20:50.186567 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:50.186544    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 16 05:20:51.186422 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:51.186385    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 16 05:20:51.186806 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:51.186461    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 16 05:20:52.186150 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:52.186114    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 16 05:20:52.186329 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:52.186177    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 16 05:20:53.186854 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:53.186821    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 16 05:20:53.187217 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:53.186874    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 16 05:20:54.186975 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:54.186925    2559 patch_prober.go:28] interesting pod/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused" start-of-body=
Sep 16 05:20:54.187313 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:54.187006    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.94:15021/healthz/ready\": dial tcp 10.134.0.94:15021: connect: connection refused"
Sep 16 05:20:55.190490 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:55.190456    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:55.190924 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:55.190913    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:20:55.191674 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:20:55.191655    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:21:05.242797 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:05.242770    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-lf8r9_d2aa8f3c-21cd-4411-bd90-d6128d4b54cc/payload-processing/0.log"
Sep 16 05:21:05.350525 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:05.350488    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6_a50cb0e7-f972-453a-a8ba-b9f63f72ab0a/payload-processing/0.log"
Sep 16 05:21:07.286554 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:07.286523    2559 scope.go:117] "RemoveContainer" containerID="fe3b1721ba622db5cdb429ef52a9b3ba43d3737aa3f0e7b8ac7cb372ce9203c8"
Sep 16 05:21:07.295841 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:07.295822    2559 scope.go:117] "RemoveContainer" containerID="91c6221c5e00bfd2d57d9474e28a13b9bc7d75c8798f2f95b740e411b8584b48"
Sep 16 05:21:07.304077 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:07.304057    2559 scope.go:117] "RemoveContainer" containerID="3155048eeefc7d9f96fdb91e5f1a65e2cceace5688e531b6052c3ab19f471ce9"
Sep 16 05:21:07.311829 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:07.311814    2559 scope.go:117] "RemoveContainer" containerID="87867e9cce02aaad7523196791809df32cd55cc207d4ff66044e68602b830795"
Sep 16 05:21:36.127629 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.127596    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-lf8r9_d2aa8f3c-21cd-4411-bd90-d6128d4b54cc/payload-processing/0.log"
Sep 16 05:21:36.251707 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.251683    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6_a50cb0e7-f972-453a-a8ba-b9f63f72ab0a/payload-processing/0.log"
Sep 16 05:21:36.804491 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.804454    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"]
Sep 16 05:21:36.808587 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.808568    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:36.812221 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.811108    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-f644d7-openshift-default-dockercfg-pmfh4\""
Sep 16 05:21:36.821591 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.821561    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"]
Sep 16 05:21:36.929645 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.929609    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-data\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:36.929837 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.929684    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755aa171-599f-439f-bf0a-a29a3562ccd4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:36.929837 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.929728    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-credential-socket\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:36.929837 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.929779    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-certs\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:36.930019 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.929917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-envoy\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:36.930019 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.929973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-token\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:36.930122 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.930027    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xgvb\" (UniqueName: \"kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-kube-api-access-5xgvb\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:36.930122 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.930064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-podinfo\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:36.930122 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:36.930097    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-socket\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.031626 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.031593    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xgvb\" (UniqueName: \"kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-kube-api-access-5xgvb\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.031626 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.031630    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-podinfo\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.031839 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.031655    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-socket\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.031839 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.031712    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-data\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.031839 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.031742    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755aa171-599f-439f-bf0a-a29a3562ccd4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.031839 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.031766    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-credential-socket\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.031839 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.031806    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-certs\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.032100 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.031856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-envoy\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.032100 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.031892    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-token\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.032200 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.032166    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-data\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.032200 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.032179    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-socket\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.032284 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.032217    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-certs\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.032606 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.032513    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-credential-socket\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.032606 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.032542    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755aa171-599f-439f-bf0a-a29a3562ccd4-istiod-ca-cert\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.034305 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.034277    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-envoy\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.034415 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.034350    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-podinfo\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.038791 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.038768    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-token\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.039753 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.039736    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xgvb\" (UniqueName: \"kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-kube-api-access-5xgvb\") pod \"e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") " pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.125653 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.125600    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:37.402071 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.402045    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"]
Sep 16 05:21:37.403962 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:21:37.403929    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755aa171_599f_439f_bf0a_a29a3562ccd4.slice/crio-bbca8e55c5b85c1e8e6cb309ca659cc5581a0d84d278f4bdc274bc31dc6f6e6c WatchSource:0}: Error finding container bbca8e55c5b85c1e8e6cb309ca659cc5581a0d84d278f4bdc274bc31dc6f6e6c: Status 404 returned error can't find the container with id bbca8e55c5b85c1e8e6cb309ca659cc5581a0d84d278f4bdc274bc31dc6f6e6c
Sep 16 05:21:37.406155 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.406123    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:21:37.406226 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.406193    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:21:37.406226 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.406221    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:21:37.683359 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.683274    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" event={"ID":"755aa171-599f-439f-bf0a-a29a3562ccd4","Type":"ContainerStarted","Data":"cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a"}
Sep 16 05:21:37.683359 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.683324    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" event={"ID":"755aa171-599f-439f-bf0a-a29a3562ccd4","Type":"ContainerStarted","Data":"bbca8e55c5b85c1e8e6cb309ca659cc5581a0d84d278f4bdc274bc31dc6f6e6c"}
Sep 16 05:21:37.704677 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:37.704625    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" podStartSLOduration=1.704611882 podStartE2EDuration="1.704611882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:21:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:21:37.702674145 +0000 UTC m=+1951.363853323" watchObservedRunningTime="2026-09-16 05:21:37.704611882 +0000 UTC m=+1951.365791058"
Sep 16 05:21:38.130306 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:38.130263    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:38.135692 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:38.135667    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:38.690083 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:38.690044    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:38.690922 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:38.690903    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:21:59.813017 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:59.812952    2559 generic.go:356] "Generic (PLEG): container finished" podID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerID="cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a" exitCode=0
Sep 16 05:21:59.813363 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:59.813031    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" event={"ID":"755aa171-599f-439f-bf0a-a29a3562ccd4","Type":"ContainerDied","Data":"cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a"}
Sep 16 05:21:59.813435 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:59.813422    2559 scope.go:117] "RemoveContainer" containerID="cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a"
Sep 16 05:21:59.814469 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:59.814442    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:21:59.814555 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:59.814534    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:21:59.814592 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:21:59.814565    2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 16 05:22:00.820843 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:00.820806    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" event={"ID":"755aa171-599f-439f-bf0a-a29a3562ccd4","Type":"ContainerStarted","Data":"8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794"}
Sep 16 05:22:01.126552 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:01.126439    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:22:01.126759 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:01.126736    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Sep 16 05:22:01.126802 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:01.126784    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Sep 16 05:22:02.126363 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:02.126330    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Sep 16 05:22:02.126766 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:02.126396    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Sep 16 05:22:03.126505 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:03.126450    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Sep 16 05:22:03.126854 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:03.126527    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Sep 16 05:22:04.126007 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:04.125974    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Sep 16 05:22:04.126178 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:04.126027    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Sep 16 05:22:05.126539 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:05.126503    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused" start-of-body=
Sep 16 05:22:05.126907 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:05.126562    2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.96:15021/healthz/ready\": dial tcp 10.134.0.96:15021: connect: connection refused"
Sep 16 05:22:05.295745 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:05.295706    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"]
Sep 16 05:22:05.300547 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:05.300526    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"
Sep 16 05:22:05.302788 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:05.302767    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:22:05.306954 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:05.306931    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"]
Sep 16 05:22:05.408821 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:05.408714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/669b28a9-8453-4539-86ec-2fde5601311e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m\" (UID: \"669b28a9-8453-4539-86ec-2fde5601311e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"
Sep 16 05:22:05.509875 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:05.509828    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/669b28a9-8453-4539-86ec-2fde5601311e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m\" (UID: \"669b28a9-8453-4539-86ec-2fde5601311e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"
Sep 16 05:22:05.510549 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:05.510530    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/669b28a9-8453-4539-86ec-2fde5601311e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m\" (UID: \"669b28a9-8453-4539-86ec-2fde5601311e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"
Sep 16 05:22:05.623892 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:05.623857    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"
Sep 16 05:22:05.911437 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:05.911411    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"]
Sep 16 05:22:05.913690 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:22:05.913659    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669b28a9_8453_4539_86ec_2fde5601311e.slice/crio-e19267aa85f82284739d2c9c42807382395688e9a8c91abe6e95b9964695c3b2 WatchSource:0}: Error finding container e19267aa85f82284739d2c9c42807382395688e9a8c91abe6e95b9964695c3b2: Status 404 returned error can't find the container with id e19267aa85f82284739d2c9c42807382395688e9a8c91abe6e95b9964695c3b2
Sep 16 05:22:06.130600 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:06.130579    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:22:06.130904 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:06.130818    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:22:06.131620 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:06.131602    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:22:06.854270 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:06.854182    2559 generic.go:356] "Generic (PLEG): container finished" podID="669b28a9-8453-4539-86ec-2fde5601311e" containerID="2fad4fd36dcd72e0f77c928855050a0c814f3571596d602fe7b100feb782768f" exitCode=0
Sep 16 05:22:06.854422 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:06.854276    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m" event={"ID":"669b28a9-8453-4539-86ec-2fde5601311e","Type":"ContainerDied","Data":"2fad4fd36dcd72e0f77c928855050a0c814f3571596d602fe7b100feb782768f"}
Sep 16 05:22:06.854422 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:06.854334    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m" event={"ID":"669b28a9-8453-4539-86ec-2fde5601311e","Type":"ContainerStarted","Data":"e19267aa85f82284739d2c9c42807382395688e9a8c91abe6e95b9964695c3b2"}
Sep 16 05:22:07.349935 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:07.349909    2559 scope.go:117] "RemoveContainer" containerID="c91f4bf05e110ff2966ca17c94d2ea6cb971b0f2a79fac89887fe127ca13c8cc"
Sep 16 05:22:07.359126 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:07.359109    2559 scope.go:117] "RemoveContainer" containerID="6059dc21f20b0e6874b538b72c5eafb9c3c71b063bee714ebacb6dd504a9b249"
Sep 16 05:22:07.990077 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:07.990054    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"
Sep 16 05:22:08.034025 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:08.034000    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/669b28a9-8453-4539-86ec-2fde5601311e-maas-api-service-ca\") pod \"669b28a9-8453-4539-86ec-2fde5601311e\" (UID: \"669b28a9-8453-4539-86ec-2fde5601311e\") "
Sep 16 05:22:08.034324 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:08.034302    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/669b28a9-8453-4539-86ec-2fde5601311e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "669b28a9-8453-4539-86ec-2fde5601311e" (UID: "669b28a9-8453-4539-86ec-2fde5601311e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:22:08.135428 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:08.135368    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/669b28a9-8453-4539-86ec-2fde5601311e-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:22:08.866846 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:08.866821    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"
Sep 16 05:22:08.866846 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:08.866837    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m" event={"ID":"669b28a9-8453-4539-86ec-2fde5601311e","Type":"ContainerDied","Data":"e19267aa85f82284739d2c9c42807382395688e9a8c91abe6e95b9964695c3b2"}
Sep 16 05:22:08.867203 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:08.866877    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e19267aa85f82284739d2c9c42807382395688e9a8c91abe6e95b9964695c3b2"
Sep 16 05:22:11.984203 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:11.984169    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"]
Sep 16 05:22:11.987584 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:11.987555    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-f644d7-jb47m"]
Sep 16 05:22:12.785690 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:12.785657    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="669b28a9-8453-4539-86ec-2fde5601311e" path="/var/lib/kubelet/pods/669b28a9-8453-4539-86ec-2fde5601311e/volumes"
Sep 16 05:22:18.429047 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:18.429010    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"]
Sep 16 05:22:18.429657 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:18.429285    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy" containerID="cri-o://8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794" gracePeriod=30
Sep 16 05:22:21.133442 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:21.133406    2559 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 16 05:22:21.133825 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:21.133469    2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 16 05:22:21.900254 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:21.900221    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"]
Sep 16 05:22:21.900712 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:21.900698    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669b28a9-8453-4539-86ec-2fde5601311e" containerName="revoke-keys"
Sep 16 05:22:21.900767 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:21.900714    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="669b28a9-8453-4539-86ec-2fde5601311e" containerName="revoke-keys"
Sep 16 05:22:21.900806 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:21.900793    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="669b28a9-8453-4539-86ec-2fde5601311e" containerName="revoke-keys"
Sep 16 05:22:21.904217 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:21.904202    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"
Sep 16 05:22:21.905878 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:21.905858    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:22:21.909914 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:21.909890    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"]
Sep 16 05:22:21.959697 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:21.959670    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f498db6-3137-4cf1-9c1f-dd2d5d697eef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp\" (UID: \"8f498db6-3137-4cf1-9c1f-dd2d5d697eef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"
Sep 16 05:22:22.061507 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:22.061143    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f498db6-3137-4cf1-9c1f-dd2d5d697eef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp\" (UID: \"8f498db6-3137-4cf1-9c1f-dd2d5d697eef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"
Sep 16 05:22:22.066501 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:22.062071    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f498db6-3137-4cf1-9c1f-dd2d5d697eef-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp\" (UID: \"8f498db6-3137-4cf1-9c1f-dd2d5d697eef\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"
Sep 16 05:22:22.215220 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:22.215158    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"
Sep 16 05:22:22.483766 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:22.483740    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"]
Sep 16 05:22:22.485496 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:22:22.485454    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f498db6_3137_4cf1_9c1f_dd2d5d697eef.slice/crio-f84da0e55c13789efc5dde91a54ac6ae9f8016544e2b0fb19706dca969cf2438 WatchSource:0}: Error finding container f84da0e55c13789efc5dde91a54ac6ae9f8016544e2b0fb19706dca969cf2438: Status 404 returned error can't find the container with id f84da0e55c13789efc5dde91a54ac6ae9f8016544e2b0fb19706dca969cf2438
Sep 16 05:22:22.942684 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:22.942604    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp" event={"ID":"8f498db6-3137-4cf1-9c1f-dd2d5d697eef","Type":"ContainerStarted","Data":"7c3fa8987b6124504ce23e83e7ed2140b6654d0218bc0d2e1b1ca5daf0814c18"}
Sep 16 05:22:22.942684 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:22.942661    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp" event={"ID":"8f498db6-3137-4cf1-9c1f-dd2d5d697eef","Type":"ContainerStarted","Data":"f84da0e55c13789efc5dde91a54ac6ae9f8016544e2b0fb19706dca969cf2438"}
Sep 16 05:22:22.958910 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:22.958853    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp" podStartSLOduration=1.958840701 podStartE2EDuration="1.958840701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:22:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:22:22.956474368 +0000 UTC m=+1996.617653544" watchObservedRunningTime="2026-09-16 05:22:22.958840701 +0000 UTC m=+1996.620019878"
Sep 16 05:22:23.679518 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.679495    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:22:23.776936 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.776913    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-envoy\") pod \"755aa171-599f-439f-bf0a-a29a3562ccd4\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") "
Sep 16 05:22:23.777071 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.776960    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-token\") pod \"755aa171-599f-439f-bf0a-a29a3562ccd4\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") "
Sep 16 05:22:23.777071 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.776980    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-data\") pod \"755aa171-599f-439f-bf0a-a29a3562ccd4\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") "
Sep 16 05:22:23.777071 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.776996    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755aa171-599f-439f-bf0a-a29a3562ccd4-istiod-ca-cert\") pod \"755aa171-599f-439f-bf0a-a29a3562ccd4\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") "
Sep 16 05:22:23.777194 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777103    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-socket\") pod \"755aa171-599f-439f-bf0a-a29a3562ccd4\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") "
Sep 16 05:22:23.777194 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777136    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-credential-socket\") pod \"755aa171-599f-439f-bf0a-a29a3562ccd4\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") "
Sep 16 05:22:23.777287 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777237    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-podinfo\") pod \"755aa171-599f-439f-bf0a-a29a3562ccd4\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") "
Sep 16 05:22:23.777287 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777251    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-data" (OuterVolumeSpecName: "istio-data") pod "755aa171-599f-439f-bf0a-a29a3562ccd4" (UID: "755aa171-599f-439f-bf0a-a29a3562ccd4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:22:23.777395 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777284    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-certs\") pod \"755aa171-599f-439f-bf0a-a29a3562ccd4\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") "
Sep 16 05:22:23.777395 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777327    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xgvb\" (UniqueName: \"kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-kube-api-access-5xgvb\") pod \"755aa171-599f-439f-bf0a-a29a3562ccd4\" (UID: \"755aa171-599f-439f-bf0a-a29a3562ccd4\") "
Sep 16 05:22:23.777395 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777342    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755aa171-599f-439f-bf0a-a29a3562ccd4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "755aa171-599f-439f-bf0a-a29a3562ccd4" (UID: "755aa171-599f-439f-bf0a-a29a3562ccd4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:22:23.777395 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777375    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "755aa171-599f-439f-bf0a-a29a3562ccd4" (UID: "755aa171-599f-439f-bf0a-a29a3562ccd4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:22:23.777628 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777454    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "755aa171-599f-439f-bf0a-a29a3562ccd4" (UID: "755aa171-599f-439f-bf0a-a29a3562ccd4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:22:23.777731 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777632    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "755aa171-599f-439f-bf0a-a29a3562ccd4" (UID: "755aa171-599f-439f-bf0a-a29a3562ccd4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:22:23.777731 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777716    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:22:23.777829 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777733    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:22:23.777829 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777745    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755aa171-599f-439f-bf0a-a29a3562ccd4-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:22:23.777829 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777761    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:22:23.777829 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.777778    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:22:23.779200 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.779180    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "755aa171-599f-439f-bf0a-a29a3562ccd4" (UID: "755aa171-599f-439f-bf0a-a29a3562ccd4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:22:23.779447 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.779432    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-kube-api-access-5xgvb" (OuterVolumeSpecName: "kube-api-access-5xgvb") pod "755aa171-599f-439f-bf0a-a29a3562ccd4" (UID: "755aa171-599f-439f-bf0a-a29a3562ccd4"). InnerVolumeSpecName "kube-api-access-5xgvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:22:23.779670 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.779652    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-token" (OuterVolumeSpecName: "istio-token") pod "755aa171-599f-439f-bf0a-a29a3562ccd4" (UID: "755aa171-599f-439f-bf0a-a29a3562ccd4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:22:23.779732 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.779690    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "755aa171-599f-439f-bf0a-a29a3562ccd4" (UID: "755aa171-599f-439f-bf0a-a29a3562ccd4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:22:23.878613 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.878587    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:22:23.878713 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.878616    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:22:23.878713 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.878631    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xgvb\" (UniqueName: \"kubernetes.io/projected/755aa171-599f-439f-bf0a-a29a3562ccd4-kube-api-access-5xgvb\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:22:23.878713 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.878645    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755aa171-599f-439f-bf0a-a29a3562ccd4-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:22:23.948909 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.948884    2559 generic.go:356] "Generic (PLEG): container finished" podID="8f498db6-3137-4cf1-9c1f-dd2d5d697eef" containerID="7c3fa8987b6124504ce23e83e7ed2140b6654d0218bc0d2e1b1ca5daf0814c18" exitCode=0
Sep 16 05:22:23.949021 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.948931    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp" event={"ID":"8f498db6-3137-4cf1-9c1f-dd2d5d697eef","Type":"ContainerDied","Data":"7c3fa8987b6124504ce23e83e7ed2140b6654d0218bc0d2e1b1ca5daf0814c18"}
Sep 16 05:22:23.950641 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.950620    2559 generic.go:356] "Generic (PLEG): container finished" podID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerID="8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794" exitCode=0
Sep 16 05:22:23.950722 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.950661    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" event={"ID":"755aa171-599f-439f-bf0a-a29a3562ccd4","Type":"ContainerDied","Data":"8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794"}
Sep 16 05:22:23.950722 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.950671    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"
Sep 16 05:22:23.950722 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.950704    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw" event={"ID":"755aa171-599f-439f-bf0a-a29a3562ccd4","Type":"ContainerDied","Data":"bbca8e55c5b85c1e8e6cb309ca659cc5581a0d84d278f4bdc274bc31dc6f6e6c"}
Sep 16 05:22:23.950826 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.950733    2559 scope.go:117] "RemoveContainer" containerID="8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794"
Sep 16 05:22:23.961219 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.961203    2559 scope.go:117] "RemoveContainer" containerID="cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a"
Sep 16 05:22:23.969749 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.969727    2559 scope.go:117] "RemoveContainer" containerID="8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794"
Sep 16 05:22:23.970107 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:22:23.970082    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794\": container with ID starting with 8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794 not found: ID does not exist" containerID="8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794"
Sep 16 05:22:23.970216 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.970120    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794"} err="failed to get container status \"8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794\": rpc error: code = NotFound desc = could not find container \"8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794\": container with ID starting with 8a66ec747fb43bda45a9d2e7622189a91ced1ffe76439212c71b1ce2ab7d8794 not found: ID does not exist"
Sep 16 05:22:23.970216 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.970142    2559 scope.go:117] "RemoveContainer" containerID="cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a"
Sep 16 05:22:23.970532 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:22:23.970501    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a\": container with ID starting with cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a not found: ID does not exist" containerID="cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a"
Sep 16 05:22:23.970644 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.970542    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a"} err="failed to get container status \"cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a\": rpc error: code = NotFound desc = could not find container \"cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a\": container with ID starting with cedf4b2edfbe651f4cae2c9fcac84e06cfde0573000d77c7b947f0d60288067a not found: ID does not exist"
Sep 16 05:22:23.977152 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.977104    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"]
Sep 16 05:22:23.980328 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:23.980304    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-f644d7-openshift-default-dffffc5d-bkqmw"]
Sep 16 05:22:24.785597 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:24.785563    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" path="/var/lib/kubelet/pods/755aa171-599f-439f-bf0a-a29a3562ccd4/volumes"
Sep 16 05:22:25.089871 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:25.089843    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"
Sep 16 05:22:25.189824 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:25.189796    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f498db6-3137-4cf1-9c1f-dd2d5d697eef-maas-api-service-ca\") pod \"8f498db6-3137-4cf1-9c1f-dd2d5d697eef\" (UID: \"8f498db6-3137-4cf1-9c1f-dd2d5d697eef\") "
Sep 16 05:22:25.190097 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:25.190078    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f498db6-3137-4cf1-9c1f-dd2d5d697eef-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8f498db6-3137-4cf1-9c1f-dd2d5d697eef" (UID: "8f498db6-3137-4cf1-9c1f-dd2d5d697eef"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:22:25.291370 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:25.291347    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f498db6-3137-4cf1-9c1f-dd2d5d697eef-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:22:25.964750 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:25.964715    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp" event={"ID":"8f498db6-3137-4cf1-9c1f-dd2d5d697eef","Type":"ContainerDied","Data":"f84da0e55c13789efc5dde91a54ac6ae9f8016544e2b0fb19706dca969cf2438"}
Sep 16 05:22:25.964750 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:25.964735    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"
Sep 16 05:22:25.964750 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:25.964759    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f84da0e55c13789efc5dde91a54ac6ae9f8016544e2b0fb19706dca969cf2438"
Sep 16 05:22:37.665318 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:37.665264    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"]
Sep 16 05:22:37.667464 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:37.667434    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-0653f3-76fvp"]
Sep 16 05:22:38.785215 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:22:38.785177    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f498db6-3137-4cf1-9c1f-dd2d5d697eef" path="/var/lib/kubelet/pods/8f498db6-3137-4cf1-9c1f-dd2d5d697eef/volumes"
Sep 16 05:23:07.386842 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:07.386808    2559 scope.go:117] "RemoveContainer" containerID="7c20cd067d3c660966ab8e396b0e7096b9ab2b573a72fcca54aea41043babd19"
Sep 16 05:23:07.396263 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:07.396242    2559 scope.go:117] "RemoveContainer" containerID="9e4e2b705b988ff9bec1b2d6d8276ffbaf913ada8a67d7ab3a74bec643ed4bef"
Sep 16 05:23:07.403937 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:07.403919    2559 scope.go:117] "RemoveContainer" containerID="26bb02edeaae0322f033ae4b8ed597d4584b5ec02df81d8f35af06606fc567fc"
Sep 16 05:23:26.570499 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.570446    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"]
Sep 16 05:23:26.570972 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.570752    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy" containerID="cri-o://d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6" gracePeriod=30
Sep 16 05:23:26.968519 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.968428    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"]
Sep 16 05:23:26.968883 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.968868    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy"
Sep 16 05:23:26.968943 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.968886    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy"
Sep 16 05:23:26.968943 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.968893    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy"
Sep 16 05:23:26.968943 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.968898    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy"
Sep 16 05:23:26.968943 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.968921    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f498db6-3137-4cf1-9c1f-dd2d5d697eef" containerName="revoke-keys"
Sep 16 05:23:26.968943 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.968927    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f498db6-3137-4cf1-9c1f-dd2d5d697eef" containerName="revoke-keys"
Sep 16 05:23:26.969109 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.968985    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy"
Sep 16 05:23:26.969109 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.968992    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f498db6-3137-4cf1-9c1f-dd2d5d697eef" containerName="revoke-keys"
Sep 16 05:23:26.969109 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.969000    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="755aa171-599f-439f-bf0a-a29a3562ccd4" containerName="istio-proxy"
Sep 16 05:23:26.972211 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.972192    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"
Sep 16 05:23:26.973891 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.973869    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:23:26.977554 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:26.977535    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"]
Sep 16 05:23:27.113117 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:27.113084    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b8311c-0922-49e8-92e9-752aeb453507-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd\" (UID: \"b8b8311c-0922-49e8-92e9-752aeb453507\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"
Sep 16 05:23:27.214084 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:27.214053    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b8311c-0922-49e8-92e9-752aeb453507-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd\" (UID: \"b8b8311c-0922-49e8-92e9-752aeb453507\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"
Sep 16 05:23:27.214767 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:27.214738    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b8311c-0922-49e8-92e9-752aeb453507-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd\" (UID: \"b8b8311c-0922-49e8-92e9-752aeb453507\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"
Sep 16 05:23:27.284764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:27.284738    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"
Sep 16 05:23:27.556609 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:27.556579    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"]
Sep 16 05:23:27.558455 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:23:27.558430    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b8311c_0922_49e8_92e9_752aeb453507.slice/crio-bc02e97e135432b3267fbd77e0acaeb31b0cd9cf67294d7c7053aa7c67a73fef WatchSource:0}: Error finding container bc02e97e135432b3267fbd77e0acaeb31b0cd9cf67294d7c7053aa7c67a73fef: Status 404 returned error can't find the container with id bc02e97e135432b3267fbd77e0acaeb31b0cd9cf67294d7c7053aa7c67a73fef
Sep 16 05:23:28.303072 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:28.303038    2559 generic.go:356] "Generic (PLEG): container finished" podID="b8b8311c-0922-49e8-92e9-752aeb453507" containerID="46e66587242906706b7746f8854d164ac4793fb73d6858feeea741f54bf9922a" exitCode=0
Sep 16 05:23:28.303377 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:28.303128    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd" event={"ID":"b8b8311c-0922-49e8-92e9-752aeb453507","Type":"ContainerDied","Data":"46e66587242906706b7746f8854d164ac4793fb73d6858feeea741f54bf9922a"}
Sep 16 05:23:28.303377 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:28.303181    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd" event={"ID":"b8b8311c-0922-49e8-92e9-752aeb453507","Type":"ContainerStarted","Data":"bc02e97e135432b3267fbd77e0acaeb31b0cd9cf67294d7c7053aa7c67a73fef"}
Sep 16 05:23:29.436792 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:29.436769    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"
Sep 16 05:23:29.531904 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:29.531873    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b8311c-0922-49e8-92e9-752aeb453507-maas-api-service-ca\") pod \"b8b8311c-0922-49e8-92e9-752aeb453507\" (UID: \"b8b8311c-0922-49e8-92e9-752aeb453507\") "
Sep 16 05:23:29.532173 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:29.532154    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8b8311c-0922-49e8-92e9-752aeb453507-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b8b8311c-0922-49e8-92e9-752aeb453507" (UID: "b8b8311c-0922-49e8-92e9-752aeb453507"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:23:29.633290 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:29.633234    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b8311c-0922-49e8-92e9-752aeb453507-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:30.314322 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:30.314289    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd" event={"ID":"b8b8311c-0922-49e8-92e9-752aeb453507","Type":"ContainerDied","Data":"bc02e97e135432b3267fbd77e0acaeb31b0cd9cf67294d7c7053aa7c67a73fef"}
Sep 16 05:23:30.314503 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:30.314361    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc02e97e135432b3267fbd77e0acaeb31b0cd9cf67294d7c7053aa7c67a73fef"
Sep 16 05:23:30.314503 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:30.314302    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"
Sep 16 05:23:31.816934 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.816914    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:23:31.952797 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.952723    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-credential-socket\") pod \"17d88493-2964-4b95-8ed3-caa3dbc9b734\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") "
Sep 16 05:23:31.952797 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.952764    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-token\") pod \"17d88493-2964-4b95-8ed3-caa3dbc9b734\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") "
Sep 16 05:23:31.953003 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.952813    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-socket\") pod \"17d88493-2964-4b95-8ed3-caa3dbc9b734\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") "
Sep 16 05:23:31.953003 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.952847    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-podinfo\") pod \"17d88493-2964-4b95-8ed3-caa3dbc9b734\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") "
Sep 16 05:23:31.953003 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.952871    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2d64\" (UniqueName: \"kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-kube-api-access-v2d64\") pod \"17d88493-2964-4b95-8ed3-caa3dbc9b734\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") "
Sep 16 05:23:31.953003 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.952899    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-data\") pod \"17d88493-2964-4b95-8ed3-caa3dbc9b734\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") "
Sep 16 05:23:31.953003 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.952942    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-envoy\") pod \"17d88493-2964-4b95-8ed3-caa3dbc9b734\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") "
Sep 16 05:23:31.953003 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.952957    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "17d88493-2964-4b95-8ed3-caa3dbc9b734" (UID: "17d88493-2964-4b95-8ed3-caa3dbc9b734"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:23:31.953003 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.952982    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-certs\") pod \"17d88493-2964-4b95-8ed3-caa3dbc9b734\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") "
Sep 16 05:23:31.953356 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.953014    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17d88493-2964-4b95-8ed3-caa3dbc9b734-istiod-ca-cert\") pod \"17d88493-2964-4b95-8ed3-caa3dbc9b734\" (UID: \"17d88493-2964-4b95-8ed3-caa3dbc9b734\") "
Sep 16 05:23:31.953356 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.953104    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "17d88493-2964-4b95-8ed3-caa3dbc9b734" (UID: "17d88493-2964-4b95-8ed3-caa3dbc9b734"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:23:31.953356 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.953248    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-data" (OuterVolumeSpecName: "istio-data") pod "17d88493-2964-4b95-8ed3-caa3dbc9b734" (UID: "17d88493-2964-4b95-8ed3-caa3dbc9b734"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:23:31.953543 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.953408    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:31.953543 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.953427    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:31.953543 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.953443    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:31.953543 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.953464    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "17d88493-2964-4b95-8ed3-caa3dbc9b734" (UID: "17d88493-2964-4b95-8ed3-caa3dbc9b734"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:23:31.953543 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.953500    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17d88493-2964-4b95-8ed3-caa3dbc9b734-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "17d88493-2964-4b95-8ed3-caa3dbc9b734" (UID: "17d88493-2964-4b95-8ed3-caa3dbc9b734"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:23:31.955079 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.955057    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "17d88493-2964-4b95-8ed3-caa3dbc9b734" (UID: "17d88493-2964-4b95-8ed3-caa3dbc9b734"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:23:31.955259 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.955244    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "17d88493-2964-4b95-8ed3-caa3dbc9b734" (UID: "17d88493-2964-4b95-8ed3-caa3dbc9b734"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:23:31.955701 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.955679    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-token" (OuterVolumeSpecName: "istio-token") pod "17d88493-2964-4b95-8ed3-caa3dbc9b734" (UID: "17d88493-2964-4b95-8ed3-caa3dbc9b734"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:23:31.955701 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:31.955689    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-kube-api-access-v2d64" (OuterVolumeSpecName: "kube-api-access-v2d64") pod "17d88493-2964-4b95-8ed3-caa3dbc9b734" (UID: "17d88493-2964-4b95-8ed3-caa3dbc9b734"). InnerVolumeSpecName "kube-api-access-v2d64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:23:32.054475 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.054453    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17d88493-2964-4b95-8ed3-caa3dbc9b734-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:32.054475 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.054474    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:32.054605 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.054500    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:32.054605 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.054507    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2d64\" (UniqueName: \"kubernetes.io/projected/17d88493-2964-4b95-8ed3-caa3dbc9b734-kube-api-access-v2d64\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:32.054605 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.054516    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:32.054605 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.054524    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17d88493-2964-4b95-8ed3-caa3dbc9b734-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:32.328085 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.328058    2559 generic.go:356] "Generic (PLEG): container finished" podID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerID="d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6" exitCode=0
Sep 16 05:23:32.328188 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.328111    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"
Sep 16 05:23:32.328188 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.328143    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" event={"ID":"17d88493-2964-4b95-8ed3-caa3dbc9b734","Type":"ContainerDied","Data":"d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6"}
Sep 16 05:23:32.328263 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.328194    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk" event={"ID":"17d88493-2964-4b95-8ed3-caa3dbc9b734","Type":"ContainerDied","Data":"07b87371b31f8e74d5138c0eea336f76a839001bff3c51b9859555479a7c3109"}
Sep 16 05:23:32.328263 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.328214    2559 scope.go:117] "RemoveContainer" containerID="d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6"
Sep 16 05:23:32.337309 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.337295    2559 scope.go:117] "RemoveContainer" containerID="920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d"
Sep 16 05:23:32.345617 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.345595    2559 scope.go:117] "RemoveContainer" containerID="d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6"
Sep 16 05:23:32.345871 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:23:32.345851    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6\": container with ID starting with d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6 not found: ID does not exist" containerID="d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6"
Sep 16 05:23:32.345914 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.345880    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6"} err="failed to get container status \"d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6\": rpc error: code = NotFound desc = could not find container \"d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6\": container with ID starting with d3f12b266047380b61436b4313d4ce8482b8aa88d254f0e9e529fea895cdc9b6 not found: ID does not exist"
Sep 16 05:23:32.345914 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.345896    2559 scope.go:117] "RemoveContainer" containerID="920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d"
Sep 16 05:23:32.346140 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:23:32.346119    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d\": container with ID starting with 920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d not found: ID does not exist" containerID="920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d"
Sep 16 05:23:32.346192 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.346149    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d"} err="failed to get container status \"920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d\": rpc error: code = NotFound desc = could not find container \"920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d\": container with ID starting with 920389a04fcb80c296992f4fbdc167237294c643ec7cd5532262cca47b4ee47d not found: ID does not exist"
Sep 16 05:23:32.349519 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.349497    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"]
Sep 16 05:23:32.354243 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.354222    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-0653f3-openshift-default-6f47ff495b-jz4nk"]
Sep 16 05:23:32.786259 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:32.786232    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" path="/var/lib/kubelet/pods/17d88493-2964-4b95-8ed3-caa3dbc9b734/volumes"
Sep 16 05:23:37.449655 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:37.449620    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"]
Sep 16 05:23:37.450056 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:37.449880    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6" podUID="a50cb0e7-f972-453a-a8ba-b9f63f72ab0a" containerName="payload-processing" containerID="cri-o://6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac" gracePeriod=30
Sep 16 05:23:37.679510 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:37.679452    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"]
Sep 16 05:23:37.686764 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:37.686522    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-afd377-qzftd"]
Sep 16 05:23:37.711580 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:37.711510    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:23:37.806943 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:37.806912    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg4sk\" (UniqueName: \"kubernetes.io/projected/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-kube-api-access-sg4sk\") pod \"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a\" (UID: \"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a\") "
Sep 16 05:23:37.806943 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:37.806944    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-plugins-config-volume\") pod \"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a\" (UID: \"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a\") "
Sep 16 05:23:37.807339 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:37.807306    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a50cb0e7-f972-453a-a8ba-b9f63f72ab0a" (UID: "a50cb0e7-f972-453a-a8ba-b9f63f72ab0a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:23:37.809065 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:37.809041    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-kube-api-access-sg4sk" (OuterVolumeSpecName: "kube-api-access-sg4sk") pod "a50cb0e7-f972-453a-a8ba-b9f63f72ab0a" (UID: "a50cb0e7-f972-453a-a8ba-b9f63f72ab0a"). InnerVolumeSpecName "kube-api-access-sg4sk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:23:37.908061 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:37.908038    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg4sk\" (UniqueName: \"kubernetes.io/projected/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-kube-api-access-sg4sk\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:37.908061 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:37.908060    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:38.364329 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:38.364290    2559 generic.go:356] "Generic (PLEG): container finished" podID="a50cb0e7-f972-453a-a8ba-b9f63f72ab0a" containerID="6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac" exitCode=0
Sep 16 05:23:38.364514 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:38.364344    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"
Sep 16 05:23:38.364514 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:38.364370    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6" event={"ID":"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a","Type":"ContainerDied","Data":"6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac"}
Sep 16 05:23:38.364514 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:38.364444    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6" event={"ID":"a50cb0e7-f972-453a-a8ba-b9f63f72ab0a","Type":"ContainerDied","Data":"845e975fb496b655274788f27c556d0c1f37dc22567502b3d1d69936e4d7c494"}
Sep 16 05:23:38.364514 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:38.364466    2559 scope.go:117] "RemoveContainer" containerID="6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac"
Sep 16 05:23:38.374392 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:38.374376    2559 scope.go:117] "RemoveContainer" containerID="6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac"
Sep 16 05:23:38.374688 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:23:38.374670    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac\": container with ID starting with 6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac not found: ID does not exist" containerID="6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac"
Sep 16 05:23:38.374759 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:38.374696    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac"} err="failed to get container status \"6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac\": rpc error: code = NotFound desc = could not find container \"6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac\": container with ID starting with 6dc9a455966c68be3193c501dcda56df4a6a1caed29e5b6845f2944f92e557ac not found: ID does not exist"
Sep 16 05:23:38.384565 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:38.384545    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"]
Sep 16 05:23:38.388308 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:38.388288    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-afd377-5bddc979bc-lt4j6"]
Sep 16 05:23:38.785757 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:38.785729    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a50cb0e7-f972-453a-a8ba-b9f63f72ab0a" path="/var/lib/kubelet/pods/a50cb0e7-f972-453a-a8ba-b9f63f72ab0a/volumes"
Sep 16 05:23:38.786228 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:38.786041    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8b8311c-0922-49e8-92e9-752aeb453507" path="/var/lib/kubelet/pods/b8b8311c-0922-49e8-92e9-752aeb453507/volumes"
Sep 16 05:23:44.247394 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.247364    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"]
Sep 16 05:23:44.247801 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.247703    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy" containerID="cri-o://d4f6d2182d1c4d0cc30a1dc254adc80033665494680cfd0e9c41d8114be17f7b" gracePeriod=30
Sep 16 05:23:44.598211 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598124    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"]
Sep 16 05:23:44.598638 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598620    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy"
Sep 16 05:23:44.598638 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598640    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy"
Sep 16 05:23:44.598796 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598653    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy"
Sep 16 05:23:44.598796 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598660    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy"
Sep 16 05:23:44.598796 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598680    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a50cb0e7-f972-453a-a8ba-b9f63f72ab0a" containerName="payload-processing"
Sep 16 05:23:44.598796 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598689    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a50cb0e7-f972-453a-a8ba-b9f63f72ab0a" containerName="payload-processing"
Sep 16 05:23:44.598796 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598701    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8b8311c-0922-49e8-92e9-752aeb453507" containerName="revoke-keys"
Sep 16 05:23:44.598796 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598708    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8b8311c-0922-49e8-92e9-752aeb453507" containerName="revoke-keys"
Sep 16 05:23:44.599078 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598811    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a50cb0e7-f972-453a-a8ba-b9f63f72ab0a" containerName="payload-processing"
Sep 16 05:23:44.599078 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598826    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy"
Sep 16 05:23:44.599078 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.598840    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8b8311c-0922-49e8-92e9-752aeb453507" containerName="revoke-keys"
Sep 16 05:23:44.602032 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.602012    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"
Sep 16 05:23:44.603948 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.603924    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:23:44.609602 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.609473    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"]
Sep 16 05:23:44.771462 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.771430    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11b58e16-5c30-403b-9ace-5934b8faa6fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p\" (UID: \"11b58e16-5c30-403b-9ace-5934b8faa6fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"
Sep 16 05:23:44.872648 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.872586    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11b58e16-5c30-403b-9ace-5934b8faa6fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p\" (UID: \"11b58e16-5c30-403b-9ace-5934b8faa6fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"
Sep 16 05:23:44.873142 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.873125    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11b58e16-5c30-403b-9ace-5934b8faa6fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p\" (UID: \"11b58e16-5c30-403b-9ace-5934b8faa6fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"
Sep 16 05:23:44.913786 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:44.913765    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"
Sep 16 05:23:45.182882 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:45.182853    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"]
Sep 16 05:23:45.184887 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:23:45.184864    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b58e16_5c30_403b_9ace_5934b8faa6fa.slice/crio-b31f6c31a3a5e0e91766f60f624de3ae8ee91549388976d20f0a8a782ccf81cb WatchSource:0}: Error finding container b31f6c31a3a5e0e91766f60f624de3ae8ee91549388976d20f0a8a782ccf81cb: Status 404 returned error can't find the container with id b31f6c31a3a5e0e91766f60f624de3ae8ee91549388976d20f0a8a782ccf81cb
Sep 16 05:23:45.402095 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:45.402067    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p" event={"ID":"11b58e16-5c30-403b-9ace-5934b8faa6fa","Type":"ContainerStarted","Data":"b31f6c31a3a5e0e91766f60f624de3ae8ee91549388976d20f0a8a782ccf81cb"}
Sep 16 05:23:46.409402 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:46.409371    2559 generic.go:356] "Generic (PLEG): container finished" podID="11b58e16-5c30-403b-9ace-5934b8faa6fa" containerID="8daf64e5c2901252475ceb15efe4fbf85fafc90e6d0d9e961295f461001bfe93" exitCode=0
Sep 16 05:23:46.409756 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:46.409445    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p" event={"ID":"11b58e16-5c30-403b-9ace-5934b8faa6fa","Type":"ContainerDied","Data":"8daf64e5c2901252475ceb15efe4fbf85fafc90e6d0d9e961295f461001bfe93"}
Sep 16 05:23:47.550725 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:47.550702    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"
Sep 16 05:23:47.697637 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:47.697558    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11b58e16-5c30-403b-9ace-5934b8faa6fa-maas-api-service-ca\") pod \"11b58e16-5c30-403b-9ace-5934b8faa6fa\" (UID: \"11b58e16-5c30-403b-9ace-5934b8faa6fa\") "
Sep 16 05:23:47.697875 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:47.697851    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b58e16-5c30-403b-9ace-5934b8faa6fa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "11b58e16-5c30-403b-9ace-5934b8faa6fa" (UID: "11b58e16-5c30-403b-9ace-5934b8faa6fa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:23:47.798807 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:47.798775    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/11b58e16-5c30-403b-9ace-5934b8faa6fa-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:48.422411 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:48.422387    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"
Sep 16 05:23:48.422630 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:48.422405    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p" event={"ID":"11b58e16-5c30-403b-9ace-5934b8faa6fa","Type":"ContainerDied","Data":"b31f6c31a3a5e0e91766f60f624de3ae8ee91549388976d20f0a8a782ccf81cb"}
Sep 16 05:23:48.422630 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:48.422474    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b31f6c31a3a5e0e91766f60f624de3ae8ee91549388976d20f0a8a782ccf81cb"
Sep 16 05:23:49.431878 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.431844    2559 generic.go:356] "Generic (PLEG): container finished" podID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerID="d4f6d2182d1c4d0cc30a1dc254adc80033665494680cfd0e9c41d8114be17f7b" exitCode=0
Sep 16 05:23:49.432209 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.431909    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" event={"ID":"84de7d62-812d-421c-8b40-c48b55a8bd3f","Type":"ContainerDied","Data":"d4f6d2182d1c4d0cc30a1dc254adc80033665494680cfd0e9c41d8114be17f7b"}
Sep 16 05:23:49.432209 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.431973    2559 scope.go:117] "RemoveContainer" containerID="2e250eb6c86e9225014a059af2ae3123727d9793f6d59e8d4ef173a46118a475"
Sep 16 05:23:49.509135 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.509085    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:23:49.614798 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.614775    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-socket\") pod \"84de7d62-812d-421c-8b40-c48b55a8bd3f\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") "
Sep 16 05:23:49.614915 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.614821    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-certs\") pod \"84de7d62-812d-421c-8b40-c48b55a8bd3f\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") "
Sep 16 05:23:49.614915 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.614868    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-envoy\") pod \"84de7d62-812d-421c-8b40-c48b55a8bd3f\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") "
Sep 16 05:23:49.615024 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.614919    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6g4m\" (UniqueName: \"kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-kube-api-access-j6g4m\") pod \"84de7d62-812d-421c-8b40-c48b55a8bd3f\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") "
Sep 16 05:23:49.615024 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.614943    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84de7d62-812d-421c-8b40-c48b55a8bd3f-istiod-ca-cert\") pod \"84de7d62-812d-421c-8b40-c48b55a8bd3f\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") "
Sep 16 05:23:49.615113 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615032    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-data\") pod \"84de7d62-812d-421c-8b40-c48b55a8bd3f\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") "
Sep 16 05:23:49.615113 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615068    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-token\") pod \"84de7d62-812d-421c-8b40-c48b55a8bd3f\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") "
Sep 16 05:23:49.615113 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615067    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "84de7d62-812d-421c-8b40-c48b55a8bd3f" (UID: "84de7d62-812d-421c-8b40-c48b55a8bd3f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:23:49.615113 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615090    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-credential-socket\") pod \"84de7d62-812d-421c-8b40-c48b55a8bd3f\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") "
Sep 16 05:23:49.615313 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615120    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-podinfo\") pod \"84de7d62-812d-421c-8b40-c48b55a8bd3f\" (UID: \"84de7d62-812d-421c-8b40-c48b55a8bd3f\") "
Sep 16 05:23:49.615313 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615177    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "84de7d62-812d-421c-8b40-c48b55a8bd3f" (UID: "84de7d62-812d-421c-8b40-c48b55a8bd3f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:23:49.615417 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615386    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "84de7d62-812d-421c-8b40-c48b55a8bd3f" (UID: "84de7d62-812d-421c-8b40-c48b55a8bd3f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:23:49.615467 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615415    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84de7d62-812d-421c-8b40-c48b55a8bd3f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "84de7d62-812d-421c-8b40-c48b55a8bd3f" (UID: "84de7d62-812d-421c-8b40-c48b55a8bd3f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:23:49.615544 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615525    2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-credential-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:49.615590 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615544    2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-socket\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:49.615590 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615558    2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-workload-certs\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:49.615812 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.615303    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-data" (OuterVolumeSpecName: "istio-data") pod "84de7d62-812d-421c-8b40-c48b55a8bd3f" (UID: "84de7d62-812d-421c-8b40-c48b55a8bd3f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:23:49.617254 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.617218    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-kube-api-access-j6g4m" (OuterVolumeSpecName: "kube-api-access-j6g4m") pod "84de7d62-812d-421c-8b40-c48b55a8bd3f" (UID: "84de7d62-812d-421c-8b40-c48b55a8bd3f"). InnerVolumeSpecName "kube-api-access-j6g4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:23:49.617363 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.617256    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-token" (OuterVolumeSpecName: "istio-token") pod "84de7d62-812d-421c-8b40-c48b55a8bd3f" (UID: "84de7d62-812d-421c-8b40-c48b55a8bd3f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:23:49.617363 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.617267    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "84de7d62-812d-421c-8b40-c48b55a8bd3f" (UID: "84de7d62-812d-421c-8b40-c48b55a8bd3f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 05:23:49.617451 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.617433    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "84de7d62-812d-421c-8b40-c48b55a8bd3f" (UID: "84de7d62-812d-421c-8b40-c48b55a8bd3f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 05:23:49.716319 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.716295    2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-data\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:49.716319 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.716318    2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-token\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:49.716456 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.716331    2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-podinfo\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:49.716456 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.716342    2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/84de7d62-812d-421c-8b40-c48b55a8bd3f-istio-envoy\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:49.716456 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.716354    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6g4m\" (UniqueName: \"kubernetes.io/projected/84de7d62-812d-421c-8b40-c48b55a8bd3f-kube-api-access-j6g4m\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:49.716456 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:49.716367    2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/84de7d62-812d-421c-8b40-c48b55a8bd3f-istiod-ca-cert\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:50.438790 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:50.438764    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"
Sep 16 05:23:50.439161 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:50.438810    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5" event={"ID":"84de7d62-812d-421c-8b40-c48b55a8bd3f","Type":"ContainerDied","Data":"f14602879c1f34d94ae36ff88b9ade3a68e6d104c61d8ba9ba6c724c5ece61e9"}
Sep 16 05:23:50.439161 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:50.438862    2559 scope.go:117] "RemoveContainer" containerID="d4f6d2182d1c4d0cc30a1dc254adc80033665494680cfd0e9c41d8114be17f7b"
Sep 16 05:23:50.460759 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:50.460730    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"]
Sep 16 05:23:50.464654 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:50.464632    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-afd377-openshift-default-5bc8568988-htqn5"]
Sep 16 05:23:50.784993 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:50.784966    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" path="/var/lib/kubelet/pods/84de7d62-812d-421c-8b40-c48b55a8bd3f/volumes"
Sep 16 05:23:55.075468 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.075426    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84"]
Sep 16 05:23:55.078022 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.077998    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-3784e2-29825595-lxw84"]
Sep 16 05:23:55.101718 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.101693    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"]
Sep 16 05:23:55.101914 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.101888    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6" podUID="92701124-b15e-47ea-abb3-e5bb26f48b25" containerName="payload-processing" containerID="cri-o://e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58" gracePeriod=30
Sep 16 05:23:55.122665 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.122635    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"]
Sep 16 05:23:55.123137 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.123099    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm" podUID="05aef53b-20ef-4eb4-a788-03f0e87aa58d" containerName="payload-pre-processing" containerID="cri-o://6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3" gracePeriod=30
Sep 16 05:23:55.263007 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.262972    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"]
Sep 16 05:23:55.266525 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.266495    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-3784e2-f7j8p"]
Sep 16 05:23:55.392957 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.392931    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:23:55.395878 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.395857    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:23:55.455997 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.455969    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnhct\" (UniqueName: \"kubernetes.io/projected/92701124-b15e-47ea-abb3-e5bb26f48b25-kube-api-access-dnhct\") pod \"92701124-b15e-47ea-abb3-e5bb26f48b25\" (UID: \"92701124-b15e-47ea-abb3-e5bb26f48b25\") "
Sep 16 05:23:55.456151 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.456006    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05aef53b-20ef-4eb4-a788-03f0e87aa58d-plugins-config-volume\") pod \"05aef53b-20ef-4eb4-a788-03f0e87aa58d\" (UID: \"05aef53b-20ef-4eb4-a788-03f0e87aa58d\") "
Sep 16 05:23:55.456151 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.456056    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sd5j\" (UniqueName: \"kubernetes.io/projected/05aef53b-20ef-4eb4-a788-03f0e87aa58d-kube-api-access-6sd5j\") pod \"05aef53b-20ef-4eb4-a788-03f0e87aa58d\" (UID: \"05aef53b-20ef-4eb4-a788-03f0e87aa58d\") "
Sep 16 05:23:55.456151 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.456093    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92701124-b15e-47ea-abb3-e5bb26f48b25-plugins-config-volume\") pod \"92701124-b15e-47ea-abb3-e5bb26f48b25\" (UID: \"92701124-b15e-47ea-abb3-e5bb26f48b25\") "
Sep 16 05:23:55.456517 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.456466    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05aef53b-20ef-4eb4-a788-03f0e87aa58d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05aef53b-20ef-4eb4-a788-03f0e87aa58d" (UID: "05aef53b-20ef-4eb4-a788-03f0e87aa58d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:23:55.456578 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.456508    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92701124-b15e-47ea-abb3-e5bb26f48b25-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "92701124-b15e-47ea-abb3-e5bb26f48b25" (UID: "92701124-b15e-47ea-abb3-e5bb26f48b25"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:23:55.458220 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.458195    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92701124-b15e-47ea-abb3-e5bb26f48b25-kube-api-access-dnhct" (OuterVolumeSpecName: "kube-api-access-dnhct") pod "92701124-b15e-47ea-abb3-e5bb26f48b25" (UID: "92701124-b15e-47ea-abb3-e5bb26f48b25"). InnerVolumeSpecName "kube-api-access-dnhct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:23:55.458323 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.458272    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05aef53b-20ef-4eb4-a788-03f0e87aa58d-kube-api-access-6sd5j" (OuterVolumeSpecName: "kube-api-access-6sd5j") pod "05aef53b-20ef-4eb4-a788-03f0e87aa58d" (UID: "05aef53b-20ef-4eb4-a788-03f0e87aa58d"). InnerVolumeSpecName "kube-api-access-6sd5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 05:23:55.469726 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.469700    2559 generic.go:356] "Generic (PLEG): container finished" podID="05aef53b-20ef-4eb4-a788-03f0e87aa58d" containerID="6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3" exitCode=0
Sep 16 05:23:55.469838 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.469741    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"
Sep 16 05:23:55.469838 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.469784    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm" event={"ID":"05aef53b-20ef-4eb4-a788-03f0e87aa58d","Type":"ContainerDied","Data":"6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3"}
Sep 16 05:23:55.469935 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.469838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm" event={"ID":"05aef53b-20ef-4eb4-a788-03f0e87aa58d","Type":"ContainerDied","Data":"98c422d4aa8b4e4c672e3ec2da07b6ed32ff635db3097c89b1a3d9852cbd458d"}
Sep 16 05:23:55.469935 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.469867    2559 scope.go:117] "RemoveContainer" containerID="6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3"
Sep 16 05:23:55.471111 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.471087    2559 generic.go:356] "Generic (PLEG): container finished" podID="92701124-b15e-47ea-abb3-e5bb26f48b25" containerID="e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58" exitCode=0
Sep 16 05:23:55.471188 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.471128    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"
Sep 16 05:23:55.471188 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.471133    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6" event={"ID":"92701124-b15e-47ea-abb3-e5bb26f48b25","Type":"ContainerDied","Data":"e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58"}
Sep 16 05:23:55.471188 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.471174    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6" event={"ID":"92701124-b15e-47ea-abb3-e5bb26f48b25","Type":"ContainerDied","Data":"7c61b985b24717d5ed67dea27da5a09f87add8ea1aadc8a0c49c683e4721445e"}
Sep 16 05:23:55.479260 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.479243    2559 scope.go:117] "RemoveContainer" containerID="6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3"
Sep 16 05:23:55.479553 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:23:55.479524    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3\": container with ID starting with 6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3 not found: ID does not exist" containerID="6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3"
Sep 16 05:23:55.479631 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.479564    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3"} err="failed to get container status \"6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3\": rpc error: code = NotFound desc = could not find container \"6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3\": container with ID starting with 6c37f269c71ba7eeedf8c3c30c4db771933a5c87313544ff969969cb07d332e3 not found: ID does not exist"
Sep 16 05:23:55.479631 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.479582    2559 scope.go:117] "RemoveContainer" containerID="e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58"
Sep 16 05:23:55.488076 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.488059    2559 scope.go:117] "RemoveContainer" containerID="e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58"
Sep 16 05:23:55.488325 ip-10-0-134-147 kubenswrapper[2559]: E0916 05:23:55.488308    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58\": container with ID starting with e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58 not found: ID does not exist" containerID="e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58"
Sep 16 05:23:55.488372 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.488332    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58"} err="failed to get container status \"e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58\": rpc error: code = NotFound desc = could not find container \"e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58\": container with ID starting with e31ceb614d64f1b15d589e9272e9abb0e4a09a4190a276a55df9fe1bf6a53b58 not found: ID does not exist"
Sep 16 05:23:55.493953 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.493891    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"]
Sep 16 05:23:55.496008 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.495988    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-3784e2-84cc8c56b9-txcl6"]
Sep 16 05:23:55.504700 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.504681    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"]
Sep 16 05:23:55.509723 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.509703    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-3784e2-f45797486-cw8mm"]
Sep 16 05:23:55.556773 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.556753    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnhct\" (UniqueName: \"kubernetes.io/projected/92701124-b15e-47ea-abb3-e5bb26f48b25-kube-api-access-dnhct\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:55.556773 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.556771    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05aef53b-20ef-4eb4-a788-03f0e87aa58d-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:55.556897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.556781    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sd5j\" (UniqueName: \"kubernetes.io/projected/05aef53b-20ef-4eb4-a788-03f0e87aa58d-kube-api-access-6sd5j\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:55.556897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:55.556790    2559 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92701124-b15e-47ea-abb3-e5bb26f48b25-plugins-config-volume\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:23:56.792028 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:56.791985    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05aef53b-20ef-4eb4-a788-03f0e87aa58d" path="/var/lib/kubelet/pods/05aef53b-20ef-4eb4-a788-03f0e87aa58d/volumes"
Sep 16 05:23:56.792536 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:56.792392    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a3b46ab-b2c8-474c-ac4e-61da0526fe22" path="/var/lib/kubelet/pods/0a3b46ab-b2c8-474c-ac4e-61da0526fe22/volumes"
Sep 16 05:23:56.792753 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:56.792734    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b58e16-5c30-403b-9ace-5934b8faa6fa" path="/var/lib/kubelet/pods/11b58e16-5c30-403b-9ace-5934b8faa6fa/volumes"
Sep 16 05:23:56.793108 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:23:56.793090    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92701124-b15e-47ea-abb3-e5bb26f48b25" path="/var/lib/kubelet/pods/92701124-b15e-47ea-abb3-e5bb26f48b25/volumes"
Sep 16 05:24:02.246345 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246314    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"]
Sep 16 05:24:02.246793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246723    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05aef53b-20ef-4eb4-a788-03f0e87aa58d" containerName="payload-pre-processing"
Sep 16 05:24:02.246793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246737    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="05aef53b-20ef-4eb4-a788-03f0e87aa58d" containerName="payload-pre-processing"
Sep 16 05:24:02.246793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246753    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy"
Sep 16 05:24:02.246793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246759    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy"
Sep 16 05:24:02.246793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246765    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b58e16-5c30-403b-9ace-5934b8faa6fa" containerName="revoke-keys"
Sep 16 05:24:02.246793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246771    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b58e16-5c30-403b-9ace-5934b8faa6fa" containerName="revoke-keys"
Sep 16 05:24:02.246793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246781    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92701124-b15e-47ea-abb3-e5bb26f48b25" containerName="payload-processing"
Sep 16 05:24:02.246793 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246787    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="92701124-b15e-47ea-abb3-e5bb26f48b25" containerName="payload-processing"
Sep 16 05:24:02.247039 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246852    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy"
Sep 16 05:24:02.247039 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246860    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="17d88493-2964-4b95-8ed3-caa3dbc9b734" containerName="istio-proxy"
Sep 16 05:24:02.247039 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246865    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="05aef53b-20ef-4eb4-a788-03f0e87aa58d" containerName="payload-pre-processing"
Sep 16 05:24:02.247039 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246871    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy"
Sep 16 05:24:02.247039 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246877    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="92701124-b15e-47ea-abb3-e5bb26f48b25" containerName="payload-processing"
Sep 16 05:24:02.247039 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.246883    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b58e16-5c30-403b-9ace-5934b8faa6fa" containerName="revoke-keys"
Sep 16 05:24:02.251195 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.251172    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"
Sep 16 05:24:02.255306 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.255263    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:24:02.261118 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.261090    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"]
Sep 16 05:24:02.302995 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.302971    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft\" (UID: \"f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"
Sep 16 05:24:02.403878 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.403853    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft\" (UID: \"f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"
Sep 16 05:24:02.404420 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.404397    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft\" (UID: \"f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"
Sep 16 05:24:02.561331 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.561242    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"
Sep 16 05:24:02.831973 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:02.831950    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"]
Sep 16 05:24:02.834156 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:24:02.834120    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c55f2c_b518_4e5b_bf1a_4e18ef7fffe4.slice/crio-6b7b26674bd411c47bb7e247d61dc3747febe19d024c1cc0bc1dfb4eb7e95911 WatchSource:0}: Error finding container 6b7b26674bd411c47bb7e247d61dc3747febe19d024c1cc0bc1dfb4eb7e95911: Status 404 returned error can't find the container with id 6b7b26674bd411c47bb7e247d61dc3747febe19d024c1cc0bc1dfb4eb7e95911
Sep 16 05:24:03.519367 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:03.519336    2559 generic.go:356] "Generic (PLEG): container finished" podID="f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4" containerID="7994e568cb60ecef23c6c7b928d3261b5db1f4113e352c309480fbbf4492fe84" exitCode=0
Sep 16 05:24:03.519679 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:03.519413    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft" event={"ID":"f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4","Type":"ContainerDied","Data":"7994e568cb60ecef23c6c7b928d3261b5db1f4113e352c309480fbbf4492fe84"}
Sep 16 05:24:03.519679 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:03.519456    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft" event={"ID":"f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4","Type":"ContainerStarted","Data":"6b7b26674bd411c47bb7e247d61dc3747febe19d024c1cc0bc1dfb4eb7e95911"}
Sep 16 05:24:04.654691 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:04.654667    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"
Sep 16 05:24:04.721691 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:04.721666    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4-maas-api-service-ca\") pod \"f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4\" (UID: \"f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4\") "
Sep 16 05:24:04.722013 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:04.721989    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4" (UID: "f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 05:24:04.822413 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:04.822385    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4-maas-api-service-ca\") on node \"ip-10-0-134-147.ec2.internal\" DevicePath \"\""
Sep 16 05:24:05.529888 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:05.529865    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"
Sep 16 05:24:05.530024 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:05.529913    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft" event={"ID":"f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4","Type":"ContainerDied","Data":"6b7b26674bd411c47bb7e247d61dc3747febe19d024c1cc0bc1dfb4eb7e95911"}
Sep 16 05:24:05.530024 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:05.529962    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b7b26674bd411c47bb7e247d61dc3747febe19d024c1cc0bc1dfb4eb7e95911"
Sep 16 05:24:07.435472 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:07.435445    2559 scope.go:117] "RemoveContainer" containerID="b437816d29cbf872ae3ad84d53cfd0af438db79368b9748d9eee9ae1c4704894"
Sep 16 05:24:12.804669 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:12.804639    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"]
Sep 16 05:24:12.808198 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:12.808170    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-10ee79-zjcft"]
Sep 16 05:24:14.784496 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:24:14.784447    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4" path="/var/lib/kubelet/pods/f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4/volumes"
Sep 16 05:28:07.498146 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:28:07.498115    2559 scope.go:117] "RemoveContainer" containerID="2fad4fd36dcd72e0f77c928855050a0c814f3571596d602fe7b100feb782768f"
Sep 16 05:29:07.520024 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:29:07.519994    2559 scope.go:117] "RemoveContainer" containerID="7c3fa8987b6124504ce23e83e7ed2140b6654d0218bc0d2e1b1ca5daf0814c18"
Sep 16 05:30:00.134357 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:00.134320    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs"]
Sep 16 05:30:00.134785 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:00.134735    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy"
Sep 16 05:30:00.134785 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:00.134748    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="84de7d62-812d-421c-8b40-c48b55a8bd3f" containerName="istio-proxy"
Sep 16 05:30:00.134785 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:00.134773    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4" containerName="revoke-keys"
Sep 16 05:30:00.134785 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:00.134779    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4" containerName="revoke-keys"
Sep 16 05:30:00.134968 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:00.134835    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9c55f2c-b518-4e5b-bf1a-4e18ef7fffe4" containerName="revoke-keys"
Sep 16 05:30:00.137770 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:00.137751    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs"
Sep 16 05:30:00.139646 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:00.139619    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-sm548\""
Sep 16 05:30:00.142571 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:00.142544    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs"]
Sep 16 05:30:00.149818 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:00.149796    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs"
Sep 16 05:30:00.422780 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:00.422743    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs"]
Sep 16 05:30:00.425100 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:30:00.425062    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f983ac3_e57f_42a8_8c71_5e15c7693fbc.slice/crio-eebd12ff149dcfaecba7361574c39ee3d1952f2f19fecd28a5d165e669cc497e WatchSource:0}: Error finding container eebd12ff149dcfaecba7361574c39ee3d1952f2f19fecd28a5d165e669cc497e: Status 404 returned error can't find the container with id eebd12ff149dcfaecba7361574c39ee3d1952f2f19fecd28a5d165e669cc497e
Sep 16 05:30:01.288287 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:01.288243    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs" event={"ID":"6f983ac3-e57f-42a8-8c71-5e15c7693fbc","Type":"ContainerStarted","Data":"62858cdb3d634185f2af58293abc5953a38830159332b443cb6f3eb56932819e"}
Sep 16 05:30:01.288769 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:01.288340    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs" event={"ID":"6f983ac3-e57f-42a8-8c71-5e15c7693fbc","Type":"ContainerStarted","Data":"eebd12ff149dcfaecba7361574c39ee3d1952f2f19fecd28a5d165e669cc497e"}
Sep 16 05:30:01.303602 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:01.303553    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs" podStartSLOduration=1.303533561 podStartE2EDuration="1.303533561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 05:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:30:01.302003666 +0000 UTC m=+2454.963182845" watchObservedRunningTime="2026-09-16 05:30:01.303533561 +0000 UTC m=+2454.964712741"
Sep 16 05:30:02.295143 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:02.295102    2559 generic.go:356] "Generic (PLEG): container finished" podID="6f983ac3-e57f-42a8-8c71-5e15c7693fbc" containerID="62858cdb3d634185f2af58293abc5953a38830159332b443cb6f3eb56932819e" exitCode=0
Sep 16 05:30:02.295546 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:02.295156    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs" event={"ID":"6f983ac3-e57f-42a8-8c71-5e15c7693fbc","Type":"ContainerDied","Data":"62858cdb3d634185f2af58293abc5953a38830159332b443cb6f3eb56932819e"}
Sep 16 05:30:03.432783 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:03.432758    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs"
Sep 16 05:30:04.306839 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:04.306807    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs"
Sep 16 05:30:04.306995 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:04.306809    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825610-k5cvs" event={"ID":"6f983ac3-e57f-42a8-8c71-5e15c7693fbc","Type":"ContainerDied","Data":"eebd12ff149dcfaecba7361574c39ee3d1952f2f19fecd28a5d165e669cc497e"}
Sep 16 05:30:04.306995 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:04.306935    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eebd12ff149dcfaecba7361574c39ee3d1952f2f19fecd28a5d165e669cc497e"
Sep 16 05:30:07.538138 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:07.538106    2559 scope.go:117] "RemoveContainer" containerID="7994e568cb60ecef23c6c7b928d3261b5db1f4113e352c309480fbbf4492fe84"
Sep 16 05:30:07.546587 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:07.546567    2559 scope.go:117] "RemoveContainer" containerID="8daf64e5c2901252475ceb15efe4fbf85fafc90e6d0d9e961295f461001bfe93"
Sep 16 05:30:07.554093 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:07.554063    2559 scope.go:117] "RemoveContainer" containerID="46e66587242906706b7746f8854d164ac4793fb73d6858feeea741f54bf9922a"
Sep 16 05:30:19.422950 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:19.422921    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jmnwg_c2114dcf-4f02-414c-affd-1160ac57f2e8/manager/0.log"
Sep 16 05:30:19.543879 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:19.543850    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xthpw_b2e404a4-97bc-4553-9b74-8ba983c076a2/manager/0.log"
Sep 16 05:30:19.998991 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:19.998964    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-756589c867-f9ghs_2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d/copy-manifests/0.log"
Sep 16 05:30:20.017737 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:20.017682    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-756589c867-f9ghs_2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d/manager/0.log"
Sep 16 05:30:20.959287 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:20.959258    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29825610-k5cvs_6f983ac3-e57f-42a8-8c71-5e15c7693fbc/cleanup/0.log"
Sep 16 05:30:21.077084 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:21.077052    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-2nzd7_f012a490-718b-4ea9-91a0-4e40baa20888/postgres/0.log"
Sep 16 05:30:21.962029 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:21.961998    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hx2q7_c2a27d53-193e-4e50-a220-f9e7ce2b4024/manager/0.log"
Sep 16 05:30:22.073267 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:22.073235    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-66bgv_94360647-5232-45b1-8243-a33e453f8197/manager/0.log"
Sep 16 05:30:22.903849 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:22.903819    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj_863f33fa-18c2-4bcf-aabd-c6b82bca98d4/istio-proxy/0.log"
Sep 16 05:30:23.353358 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:23.353324    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4fbjr_b6b1cb04-82ac-4e66-8159-867647a40482/istio-proxy/1.log"
Sep 16 05:30:23.480454 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:23.480425    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-f4k6g_cad4ca0f-be34-4ca8-a7ee-b681df543ece/payload-pre-processing/0.log"
Sep 16 05:30:23.603220 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:23.603187    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-lf8r9_d2aa8f3c-21cd-4411-bd90-d6128d4b54cc/payload-processing/0.log"
Sep 16 05:30:24.274873 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:24.274846    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-blb9g_f283abb9-540b-4253-a056-236a2b953d49/main/0.log"
Sep 16 05:30:24.613868 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:24.613777    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-qpf82_340a892f-ac56-4cfb-bf7d-4c34fd355f5e/main/0.log"
Sep 16 05:30:24.732243 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:24.732213    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-7k2rn_d400ef7f-26f4-4498-b5ac-a895469f748a/main/0.log"
Sep 16 05:30:32.811334 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:32.811302    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nb8bf_c5d07b8d-2dc6-467d-99b3-a505e342f2fc/global-pull-secret-syncer/0.log"
Sep 16 05:30:32.960422 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:32.960391    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dnkdn_5cdcef12-f8d4-4169-97ee-32cad9f9ac6f/konnectivity-agent/0.log"
Sep 16 05:30:33.005328 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:33.005304    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-147.ec2.internal_6796712b5facba899f960a43b24969ec/haproxy/0.log"
Sep 16 05:30:37.599802 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:37.599774    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hx2q7_c2a27d53-193e-4e50-a220-f9e7ce2b4024/manager/0.log"
Sep 16 05:30:37.631407 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:37.631378    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-66bgv_94360647-5232-45b1-8243-a33e453f8197/manager/0.log"
Sep 16 05:30:39.270784 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.270738    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3956437-acd4-4aad-a0b4-bf1158da6ba1/alertmanager/0.log"
Sep 16 05:30:39.291265 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.291242    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3956437-acd4-4aad-a0b4-bf1158da6ba1/config-reloader/0.log"
Sep 16 05:30:39.313441 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.313419    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3956437-acd4-4aad-a0b4-bf1158da6ba1/kube-rbac-proxy-web/0.log"
Sep 16 05:30:39.329237 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.329200    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3956437-acd4-4aad-a0b4-bf1158da6ba1/kube-rbac-proxy/0.log"
Sep 16 05:30:39.348499 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.348457    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3956437-acd4-4aad-a0b4-bf1158da6ba1/kube-rbac-proxy-metric/0.log"
Sep 16 05:30:39.367439 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.367423    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3956437-acd4-4aad-a0b4-bf1158da6ba1/prom-label-proxy/0.log"
Sep 16 05:30:39.386737 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.386716    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3956437-acd4-4aad-a0b4-bf1158da6ba1/init-config-reloader/0.log"
Sep 16 05:30:39.639897 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.639791    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hczd9_db510a42-d551-4397-a7e4-398e88e3a3ce/node-exporter/0.log"
Sep 16 05:30:39.659342 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.659318    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hczd9_db510a42-d551-4397-a7e4-398e88e3a3ce/kube-rbac-proxy/0.log"
Sep 16 05:30:39.678779 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.678762    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hczd9_db510a42-d551-4397-a7e4-398e88e3a3ce/init-textfile/0.log"
Sep 16 05:30:39.854427 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.854400    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86dd0ef5-8698-4d54-a105-4b8e29634fed/prometheus/0.log"
Sep 16 05:30:39.877656 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.877632    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86dd0ef5-8698-4d54-a105-4b8e29634fed/config-reloader/0.log"
Sep 16 05:30:39.899353 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.899290    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86dd0ef5-8698-4d54-a105-4b8e29634fed/thanos-sidecar/0.log"
Sep 16 05:30:39.919121 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.919103    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86dd0ef5-8698-4d54-a105-4b8e29634fed/kube-rbac-proxy-web/0.log"
Sep 16 05:30:39.938791 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.938775    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86dd0ef5-8698-4d54-a105-4b8e29634fed/kube-rbac-proxy/0.log"
Sep 16 05:30:39.961190 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.961168    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86dd0ef5-8698-4d54-a105-4b8e29634fed/kube-rbac-proxy-thanos/0.log"
Sep 16 05:30:39.984655 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:39.984629    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_86dd0ef5-8698-4d54-a105-4b8e29634fed/init-config-reloader/0.log"
Sep 16 05:30:40.020775 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:40.020735    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-5pwdr_9a351ef0-36a7-4641-836f-cdfe1a363653/prometheus-operator/0.log"
Sep 16 05:30:40.036023 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:40.036006    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-5pwdr_9a351ef0-36a7-4641-836f-cdfe1a363653/kube-rbac-proxy/0.log"
Sep 16 05:30:40.058332 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:40.058304    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-c8ww8_481fcf97-62d0-4c84-b84d-fb5d4bb99e07/prometheus-operator-admission-webhook/0.log"
Sep 16 05:30:40.213512 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:40.213427    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869c57b67d-xr7lc_c2af2863-66d0-4273-992a-dcea43304a6f/thanos-query/0.log"
Sep 16 05:30:40.234932 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:40.234907    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869c57b67d-xr7lc_c2af2863-66d0-4273-992a-dcea43304a6f/kube-rbac-proxy-web/0.log"
Sep 16 05:30:40.254708 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:40.254685    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869c57b67d-xr7lc_c2af2863-66d0-4273-992a-dcea43304a6f/kube-rbac-proxy/0.log"
Sep 16 05:30:40.279270 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:40.279254    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869c57b67d-xr7lc_c2af2863-66d0-4273-992a-dcea43304a6f/prom-label-proxy/0.log"
Sep 16 05:30:40.304034 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:40.304013    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869c57b67d-xr7lc_c2af2863-66d0-4273-992a-dcea43304a6f/kube-rbac-proxy-rules/0.log"
Sep 16 05:30:40.338524 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:40.338502    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-869c57b67d-xr7lc_c2af2863-66d0-4273-992a-dcea43304a6f/kube-rbac-proxy-metrics/0.log"
Sep 16 05:30:43.022617 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.022590    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-lv9b6_8b149c36-4928-4c9a-b7f0-460c06c0a001/download-server/0.log"
Sep 16 05:30:43.406863 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.406789    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"]
Sep 16 05:30:43.407269 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.407250    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f983ac3-e57f-42a8-8c71-5e15c7693fbc" containerName="cleanup"
Sep 16 05:30:43.407269 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.407266    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f983ac3-e57f-42a8-8c71-5e15c7693fbc" containerName="cleanup"
Sep 16 05:30:43.407520 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.407378    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f983ac3-e57f-42a8-8c71-5e15c7693fbc" containerName="cleanup"
Sep 16 05:30:43.410653 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.410636    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.412618 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.412595    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hf662\"/\"kube-root-ca.crt\""
Sep 16 05:30:43.412956 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.412941    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hf662\"/\"default-dockercfg-p95kz\""
Sep 16 05:30:43.413010 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.412963    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hf662\"/\"openshift-service-ca.crt\""
Sep 16 05:30:43.415766 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.415747    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"]
Sep 16 05:30:43.549563 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.549537    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-lib-modules\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.549681 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.549596    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-proc\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.549681 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.549644    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-podres\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.549681 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.549669    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-sys\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.549850 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.549737    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr9qr\" (UniqueName: \"kubernetes.io/projected/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-kube-api-access-lr9qr\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.651167 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.651135    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-proc\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.651287 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.651192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-podres\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.651287 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.651225    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-sys\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.651287 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.651258    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-proc\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.651287 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.651269    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr9qr\" (UniqueName: \"kubernetes.io/projected/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-kube-api-access-lr9qr\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.651531 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.651318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-sys\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.651531 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.651359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-lib-modules\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.651531 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.651383    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-podres\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.651670 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.651575    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-lib-modules\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.658754 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.658706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr9qr\" (UniqueName: \"kubernetes.io/projected/59cb4b9e-f48c-47ad-ac0f-a19f8948629a-kube-api-access-lr9qr\") pod \"perf-node-gather-daemonset-vjdvk\" (UID: \"59cb4b9e-f48c-47ad-ac0f-a19f8948629a\") " pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.720941 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.720907    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:43.993345 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:43.993304    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"]
Sep 16 05:30:44.000387 ip-10-0-134-147 kubenswrapper[2559]: W0916 05:30:44.000355    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod59cb4b9e_f48c_47ad_ac0f_a19f8948629a.slice/crio-e39dd3c56d1a95ff57952ecf3d1e66228d5466bad1ed083e8dbfca33bd60c8cd WatchSource:0}: Error finding container e39dd3c56d1a95ff57952ecf3d1e66228d5466bad1ed083e8dbfca33bd60c8cd: Status 404 returned error can't find the container with id e39dd3c56d1a95ff57952ecf3d1e66228d5466bad1ed083e8dbfca33bd60c8cd
Sep 16 05:30:44.515946 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:44.515906    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk" event={"ID":"59cb4b9e-f48c-47ad-ac0f-a19f8948629a","Type":"ContainerStarted","Data":"041674d8b944f26e7d2c5812fbae9e469960f572eac32a22626d2a821029a27a"}
Sep 16 05:30:44.516370 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:44.515961    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk" event={"ID":"59cb4b9e-f48c-47ad-ac0f-a19f8948629a","Type":"ContainerStarted","Data":"e39dd3c56d1a95ff57952ecf3d1e66228d5466bad1ed083e8dbfca33bd60c8cd"}
Sep 16 05:30:44.516370 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:44.516005    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:44.531655 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:44.531609    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk" podStartSLOduration=1.531592998 podStartE2EDuration="1.531592998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 05:30:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 05:30:44.529725379 +0000 UTC m=+2498.190904568" watchObservedRunningTime="2026-09-16 05:30:44.531592998 +0000 UTC m=+2498.192772176"
Sep 16 05:30:44.909783 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:44.909755    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4vxh6_c3c8bb0f-3119-4407-9a06-d3f0466ffe5f/dns/0.log"
Sep 16 05:30:44.928065 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:44.928038    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4vxh6_c3c8bb0f-3119-4407-9a06-d3f0466ffe5f/kube-rbac-proxy/0.log"
Sep 16 05:30:45.045655 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:45.045627    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7h8cj_c5a33096-52cf-4c3d-972d-8d3859c715c1/dns-node-resolver/0.log"
Sep 16 05:30:45.660003 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:45.659975    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c4df87c7-rfpm9_a815e044-d1b1-4162-b3a5-fbc89edcf6f3/registry/0.log"
Sep 16 05:30:45.683866 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:45.683841    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-42m6b_04054e53-0882-4028-9e81-5bcf959c1cf6/node-ca/0.log"
Sep 16 05:30:46.606759 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:46.606717    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj_863f33fa-18c2-4bcf-aabd-c6b82bca98d4/istio-proxy/0.log"
Sep 16 05:30:47.083899 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:47.083863    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4fbjr_b6b1cb04-82ac-4e66-8159-867647a40482/istio-proxy/0.log"
Sep 16 05:30:47.088738 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:47.088698    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4fbjr_b6b1cb04-82ac-4e66-8159-867647a40482/istio-proxy/1.log"
Sep 16 05:30:47.140612 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:47.140581    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-f4k6g_cad4ca0f-be34-4ca8-a7ee-b681df543ece/payload-pre-processing/0.log"
Sep 16 05:30:47.182969 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:47.182935    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-lf8r9_d2aa8f3c-21cd-4411-bd90-d6128d4b54cc/payload-processing/0.log"
Sep 16 05:30:48.083207 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:48.083161    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fmh8r_315d95fb-3972-4e60-93b8-a5280e0466ec/serve-healthcheck-canary/0.log"
Sep 16 05:30:48.542781 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:48.542753    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cjvr_b15b9dbd-c63b-4123-a436-31f81bc75729/kube-rbac-proxy/0.log"
Sep 16 05:30:48.561585 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:48.561550    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cjvr_b15b9dbd-c63b-4123-a436-31f81bc75729/exporter/0.log"
Sep 16 05:30:48.580015 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:48.579994    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cjvr_b15b9dbd-c63b-4123-a436-31f81bc75729/extractor/0.log"
Sep 16 05:30:50.530916 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:50.530890    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hf662/perf-node-gather-daemonset-vjdvk"
Sep 16 05:30:50.751815 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:50.751786    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-jmnwg_c2114dcf-4f02-414c-affd-1160ac57f2e8/manager/0.log"
Sep 16 05:30:51.224779 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:51.224751    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xthpw_b2e404a4-97bc-4553-9b74-8ba983c076a2/manager/0.log"
Sep 16 05:30:51.493391 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:51.493321    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-756589c867-f9ghs_2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d/manager/0.log"
Sep 16 05:30:51.509163 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:51.509141    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-756589c867-f9ghs_2bfab273-bdf5-4b73-9dc4-a60fbc1cb14d/copy-manifests/0.log"
Sep 16 05:30:52.933742 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:52.933670    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-778cf7776f-nn6sf_acb6dcd3-5482-45ed-b62b-53b35cfc2a92/manager/0.log"
Sep 16 05:30:53.180867 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:53.180838    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj_863f33fa-18c2-4bcf-aabd-c6b82bca98d4/istio-proxy/0.log"
Sep 16 05:30:53.641461 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:53.641374    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4fbjr_b6b1cb04-82ac-4e66-8159-867647a40482/istio-proxy/0.log"
Sep 16 05:30:53.646577 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:53.646551    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4fbjr_b6b1cb04-82ac-4e66-8159-867647a40482/istio-proxy/1.log"
Sep 16 05:30:53.673808 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:53.673779    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-f4k6g_cad4ca0f-be34-4ca8-a7ee-b681df543ece/payload-pre-processing/0.log"
Sep 16 05:30:53.703611 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:53.703590    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-lf8r9_d2aa8f3c-21cd-4411-bd90-d6128d4b54cc/payload-processing/0.log"
Sep 16 05:30:55.268619 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:55.268585    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cpxjlj_863f33fa-18c2-4bcf-aabd-c6b82bca98d4/istio-proxy/0.log"
Sep 16 05:30:55.746741 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:55.746709    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4fbjr_b6b1cb04-82ac-4e66-8159-867647a40482/istio-proxy/0.log"
Sep 16 05:30:55.751683 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:55.751657    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4fbjr_b6b1cb04-82ac-4e66-8159-867647a40482/istio-proxy/1.log"
Sep 16 05:30:55.784368 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:55.784334    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-f4k6g_cad4ca0f-be34-4ca8-a7ee-b681df543ece/payload-pre-processing/0.log"
Sep 16 05:30:55.817049 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:55.817021    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-lf8r9_d2aa8f3c-21cd-4411-bd90-d6128d4b54cc/payload-processing/0.log"
Sep 16 05:30:59.370954 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:59.370917    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-885bn_55bd99bc-f1a4-4208-9326-76f14296bfaf/kube-multus/0.log"
Sep 16 05:30:59.655809 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:59.655733    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w967k_e70a14e2-5e55-49de-809f-fec8c0dba5e1/kube-multus-additional-cni-plugins/0.log"
Sep 16 05:30:59.674695 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:59.674658    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w967k_e70a14e2-5e55-49de-809f-fec8c0dba5e1/egress-router-binary-copy/0.log"
Sep 16 05:30:59.694380 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:59.694357    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w967k_e70a14e2-5e55-49de-809f-fec8c0dba5e1/cni-plugins/0.log"
Sep 16 05:30:59.713341 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:59.713314    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w967k_e70a14e2-5e55-49de-809f-fec8c0dba5e1/bond-cni-plugin/0.log"
Sep 16 05:30:59.732922 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:59.732897    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w967k_e70a14e2-5e55-49de-809f-fec8c0dba5e1/routeoverride-cni/0.log"
Sep 16 05:30:59.752392 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:59.752372    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w967k_e70a14e2-5e55-49de-809f-fec8c0dba5e1/whereabouts-cni-bincopy/0.log"
Sep 16 05:30:59.771091 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:59.771071    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w967k_e70a14e2-5e55-49de-809f-fec8c0dba5e1/whereabouts-cni/0.log"
Sep 16 05:30:59.916209 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:59.916120    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zp4zd_238121a1-1a61-4833-8f18-4e02b9a5d58a/network-metrics-daemon/0.log"
Sep 16 05:30:59.930215 ip-10-0-134-147 kubenswrapper[2559]: I0916 05:30:59.930187    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zp4zd_238121a1-1a61-4833-8f18-4e02b9a5d58a/kube-rbac-proxy/0.log"