Sep 17 00:09:58.311273 ip-10-0-138-211 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 00:09:58.651985 ip-10-0-138-211 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 00:09:58.651985 ip-10-0-138-211 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 00:09:58.651985 ip-10-0-138-211 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 00:09:58.651985 ip-10-0-138-211 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 00:09:58.651985 ip-10-0-138-211 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 00:09:58.653626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.653558    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 00:09:58.656653 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656628    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:58.656653 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656651    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:58.656653 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656656    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:58.656653 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656660    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:58.656653 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656664    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656669    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656673    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656676    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656681    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656685    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656689    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656693    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656697    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656700    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656704    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656709    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656713    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656717    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656721    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656725    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656730    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656735    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656739    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656743    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:58.656917 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656747    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656751    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656756    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656760    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656764    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656768    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656773    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656777    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656781    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656786    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656790    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656794    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656798    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656803    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656807    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656811    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656816    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656820    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656824    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:58.657735 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656828    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656833    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656837    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656841    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656846    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656850    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656855    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656862    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656868    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656873    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656879    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656883    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656888    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656893    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656897    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656901    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656906    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656910    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656913    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:58.658544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656918    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656923    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656927    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656931    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656935    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656939    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656944    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656948    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656955    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656961    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656965    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656970    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656975    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656979    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656984    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656988    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.656996    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657002    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657006    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:58.659208 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657011    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657031    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657036    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657041    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657045    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657050    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657055    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657058    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657062    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657067    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657071    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657075    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657080    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657084    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657088    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657092    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657097    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.657101    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658295    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658306    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658313    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:58.659817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658318    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658323    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658329    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658333    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658337    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658343    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658347    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658352    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658357    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658361    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658365    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658369    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658373    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658377    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658382    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658386    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658390    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658396    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658400    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658404    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:58.660714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658409    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658413    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658417    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658422    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658426    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658430    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658435    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658439    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658443    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658448    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658452    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658456    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658460    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658464    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658469    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658473    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658477    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658481    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658487    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658492    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:58.661660 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658498    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658503    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658508    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658512    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658517    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658521    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658526    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658530    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658534    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658539    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658543    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658547    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658551    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658555    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658559    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658563    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658567    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658571    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658575    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:58.662367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658580    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658584    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658588    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658592    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658597    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658601    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658606    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658610    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658614    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658618    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658622    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658627    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658631    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658635    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658638    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658643    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658647    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658651    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658655    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:58.662871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658659    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658663    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658672    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658678    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658683    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658687    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658692    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658696    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658700    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658704    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658708    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658713    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658719    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658725    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658730    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658735    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658739    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.658743    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659938    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659948    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:58.663370 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659953    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659958    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659962    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659967    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659972    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659977    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659981    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659985    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659990    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659994    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.659998    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660002    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660006    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660011    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660033    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660038    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660043    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660048    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660054    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:58.663853 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660060    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660064    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660069    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660074    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660078    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660082    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660087    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660091    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660095    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660099    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660103    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660107    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660112    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660116    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660120    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660125    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660129    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660133    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660137    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660141    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:58.664335 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660145    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660150    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660154    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660159    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660164    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660168    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660173    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660178    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660182    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660185    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660189    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660194    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660198    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660203    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660207    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660212    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660216    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660220    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660224    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660228    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:58.664812 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660232    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660236    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660241    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660247    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660252    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660258    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660262    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660267    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660271    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660276    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660281    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660285    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660290    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660294    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660299    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660304    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660308    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660313    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660317    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:58.665322 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660322    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660327    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660331    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660335    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660339    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660344    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660349    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660354    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660357    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660363    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660367    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660372    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660376    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660380    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660384    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660390    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660396    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660400    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.660405    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660500    2565 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 00:09:58.665870 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660551    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660561    2565 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660568    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660574    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660580    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660586    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660593    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660598    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660603    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660608    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660614    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660618    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660623    2565 flags.go:64] FLAG: --cgroup-root=""
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660628    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660632    2565 flags.go:64] FLAG: --client-ca-file=""
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660637    2565 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660642    2565 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660647    2565 flags.go:64] FLAG: --cluster-domain=""
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660653    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660658    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660663    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660668    2565 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660674    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 00:09:58.666710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660679    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660684    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660689    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660694    2565 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660699    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660704    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660709    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660713    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660719    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660723    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660728    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660732    2565 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660736    2565 flags.go:64] FLAG: --enable-server="true"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660741    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660748    2565 flags.go:64] FLAG: --event-burst="100"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660753    2565 flags.go:64] FLAG: --event-qps="50"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660757    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660762    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660767    2565 flags.go:64] FLAG: --eviction-hard=""
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660773    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660777    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660781    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660786    2565 flags.go:64] FLAG: --eviction-soft=""
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660791    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660796    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 00:09:58.667722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660803    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660808    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660813    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660818    2565 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660823    2565 flags.go:64] FLAG: --feature-gates=""
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660829    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660833    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660839    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660844    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660849    2565 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660854    2565 flags.go:64] FLAG: --help="false"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660859    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-138-211.ec2.internal"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660864    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660868    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660873    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660881    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660887    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660891    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660896    2565 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660901    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660905    2565 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660910    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660915    2565 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660920    2565 flags.go:64] FLAG: --kube-reserved=""
Sep 17 00:09:58.668752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660924    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660929    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660934    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660939    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660943    2565 flags.go:64] FLAG: --lock-file=""
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660948    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660952    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660979    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660991    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.660996    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661000    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661005    2565 flags.go:64] FLAG: --logging-format="text"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661011    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661031    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661036    2565 flags.go:64] FLAG: --manifest-url=""
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661041    2565 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661047    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661052    2565 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661058    2565 flags.go:64] FLAG: --max-pods="110"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661063    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661068    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661072    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661077    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661084    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661098    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 00:09:58.669680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661103    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661114    2565 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661119    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661124    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661128    2565 flags.go:64] FLAG: --pod-cidr=""
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661133    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661142    2565 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661146    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661151    2565 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661156    2565 flags.go:64] FLAG: --port="10250"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661160    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661165    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b55852de4d542b00"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661170    2565 flags.go:64] FLAG: --qos-reserved=""
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661176    2565 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661181    2565 flags.go:64] FLAG: --register-node="true"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661187    2565 flags.go:64] FLAG: --register-with-taints=""
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661193    2565 flags.go:64] FLAG: --registry-burst="10"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661198    2565 flags.go:64] FLAG: --registry-qps="5"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661203    2565 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661208    2565 flags.go:64] FLAG: --reserved-memory=""
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661214    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661219    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661224    2565 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661229    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661233    2565 flags.go:64] FLAG: --runonce="false"
Sep 17 00:09:58.670320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661238    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661243    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661248    2565 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661253    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661257    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661263    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661269    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661274    2565 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661279    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661284    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661288    2565 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661293    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661298    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661303    2565 flags.go:64] FLAG: --system-cgroups=""
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661308    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661316    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661321    2565 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661326    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661332    2565 flags.go:64] FLAG: --tls-min-version=""
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661336    2565 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661341    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661346    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661352    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661357    2565 flags.go:64] FLAG: --v="2"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661363    2565 flags.go:64] FLAG: --version="false"
Sep 17 00:09:58.670934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661369    2565 flags.go:64] FLAG: --vmodule=""
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661374    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.661380    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661557    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661563    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661568    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661572    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661577    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661581    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661585    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661590    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661594    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661599    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661605    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661610    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661614    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661618    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661622    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661626    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661631    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:58.671577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661635    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661641    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661646    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661651    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661655    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661659    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661664    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661668    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661671    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661677    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661681    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661686    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661690    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661694    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661698    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661702    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661707    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661712    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661716    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661720    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:58.672088 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661724    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661728    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661732    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661737    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661741    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661748    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661752    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661756    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661760    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661764    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661769    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661773    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661777    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661781    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661785    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661789    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661793    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661798    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661802    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661807    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:58.672580 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661811    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661817    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661822    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661826    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661833    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661838    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661843    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661848    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661852    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661857    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661861    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661866    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661870    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661874    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661878    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661883    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661887    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661893    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661897    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:58.673130 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661902    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661908    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661914    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661919    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661924    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661928    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661932    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661937    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661941    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661945    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661949    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661954    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661958    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661962    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661968    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661972    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661977    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661981    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661986    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:58.673593 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661989    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661994    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.661998    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.662002    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.662012    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.671011    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.671125    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.671852    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.671859    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671915    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671920    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671923    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671926    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671929    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:58.674062 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671932    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671936    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671939    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671942    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671945    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671948    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671950    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671953    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671956    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671959    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671962    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671965    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671968    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671970    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671973    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671976    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671978    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671981    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671985    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671990    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:58.674408 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671993    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671996    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.671998    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672001    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672005    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672008    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672010    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672013    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672033    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672036    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672039    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672041    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672045    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672047    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672050    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672053    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672055    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672058    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672060    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672063    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:58.674894 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672065    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672068    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672071    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672074    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672076    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672079    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672081    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672084    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672088    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672092    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672095    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672098    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672101    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672104    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672107    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672110    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672112    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672115    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672118    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:58.675414 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672121    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672123    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672126    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672129    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672131    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672134    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672136    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672139    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672141    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672144    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672147    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672151    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672155    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672158    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672161    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672164    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672167    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672170    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672172    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:58.675867 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672175    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672178    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672181    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672183    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672186    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672188    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672191    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672193    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672196    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672198    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672201    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672204    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672206    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672209    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672211    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:58.676363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672214    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.672219    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672325    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672330    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672333    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672336    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672339    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672342    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672344    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672347    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672349    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672352    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672355    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672357    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672360    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:58.676725 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672363    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672365    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672368    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672371    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672373    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672376    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672378    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672381    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672384    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672387    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672389    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672392    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672395    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672397    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672400    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672403    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672406    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672409    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672411    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:58.677185 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672414    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672416    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672419    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672421    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672424    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672426    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672429    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672431    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672434    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672436    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672440    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672443    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672446    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672449    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672452    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672454    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672457    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672459    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672479    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672483    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:58.677649 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672486    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672490    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672492    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672495    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672499    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672503    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672506    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672509    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672512    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672515    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672518    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672521    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672523    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672526    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672528    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672531    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672533    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672536    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672538    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:58.678158 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672541    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672543    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672546    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672548    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672551    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672553    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672556    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672559    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672562    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672565    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672567    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672570    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672572    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672575    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672577    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672580    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672582    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672585    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672588    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672591    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:58.678664 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672594    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672596    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672599    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672601    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672604    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672606    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672610    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:09:58.672613    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.672618    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.672721    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.675073    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.675972    2565 server.go:1019] "Starting client certificate rotation"
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.676051    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 00:09:58.679191 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.676743    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 00:09:58.679512 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.678417    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 00:09:58.682599 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.682586    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 00:09:58.691431 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.691415    2565 log.go:25] "Validated CRI v1 runtime API"
Sep 17 00:09:58.694311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.694298    2565 log.go:25] "Validated CRI v1 image API"
Sep 17 00:09:58.695156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.695136    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 00:09:58.700585 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.700568    2565 fs.go:135] Filesystem UUIDs: map[27b5e32d-7dfb-4eea-9f23-37edf59d762a:/dev/nvme0n1p3 5c59b8f6-808e-4271-829a-94363559019c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 17 00:09:58.700679 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.700585    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 00:09:58.706967 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.706862    2565 manager.go:216] Machine: {Timestamp:2026-09-17 00:09:58.705799488 +0000 UTC m=+0.293323440 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100883 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2396027481cbbc21c96f6b67baf1ce SystemUUID:ec239602-7481-cbbc-21c9-6f6b67baf1ce BootID:afe64230-dceb-45cd-bdbd-7d938baf2cc3 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:db:48:9c:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:db:48:9c:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:0c:dd:06:cd:8d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 00:09:58.706967 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.706958    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 00:09:58.707108 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.707068    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 00:09:58.709346 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.709317    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 00:09:58.709469 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.709349    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-211.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 00:09:58.710584 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.710574    2565 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 00:09:58.710616 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.710588    2565 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 00:09:58.710616 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.710595    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 00:09:58.711200 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.711190    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 00:09:58.712345 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.712335    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 00:09:58.715565 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.715550    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 00:09:58.716849 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.716837    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 00:09:58.716964 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.716955    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 00:09:58.716993 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.716985    2565 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 00:09:58.717042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.716998    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 00:09:58.717042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.717032    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 00:09:58.717118 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.717045    2565 kubelet.go:398] "Adding apiserver pod source"
Sep 17 00:09:58.717118 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.717059    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 00:09:58.717416 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.717405    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 00:09:58.717449 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.717428    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 00:09:58.719138 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.719119    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 00:09:58.721455 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.721439    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 00:09:58.721538 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.721477    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 00:09:58.723997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.723983    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 00:09:58.724084 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724003    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 00:09:58.724084 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724013    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 00:09:58.724084 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724036    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 00:09:58.724084 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724048    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 00:09:58.724084 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724056    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 00:09:58.724084 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724075    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 00:09:58.724084 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724083    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 00:09:58.724304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724092    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 00:09:58.724304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724100    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 00:09:58.724304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724120    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 00:09:58.724304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724128    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 00:09:58.724855 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724837    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 00:09:58.724855 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.724854    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 00:09:58.727433 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.727411    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 00:09:58.727481 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.727428    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 00:09:58.727481 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.727423    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-211.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 00:09:58.728215 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.728203    2565 server.go:1268] "Started kubelet"
Sep 17 00:09:58.728293 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.728267    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 00:09:58.728341 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.728284    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 00:09:58.728398 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.728364    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 00:09:58.728803 ip-10-0-138-211 systemd[1]: Started Kubernetes Kubelet.
Sep 17 00:09:58.729697 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.729673    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 00:09:58.730618 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.730605    2565 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 00:09:58.733763 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.733741    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ptxkr"
Sep 17 00:09:58.735350 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.735321    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 00:09:58.736775 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.735882    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-211.ec2.internal.18d5f32c57e1f109  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-211.ec2.internal,UID:ip-10-0-138-211.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-211.ec2.internal,},FirstTimestamp:2026-09-17 00:09:58.728175881 +0000 UTC m=+0.315699832,LastTimestamp:2026-09-17 00:09:58.728175881 +0000 UTC m=+0.315699832,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-211.ec2.internal,}"
Sep 17 00:09:58.738728 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.738714    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 00:09:58.739292 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.739277    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 00:09:58.739396 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.739379    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:09:58.739919 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.739900    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 00:09:58.740079 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.740063    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 00:09:58.740121 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.740083    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 00:09:58.740166 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.740153    2565 factory.go:55] Registering systemd factory
Sep 17 00:09:58.740202 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.740174    2565 factory.go:223] Registration of the systemd container factory successfully
Sep 17 00:09:58.740258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.740246    2565 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 00:09:58.740304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.740257    2565 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 00:09:58.740432 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.740418    2565 factory.go:153] Registering CRI-O factory
Sep 17 00:09:58.740465 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.740437    2565 factory.go:223] Registration of the crio container factory successfully
Sep 17 00:09:58.740528 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.740518    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 00:09:58.740561 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.740535    2565 factory.go:103] Registering Raw factory
Sep 17 00:09:58.740561 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.740544    2565 manager.go:1196] Started watching for new ooms in manager
Sep 17 00:09:58.741320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.741305    2565 manager.go:349] Starting recovery of all containers
Sep 17 00:09:58.742229 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.742200    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 00:09:58.742229 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.742211    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 00:09:58.746922 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.746902    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ptxkr"
Sep 17 00:09:58.754167 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.754152    2565 manager.go:354] Recovery completed
Sep 17 00:09:58.758979 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.758959    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:58.760707 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.760689    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:58.760773 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.760726    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:58.760773 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.760740    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:58.761468 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.761452    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 00:09:58.761468 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.761467    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 00:09:58.761597 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.761484    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 00:09:58.761597 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.761488    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:58.762277 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.762259    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:58.762332 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.762290    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:58.762332 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.762300    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:58.763467 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.763454    2565 policy_none.go:49] "None policy: Start"
Sep 17 00:09:58.763518 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.763472    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 00:09:58.763518 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.763485    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 00:09:58.765343 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.765332    2565 policy_none.go:47] "Start"
Sep 17 00:09:58.816070 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.805621    2565 manager.go:337] "Starting Device Plugin manager"
Sep 17 00:09:58.816070 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.805658    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 00:09:58.816070 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.805670    2565 server.go:87] "Starting device plugin registration server"
Sep 17 00:09:58.816070 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.805923    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 00:09:58.816070 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.805935    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 00:09:58.816070 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.806006    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 00:09:58.816070 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.806090    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 00:09:58.816070 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.806099    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 00:09:58.816070 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.807411    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 00:09:58.816070 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.807464    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:09:58.857517 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.857492    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 00:09:58.858666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.858645    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 00:09:58.858761 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.858697    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 00:09:58.858761 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.858724    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 00:09:58.858863 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.858771    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 00:09:58.860965 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.860948    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:09:58.906841 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.906783    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:58.907533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.907518    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:58.907615 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.907567    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:58.907615 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.907585    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:58.907615 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.907610    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-211.ec2.internal"
Sep 17 00:09:58.916442 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.916419    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-211.ec2.internal"
Sep 17 00:09:58.916527 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.916452    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-211.ec2.internal\": node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:09:58.933401 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.933380    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:09:58.959481 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.959461    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-211.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal"]
Sep 17 00:09:58.959555 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.959543    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:58.960861 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.960840    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:58.960930 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.960868    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:58.960930 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.960887    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:58.963136 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.963124    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:58.963255 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.963242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:58.963295 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.963270    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:58.963780 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.963764    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:58.963840 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.963791    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:58.963840 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.963801    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:58.963840 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.963772    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:58.963934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.963858    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:58.963934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.963870    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:58.965939 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.965927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:58.965989 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.965951    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:58.966648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.966628    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:58.966710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.966657    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:58.966710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:58.966667    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:58.989563 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.989539    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-211.ec2.internal\" not found" node="ip-10-0-138-211.ec2.internal"
Sep 17 00:09:58.993689 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:58.993675    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-211.ec2.internal\" not found" node="ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.033875 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:59.033857    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:09:59.042566 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:59.042549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0bc175423b8a32cb6a5dcc25bbd2083d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-211.ec2.internal\" (UID: \"0bc175423b8a32cb6a5dcc25bbd2083d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.042637 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:59.042571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed0806145607cf8ffdc220e9b1119389-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal\" (UID: \"ed0806145607cf8ffdc220e9b1119389\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.042637 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:59.042588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed0806145607cf8ffdc220e9b1119389-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal\" (UID: \"ed0806145607cf8ffdc220e9b1119389\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.134795 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:59.134777    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:09:59.143132 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:59.143099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0bc175423b8a32cb6a5dcc25bbd2083d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-211.ec2.internal\" (UID: \"0bc175423b8a32cb6a5dcc25bbd2083d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.143198 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:59.143137    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed0806145607cf8ffdc220e9b1119389-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal\" (UID: \"ed0806145607cf8ffdc220e9b1119389\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.143198 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:59.143155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed0806145607cf8ffdc220e9b1119389-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal\" (UID: \"ed0806145607cf8ffdc220e9b1119389\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.143198 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:59.143172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0bc175423b8a32cb6a5dcc25bbd2083d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-211.ec2.internal\" (UID: \"0bc175423b8a32cb6a5dcc25bbd2083d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.143312 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:59.143200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ed0806145607cf8ffdc220e9b1119389-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal\" (UID: \"ed0806145607cf8ffdc220e9b1119389\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.143312 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:59.143199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ed0806145607cf8ffdc220e9b1119389-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal\" (UID: \"ed0806145607cf8ffdc220e9b1119389\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.235558 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:59.235502    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:09:59.293066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:59.293041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.296931 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:09:59.296913    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal"
Sep 17 00:09:59.336259 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:09:59.336231    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:10:00.497539 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:00.497519    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:10:00.598131 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:00.598074    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:10:00.698541 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:00.698519    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:10:00.737078 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:00.737053    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 00:10:00.737453 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:00.737174    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 00:10:00.799197 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:00.799175    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:10:00.816998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:00.816965    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 00:04:59 +0000 UTC" deadline="2028-04-25 21:00:57.642115236 +0000 UTC"
Sep 17 00:10:00.816998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:00.816994    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14084h50m56.825124382s"
Sep 17 00:10:00.900317 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:00.900267    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:10:00.984001 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:00.983858    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:10:01.000914 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:01.000895    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:10:01.101144 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:01.101121    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:10:01.154795 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:01.154734    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc175423b8a32cb6a5dcc25bbd2083d.slice/crio-39e1ee2b95a9c274f1753f3796057fa4d4cbf1031f349f9f35353ff70fab35f3 WatchSource:0}: Error finding container 39e1ee2b95a9c274f1753f3796057fa4d4cbf1031f349f9f35353ff70fab35f3: Status 404 returned error can't find the container with id 39e1ee2b95a9c274f1753f3796057fa4d4cbf1031f349f9f35353ff70fab35f3
Sep 17 00:10:01.154965 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:01.154947    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0806145607cf8ffdc220e9b1119389.slice/crio-fe6044c72ae441ed42764faa9934f1d132bb3a82489436890d32d3cfaa126de4 WatchSource:0}: Error finding container fe6044c72ae441ed42764faa9934f1d132bb3a82489436890d32d3cfaa126de4: Status 404 returned error can't find the container with id fe6044c72ae441ed42764faa9934f1d132bb3a82489436890d32d3cfaa126de4
Sep 17 00:10:01.163345 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.163330    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:10:01.201741 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:01.201718    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-211.ec2.internal\" not found"
Sep 17 00:10:01.290451 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.290431    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:10:01.301322 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.301298    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-211.ec2.internal"
Sep 17 00:10:01.310263 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.310242    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 00:10:01.311387 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.311373    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal"
Sep 17 00:10:01.320175 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.320156    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 00:10:01.338614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.338596    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:10:01.779027 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.779004    2565 apiserver.go:52] "Watching apiserver"
Sep 17 00:10:01.787198 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.787179    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 00:10:01.787612 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.787579    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-d4c9q","openshift-multus/multus-nsp6k","kube-system/global-pull-secret-syncer-kjjvd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c","openshift-image-registry/node-ca-whcmk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal","openshift-multus/network-metrics-daemon-w28gk","openshift-network-diagnostics/network-check-target-dctfb","openshift-network-operator/iptables-alerter-8k8fb","openshift-ovn-kubernetes/ovnkube-node-6ljnh","kube-system/konnectivity-agent-fjln9","kube-system/kube-apiserver-proxy-ip-10-0-138-211.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5gjhc","openshift-dns/node-resolver-m5sg5"]
Sep 17 00:10:01.790153 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.790128    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.792394 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.792364    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:01.793203 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.792906    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 00:10:01.793203 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.792937    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 00:10:01.793203 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.792970    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kk6np\""
Sep 17 00:10:01.793203 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.793028    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 00:10:01.793203 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.793055    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 00:10:01.793203 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.793169    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 00:10:01.794626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.794608    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 00:10:01.794766 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.794736    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:01.794885 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:01.794832    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:01.794973 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.794898    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 00:10:01.794973 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.794900    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hvbsm\""
Sep 17 00:10:01.797071 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.797043    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.799381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.799164    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 00:10:01.799381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.799259    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 00:10:01.799529 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.799507    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 00:10:01.799624 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.799574    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9c6pv\""
Sep 17 00:10:01.799774 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.799740    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-whcmk"
Sep 17 00:10:01.800694 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.800671    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 00:10:01.801655 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.801637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:01.801791 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:01.801707    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:01.802414 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.802391    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 00:10:01.802754 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.802666    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fzlgm\""
Sep 17 00:10:01.803320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.802664    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 00:10:01.803320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.803257    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 00:10:01.805100 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.805082    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:01.805311 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:01.805285    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:01.808469 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.808001    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8k8fb"
Sep 17 00:10:01.810535 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.810517    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 00:10:01.810628 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.810567    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.811001 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.810981    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 00:10:01.811163 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.811142    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j4phn\""
Sep 17 00:10:01.811402 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.811386    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:10:01.813011 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.812992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.813368 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.813343    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 00:10:01.813818 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.813781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:01.813918 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.813825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-etc-selinux\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.813918 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.813860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-sys-fs\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.813918 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.813904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqqmk\" (UniqueName: \"kubernetes.io/projected/37dbbfd8-ffbf-4601-b41b-b23df76d380f-kube-api-access-tqqmk\") pod \"node-ca-whcmk\" (UID: \"37dbbfd8-ffbf-4601-b41b-b23df76d380f\") " pod="openshift-image-registry/node-ca-whcmk"
Sep 17 00:10:01.814073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.813933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/345076c3-2bd1-4142-ae90-0fd15c7242f9-dbus\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:01.814073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.813959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.814073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.813976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.814073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.813990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-socket-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.814073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-system-cni-dir\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.814073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.814073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bef72613-f5cb-4857-8549-33e3692289b2-agent-certs\") pod \"konnectivity-agent-fjln9\" (UID: \"bef72613-f5cb-4857-8549-33e3692289b2\") " pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:01.814073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-registration-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.814073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814060    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 00:10:01.814380 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814249    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 00:10:01.814380 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814269    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 00:10:01.814380 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814284    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nnvdv\""
Sep 17 00:10:01.814380 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvxnx\" (UniqueName: \"kubernetes.io/projected/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-kube-api-access-rvxnx\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.814508 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814387    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 00:10:01.814508 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37dbbfd8-ffbf-4601-b41b-b23df76d380f-host\") pod \"node-ca-whcmk\" (UID: \"37dbbfd8-ffbf-4601-b41b-b23df76d380f\") " pod="openshift-image-registry/node-ca-whcmk"
Sep 17 00:10:01.814508 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814431    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37dbbfd8-ffbf-4601-b41b-b23df76d380f-serviceca\") pod \"node-ca-whcmk\" (UID: \"37dbbfd8-ffbf-4601-b41b-b23df76d380f\") " pod="openshift-image-registry/node-ca-whcmk"
Sep 17 00:10:01.814508 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814452    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 00:10:01.814508 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/345076c3-2bd1-4142-ae90-0fd15c7242f9-kubelet-config\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:01.814508 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:01.814693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.814693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksh5c\" (UniqueName: \"kubernetes.io/projected/fa2489c7-1864-4abe-bc0f-4bfea881a246-kube-api-access-ksh5c\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:01.814693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-device-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.814693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-cnibin\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.814693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814614    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.814693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814621    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 00:10:01.814693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf9pd\" (UniqueName: \"kubernetes.io/projected/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-kube-api-access-tf9pd\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.814693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.814644    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bef72613-f5cb-4857-8549-33e3692289b2-konnectivity-ca\") pod \"konnectivity-agent-fjln9\" (UID: \"bef72613-f5cb-4857-8549-33e3692289b2\") " pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:01.815328 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.815306    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4vvkc\""
Sep 17 00:10:01.815422 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.815406    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 00:10:01.815640 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.815626    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.817866 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.817842    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:10:01.818082 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.817995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m5sg5"
Sep 17 00:10:01.818082 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.818025    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-smh58\""
Sep 17 00:10:01.818263 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.818096    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 00:10:01.820337 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.820300    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vxflv\""
Sep 17 00:10:01.820439 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.820338    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 00:10:01.820439 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.820360    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 00:10:01.833135 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.833109    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ppfhl"
Sep 17 00:10:01.835351 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.835333    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:10:01.840297 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.840276    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ppfhl"
Sep 17 00:10:01.902067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.902045    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 00:10:01.915210 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915182    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63dc5909-1a82-42ae-bd7d-e3be851bde86-cni-binary-copy\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.915305 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-hostroot\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.915305 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-etc-kubernetes\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.915305 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szbpn\" (UniqueName: \"kubernetes.io/projected/99ef898a-6b18-4def-851a-defedc9752f0-kube-api-access-szbpn\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.915448 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:01.915448 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-log-socket\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.915448 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915367    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-socket-dir-parent\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.915448 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99ef898a-6b18-4def-851a-defedc9752f0-tmp\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.915631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56bd23f3-6be8-4b22-ad3c-ba0156a5f08e-tmp-dir\") pod \"node-resolver-m5sg5\" (UID: \"56bd23f3-6be8-4b22-ad3c-ba0156a5f08e\") " pod="openshift-dns/node-resolver-m5sg5"
Sep 17 00:10:01.915631 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:01.915469    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:01.915631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-systemd-units\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.915631 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:01.915529    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs podName:fa2489c7-1864-4abe-bc0f-4bfea881a246 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:02.41550782 +0000 UTC m=+2.942247302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs") pod "network-metrics-daemon-w28gk" (UID: "fa2489c7-1864-4abe-bc0f-4bfea881a246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:01.915631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcsgh\" (UniqueName: \"kubernetes.io/projected/63dc5909-1a82-42ae-bd7d-e3be851bde86-kube-api-access-bcsgh\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.915631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-sysctl-conf\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.915631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-run\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.915631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-lib-modules\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-host\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-registration-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvxnx\" (UniqueName: \"kubernetes.io/projected/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-kube-api-access-rvxnx\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37dbbfd8-ffbf-4601-b41b-b23df76d380f-host\") pod \"node-ca-whcmk\" (UID: \"37dbbfd8-ffbf-4601-b41b-b23df76d380f\") " pod="openshift-image-registry/node-ca-whcmk"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915738    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-registration-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/37dbbfd8-ffbf-4601-b41b-b23df76d380f-host\") pod \"node-ca-whcmk\" (UID: \"37dbbfd8-ffbf-4601-b41b-b23df76d380f\") " pod="openshift-image-registry/node-ca-whcmk"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37dbbfd8-ffbf-4601-b41b-b23df76d380f-serviceca\") pod \"node-ca-whcmk\" (UID: \"37dbbfd8-ffbf-4601-b41b-b23df76d380f\") " pod="openshift-image-registry/node-ca-whcmk"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-kubelet\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-cni-bin\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13c90c3a-8f98-4f15-9341-01ac50730012-ovn-node-metrics-cert\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksh5c\" (UniqueName: \"kubernetes.io/projected/fa2489c7-1864-4abe-bc0f-4bfea881a246-kube-api-access-ksh5c\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.915994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf9pd\" (UniqueName: \"kubernetes.io/projected/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-kube-api-access-tf9pd\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13c90c3a-8f98-4f15-9341-01ac50730012-ovnkube-script-lib\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fncjj\" (UniqueName: \"kubernetes.io/projected/13c90c3a-8f98-4f15-9341-01ac50730012-kube-api-access-fncjj\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-cni-dir\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.916044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-run-multus-certs\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916073    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-sys-fs\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqqmk\" (UniqueName: \"kubernetes.io/projected/37dbbfd8-ffbf-4601-b41b-b23df76d380f-kube-api-access-tqqmk\") pod \"node-ca-whcmk\" (UID: \"37dbbfd8-ffbf-4601-b41b-b23df76d380f\") " pod="openshift-image-registry/node-ca-whcmk"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28411be7-9487-4a51-8a36-900ad3555d09-iptables-alerter-script\") pod \"iptables-alerter-8k8fb\" (UID: \"28411be7-9487-4a51-8a36-900ad3555d09\") " pod="openshift-network-operator/iptables-alerter-8k8fb"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13c90c3a-8f98-4f15-9341-01ac50730012-ovnkube-config\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916128    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56bd23f3-6be8-4b22-ad3c-ba0156a5f08e-hosts-file\") pod \"node-resolver-m5sg5\" (UID: \"56bd23f3-6be8-4b22-ad3c-ba0156a5f08e\") " pod="openshift-dns/node-resolver-m5sg5"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-system-cni-dir\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-conf-dir\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-sysconfig\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/345076c3-2bd1-4142-ae90-0fd15c7242f9-kubelet-config\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-run-ovn\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13c90c3a-8f98-4f15-9341-01ac50730012-env-overrides\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-systemd\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916378    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/37dbbfd8-ffbf-4601-b41b-b23df76d380f-serviceca\") pod \"node-ca-whcmk\" (UID: \"37dbbfd8-ffbf-4601-b41b-b23df76d380f\") " pod="openshift-image-registry/node-ca-whcmk"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916386    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/345076c3-2bd1-4142-ae90-0fd15c7242f9-kubelet-config\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:01.916614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916377    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-sys-fs\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-system-cni-dir\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916414    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-sys\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-run-systemd\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-var-lib-cni-bin\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916544    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-var-lib-kubelet\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-etc-selinux\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/345076c3-2bd1-4142-ae90-0fd15c7242f9-dbus\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-slash\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916634    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-cni-netd\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-run-netns\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-var-lib-kubelet\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-etc-selinux\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916727    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-kubernetes\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thqqt\" (UniqueName: \"kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt\") pod \"network-check-target-dctfb\" (UID: \"a5159d33-9894-4022-9611-cf85fa5b4c56\") " pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:01.917433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/345076c3-2bd1-4142-ae90-0fd15c7242f9-dbus\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-system-cni-dir\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-cnibin\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916874    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99ef898a-6b18-4def-851a-defedc9752f0-etc-tuned\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28411be7-9487-4a51-8a36-900ad3555d09-host-slash\") pod \"iptables-alerter-8k8fb\" (UID: \"28411be7-9487-4a51-8a36-900ad3555d09\") " pod="openshift-network-operator/iptables-alerter-8k8fb"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916901    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-var-lib-openvswitch\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-run-openvswitch\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-run-k8s-cni-cncf-io\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.916976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-daemon-config\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-sysctl-d\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-device-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-cnibin\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-device-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bef72613-f5cb-4857-8549-33e3692289b2-konnectivity-ca\") pod \"konnectivity-agent-fjln9\" (UID: \"bef72613-f5cb-4857-8549-33e3692289b2\") " pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917150    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-cnibin\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.918130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-run-netns\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917180    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-node-log\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-modprobe-d\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917328    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bef72613-f5cb-4857-8549-33e3692289b2-agent-certs\") pod \"konnectivity-agent-fjln9\" (UID: \"bef72613-f5cb-4857-8549-33e3692289b2\") " pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-var-lib-cni-multus\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-socket-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcpn5\" (UniqueName: \"kubernetes.io/projected/28411be7-9487-4a51-8a36-900ad3555d09-kube-api-access-dcpn5\") pod \"iptables-alerter-8k8fb\" (UID: \"28411be7-9487-4a51-8a36-900ad3555d09\") " pod="openshift-network-operator/iptables-alerter-8k8fb"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917448    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-etc-openvswitch\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-run-ovn-kubernetes\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:01.917541    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8b22\" (UniqueName: \"kubernetes.io/projected/56bd23f3-6be8-4b22-ad3c-ba0156a5f08e-kube-api-access-w8b22\") pod \"node-resolver-m5sg5\" (UID: \"56bd23f3-6be8-4b22-ad3c-ba0156a5f08e\") " pod="openshift-dns/node-resolver-m5sg5"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:01.917582    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret podName:345076c3-2bd1-4142-ae90-0fd15c7242f9 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:02.41756823 +0000 UTC m=+2.944307703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret") pod "global-pull-secret-syncer-kjjvd" (UID: "345076c3-2bd1-4142-ae90-0fd15c7242f9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917536    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-cni-binary-copy\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.918737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-socket-dir\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.919331 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917673    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bef72613-f5cb-4857-8549-33e3692289b2-konnectivity-ca\") pod \"konnectivity-agent-fjln9\" (UID: \"bef72613-f5cb-4857-8549-33e3692289b2\") " pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:01.919331 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917751    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 00:10:01.919331 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.917795    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.921826 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.921789    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bef72613-f5cb-4857-8549-33e3692289b2-agent-certs\") pod \"konnectivity-agent-fjln9\" (UID: \"bef72613-f5cb-4857-8549-33e3692289b2\") " pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:01.924185 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.924146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-211.ec2.internal" event={"ID":"0bc175423b8a32cb6a5dcc25bbd2083d","Type":"ContainerStarted","Data":"39e1ee2b95a9c274f1753f3796057fa4d4cbf1031f349f9f35353ff70fab35f3"}
Sep 17 00:10:01.924274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.924226    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvxnx\" (UniqueName: \"kubernetes.io/projected/16b783ee-8f6b-4d75-9ebd-e83aa0e66fba-kube-api-access-rvxnx\") pod \"aws-ebs-csi-driver-node-2zz5c\" (UID: \"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:01.924516 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.924495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksh5c\" (UniqueName: \"kubernetes.io/projected/fa2489c7-1864-4abe-bc0f-4bfea881a246-kube-api-access-ksh5c\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:01.924516 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.924509    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqqmk\" (UniqueName: \"kubernetes.io/projected/37dbbfd8-ffbf-4601-b41b-b23df76d380f-kube-api-access-tqqmk\") pod \"node-ca-whcmk\" (UID: \"37dbbfd8-ffbf-4601-b41b-b23df76d380f\") " pod="openshift-image-registry/node-ca-whcmk"
Sep 17 00:10:01.924628 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.924587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf9pd\" (UniqueName: \"kubernetes.io/projected/9d5fad81-0837-4f67-85fd-c65c5d5a01bc-kube-api-access-tf9pd\") pod \"multus-additional-cni-plugins-d4c9q\" (UID: \"9d5fad81-0837-4f67-85fd-c65c5d5a01bc\") " pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:01.925707 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:01.925683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal" event={"ID":"ed0806145607cf8ffdc220e9b1119389","Type":"ContainerStarted","Data":"fe6044c72ae441ed42764faa9934f1d132bb3a82489436890d32d3cfaa126de4"}
Sep 17 00:10:02.018434 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8b22\" (UniqueName: \"kubernetes.io/projected/56bd23f3-6be8-4b22-ad3c-ba0156a5f08e-kube-api-access-w8b22\") pod \"node-resolver-m5sg5\" (UID: \"56bd23f3-6be8-4b22-ad3c-ba0156a5f08e\") " pod="openshift-dns/node-resolver-m5sg5"
Sep 17 00:10:02.018434 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63dc5909-1a82-42ae-bd7d-e3be851bde86-cni-binary-copy\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.018575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-hostroot\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.018575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-etc-kubernetes\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.018575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018481    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szbpn\" (UniqueName: \"kubernetes.io/projected/99ef898a-6b18-4def-851a-defedc9752f0-kube-api-access-szbpn\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.018575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-log-socket\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.018575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-hostroot\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.018575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-log-socket\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018567    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-etc-kubernetes\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-socket-dir-parent\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99ef898a-6b18-4def-851a-defedc9752f0-tmp\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-socket-dir-parent\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56bd23f3-6be8-4b22-ad3c-ba0156a5f08e-tmp-dir\") pod \"node-resolver-m5sg5\" (UID: \"56bd23f3-6be8-4b22-ad3c-ba0156a5f08e\") " pod="openshift-dns/node-resolver-m5sg5"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-systemd-units\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcsgh\" (UniqueName: \"kubernetes.io/projected/63dc5909-1a82-42ae-bd7d-e3be851bde86-kube-api-access-bcsgh\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-sysctl-conf\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-run\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-systemd-units\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-lib-modules\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-host\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-kubelet\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-cni-bin\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018885    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-run\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-sysctl-conf\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13c90c3a-8f98-4f15-9341-01ac50730012-ovn-node-metrics-cert\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.018957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018942    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13c90c3a-8f98-4f15-9341-01ac50730012-ovnkube-script-lib\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018947    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-host\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56bd23f3-6be8-4b22-ad3c-ba0156a5f08e-tmp-dir\") pod \"node-resolver-m5sg5\" (UID: \"56bd23f3-6be8-4b22-ad3c-ba0156a5f08e\") " pod="openshift-dns/node-resolver-m5sg5"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fncjj\" (UniqueName: \"kubernetes.io/projected/13c90c3a-8f98-4f15-9341-01ac50730012-kube-api-access-fncjj\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018978    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/63dc5909-1a82-42ae-bd7d-e3be851bde86-cni-binary-copy\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.018991    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-kubelet\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-cni-dir\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-run-multus-certs\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019041    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-cni-bin\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28411be7-9487-4a51-8a36-900ad3555d09-iptables-alerter-script\") pod \"iptables-alerter-8k8fb\" (UID: \"28411be7-9487-4a51-8a36-900ad3555d09\") " pod="openshift-network-operator/iptables-alerter-8k8fb"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019061    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-lib-modules\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-cni-dir\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13c90c3a-8f98-4f15-9341-01ac50730012-ovnkube-config\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019084    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-run-multus-certs\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019103    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56bd23f3-6be8-4b22-ad3c-ba0156a5f08e-hosts-file\") pod \"node-resolver-m5sg5\" (UID: \"56bd23f3-6be8-4b22-ad3c-ba0156a5f08e\") " pod="openshift-dns/node-resolver-m5sg5"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-conf-dir\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-sysconfig\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-run-ovn\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.019845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13c90c3a-8f98-4f15-9341-01ac50730012-env-overrides\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-systemd\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-conf-dir\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-sys\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56bd23f3-6be8-4b22-ad3c-ba0156a5f08e-hosts-file\") pod \"node-resolver-m5sg5\" (UID: \"56bd23f3-6be8-4b22-ad3c-ba0156a5f08e\") " pod="openshift-dns/node-resolver-m5sg5"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-sys\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-run-systemd\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-var-lib-cni-bin\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019394    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-sysconfig\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-var-lib-kubelet\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-slash\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-cni-netd\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019485    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-run-netns\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019508    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-systemd\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019512    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-var-lib-kubelet\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-kubernetes\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13c90c3a-8f98-4f15-9341-01ac50730012-ovnkube-config\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-run-systemd\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.020714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13c90c3a-8f98-4f15-9341-01ac50730012-ovnkube-script-lib\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019562    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thqqt\" (UniqueName: \"kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt\") pod \"network-check-target-dctfb\" (UID: \"a5159d33-9894-4022-9611-cf85fa5b4c56\") " pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-run-netns\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-system-cni-dir\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-var-lib-kubelet\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-cnibin\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-var-lib-kubelet\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99ef898a-6b18-4def-851a-defedc9752f0-etc-tuned\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-var-lib-cni-bin\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28411be7-9487-4a51-8a36-900ad3555d09-host-slash\") pod \"iptables-alerter-8k8fb\" (UID: \"28411be7-9487-4a51-8a36-900ad3555d09\") " pod="openshift-network-operator/iptables-alerter-8k8fb"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019604    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/28411be7-9487-4a51-8a36-900ad3555d09-iptables-alerter-script\") pod \"iptables-alerter-8k8fb\" (UID: \"28411be7-9487-4a51-8a36-900ad3555d09\") " pod="openshift-network-operator/iptables-alerter-8k8fb"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019685    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-system-cni-dir\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-slash\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-var-lib-openvswitch\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-cnibin\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-run-openvswitch\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019767    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/28411be7-9487-4a51-8a36-900ad3555d09-host-slash\") pod \"iptables-alerter-8k8fb\" (UID: \"28411be7-9487-4a51-8a36-900ad3555d09\") " pod="openshift-network-operator/iptables-alerter-8k8fb"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019438    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-run-ovn\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-run-openvswitch\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-run-k8s-cni-cncf-io\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-run-k8s-cni-cncf-io\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13c90c3a-8f98-4f15-9341-01ac50730012-env-overrides\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019863    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-daemon-config\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-cni-netd\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-sysctl-d\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019977    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-sysctl-d\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.019980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-run-netns\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020005    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-run-netns\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-node-log\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-node-log\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-kubernetes\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020075    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-modprobe-d\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020101    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-var-lib-openvswitch\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-var-lib-cni-multus\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.021944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020074    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.022425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcpn5\" (UniqueName: \"kubernetes.io/projected/28411be7-9487-4a51-8a36-900ad3555d09-kube-api-access-dcpn5\") pod \"iptables-alerter-8k8fb\" (UID: \"28411be7-9487-4a51-8a36-900ad3555d09\") " pod="openshift-network-operator/iptables-alerter-8k8fb"
Sep 17 00:10:02.022425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-etc-openvswitch\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.022425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99ef898a-6b18-4def-851a-defedc9752f0-etc-modprobe-d\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.022425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020184    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/63dc5909-1a82-42ae-bd7d-e3be851bde86-host-var-lib-cni-multus\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.022425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-run-ovn-kubernetes\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.022425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-host-run-ovn-kubernetes\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.022425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/63dc5909-1a82-42ae-bd7d-e3be851bde86-multus-daemon-config\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.022425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.020252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13c90c3a-8f98-4f15-9341-01ac50730012-etc-openvswitch\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.022425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.021065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13c90c3a-8f98-4f15-9341-01ac50730012-ovn-node-metrics-cert\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.022425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.021085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99ef898a-6b18-4def-851a-defedc9752f0-tmp\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.022425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.022059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99ef898a-6b18-4def-851a-defedc9752f0-etc-tuned\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.024665 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.024650    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:02.024716 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.024668    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:02.024716 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.024678    2565 projected.go:196] Error preparing data for projected volume kube-api-access-thqqt for pod openshift-network-diagnostics/network-check-target-dctfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:02.024778 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.024720    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt podName:a5159d33-9894-4022-9611-cf85fa5b4c56 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:02.524708271 +0000 UTC m=+3.051447738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-thqqt" (UniqueName: "kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt") pod "network-check-target-dctfb" (UID: "a5159d33-9894-4022-9611-cf85fa5b4c56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:02.026992 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.026963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fncjj\" (UniqueName: \"kubernetes.io/projected/13c90c3a-8f98-4f15-9341-01ac50730012-kube-api-access-fncjj\") pod \"ovnkube-node-6ljnh\" (UID: \"13c90c3a-8f98-4f15-9341-01ac50730012\") " pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.027113 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.027096    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szbpn\" (UniqueName: \"kubernetes.io/projected/99ef898a-6b18-4def-851a-defedc9752f0-kube-api-access-szbpn\") pod \"tuned-5gjhc\" (UID: \"99ef898a-6b18-4def-851a-defedc9752f0\") " pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.027260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.027237    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcsgh\" (UniqueName: \"kubernetes.io/projected/63dc5909-1a82-42ae-bd7d-e3be851bde86-kube-api-access-bcsgh\") pod \"multus-nsp6k\" (UID: \"63dc5909-1a82-42ae-bd7d-e3be851bde86\") " pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.027504 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.027485    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8b22\" (UniqueName: \"kubernetes.io/projected/56bd23f3-6be8-4b22-ad3c-ba0156a5f08e-kube-api-access-w8b22\") pod \"node-resolver-m5sg5\" (UID: \"56bd23f3-6be8-4b22-ad3c-ba0156a5f08e\") " pod="openshift-dns/node-resolver-m5sg5"
Sep 17 00:10:02.027693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.027675    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcpn5\" (UniqueName: \"kubernetes.io/projected/28411be7-9487-4a51-8a36-900ad3555d09-kube-api-access-dcpn5\") pod \"iptables-alerter-8k8fb\" (UID: \"28411be7-9487-4a51-8a36-900ad3555d09\") " pod="openshift-network-operator/iptables-alerter-8k8fb"
Sep 17 00:10:02.104031 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.103969    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d4c9q"
Sep 17 00:10:02.110346 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.110328    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:02.114067 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:02.114047    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5fad81_0837_4f67_85fd_c65c5d5a01bc.slice/crio-a4d6121cf8ca1934553807b5e34a3cb57af4f3ef0ffd8cb616e1002606a945f7 WatchSource:0}: Error finding container a4d6121cf8ca1934553807b5e34a3cb57af4f3ef0ffd8cb616e1002606a945f7: Status 404 returned error can't find the container with id a4d6121cf8ca1934553807b5e34a3cb57af4f3ef0ffd8cb616e1002606a945f7
Sep 17 00:10:02.118109 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:02.118086    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef72613_f5cb_4857_8549_33e3692289b2.slice/crio-7d36b64fe5a371b599c02b633a6366ccd35eeb0a5692922b95dd0f7ca6d61a8d WatchSource:0}: Error finding container 7d36b64fe5a371b599c02b633a6366ccd35eeb0a5692922b95dd0f7ca6d61a8d: Status 404 returned error can't find the container with id 7d36b64fe5a371b599c02b633a6366ccd35eeb0a5692922b95dd0f7ca6d61a8d
Sep 17 00:10:02.118648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.118633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c"
Sep 17 00:10:02.124263 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.124247    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-whcmk"
Sep 17 00:10:02.127122 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:02.127102    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b783ee_8f6b_4d75_9ebd_e83aa0e66fba.slice/crio-9a4bf246831edf0a21906b1814261e3e424074a7fe48354be773004a05f2f5fd WatchSource:0}: Error finding container 9a4bf246831edf0a21906b1814261e3e424074a7fe48354be773004a05f2f5fd: Status 404 returned error can't find the container with id 9a4bf246831edf0a21906b1814261e3e424074a7fe48354be773004a05f2f5fd
Sep 17 00:10:02.131587 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.131570    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8k8fb"
Sep 17 00:10:02.132064 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:02.132045    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37dbbfd8_ffbf_4601_b41b_b23df76d380f.slice/crio-4e5a7bdc48fa1fa6bcfd6dca013e94cabab7bad41e61b08371c5f5ace647238f WatchSource:0}: Error finding container 4e5a7bdc48fa1fa6bcfd6dca013e94cabab7bad41e61b08371c5f5ace647238f: Status 404 returned error can't find the container with id 4e5a7bdc48fa1fa6bcfd6dca013e94cabab7bad41e61b08371c5f5ace647238f
Sep 17 00:10:02.138648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.138631    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:02.140993 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:02.140975    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28411be7_9487_4a51_8a36_900ad3555d09.slice/crio-c6f5c0307626d87319cfa83f66558fcde4bfc796e7b9e50285a383236cad2f71 WatchSource:0}: Error finding container c6f5c0307626d87319cfa83f66558fcde4bfc796e7b9e50285a383236cad2f71: Status 404 returned error can't find the container with id c6f5c0307626d87319cfa83f66558fcde4bfc796e7b9e50285a383236cad2f71
Sep 17 00:10:02.144818 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.144787    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nsp6k"
Sep 17 00:10:02.146095 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:02.146077    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c90c3a_8f98_4f15_9341_01ac50730012.slice/crio-de3e220443754da7dca03bfc735ed510c68fbabc6275497150b58f0a503106a7 WatchSource:0}: Error finding container de3e220443754da7dca03bfc735ed510c68fbabc6275497150b58f0a503106a7: Status 404 returned error can't find the container with id de3e220443754da7dca03bfc735ed510c68fbabc6275497150b58f0a503106a7
Sep 17 00:10:02.151069 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.151052    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5gjhc"
Sep 17 00:10:02.152605 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:02.152587    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63dc5909_1a82_42ae_bd7d_e3be851bde86.slice/crio-a768391f6d5669dc5e67190a4a086509841a526d7f3a4c507f86613d35661265 WatchSource:0}: Error finding container a768391f6d5669dc5e67190a4a086509841a526d7f3a4c507f86613d35661265: Status 404 returned error can't find the container with id a768391f6d5669dc5e67190a4a086509841a526d7f3a4c507f86613d35661265
Sep 17 00:10:02.157717 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.157691    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m5sg5"
Sep 17 00:10:02.159526 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:02.159507    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ef898a_6b18_4def_851a_defedc9752f0.slice/crio-7d616b9318c936630a8e2d81e10afcc365c6c363a4a2fa363c260e0d999d8e8b WatchSource:0}: Error finding container 7d616b9318c936630a8e2d81e10afcc365c6c363a4a2fa363c260e0d999d8e8b: Status 404 returned error can't find the container with id 7d616b9318c936630a8e2d81e10afcc365c6c363a4a2fa363c260e0d999d8e8b
Sep 17 00:10:02.169924 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:02.169903    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56bd23f3_6be8_4b22_ad3c_ba0156a5f08e.slice/crio-9199bd055ac6d90c4764467f3e3d4ee8d474d491ed52c829ad5b686e3b5bb99f WatchSource:0}: Error finding container 9199bd055ac6d90c4764467f3e3d4ee8d474d491ed52c829ad5b686e3b5bb99f: Status 404 returned error can't find the container with id 9199bd055ac6d90c4764467f3e3d4ee8d474d491ed52c829ad5b686e3b5bb99f
Sep 17 00:10:02.423431 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.423360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:02.423431 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.423410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:02.423620 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.423558    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:02.423620 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.423616    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs podName:fa2489c7-1864-4abe-bc0f-4bfea881a246 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:03.423599276 +0000 UTC m=+3.950338735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs") pod "network-metrics-daemon-w28gk" (UID: "fa2489c7-1864-4abe-bc0f-4bfea881a246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:02.423735 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.423618    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:02.423735 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.423676    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret podName:345076c3-2bd1-4142-ae90-0fd15c7242f9 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:03.423659641 +0000 UTC m=+3.950399100 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret") pod "global-pull-secret-syncer-kjjvd" (UID: "345076c3-2bd1-4142-ae90-0fd15c7242f9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:02.624447 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.624414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thqqt\" (UniqueName: \"kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt\") pod \"network-check-target-dctfb\" (UID: \"a5159d33-9894-4022-9611-cf85fa5b4c56\") " pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:02.624621 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.624593    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:02.624621 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.624608    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:02.624621 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.624617    2565 projected.go:196] Error preparing data for projected volume kube-api-access-thqqt for pod openshift-network-diagnostics/network-check-target-dctfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:02.624770 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.624663    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt podName:a5159d33-9894-4022-9611-cf85fa5b4c56 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:03.624650366 +0000 UTC m=+4.151389822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-thqqt" (UniqueName: "kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt") pod "network-check-target-dctfb" (UID: "a5159d33-9894-4022-9611-cf85fa5b4c56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:02.844704 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.844614    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 00:05:01 +0000 UTC" deadline="2028-07-04 22:33:55.11947878 +0000 UTC"
Sep 17 00:10:02.844704 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.844658    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15766h23m52.274823923s"
Sep 17 00:10:02.920480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.920444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:02.920618 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:02.920571    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:02.936988 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.936914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjln9" event={"ID":"bef72613-f5cb-4857-8549-33e3692289b2","Type":"ContainerStarted","Data":"7d36b64fe5a371b599c02b633a6366ccd35eeb0a5692922b95dd0f7ca6d61a8d"}
Sep 17 00:10:02.945971 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.945942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5gjhc" event={"ID":"99ef898a-6b18-4def-851a-defedc9752f0","Type":"ContainerStarted","Data":"7d616b9318c936630a8e2d81e10afcc365c6c363a4a2fa363c260e0d999d8e8b"}
Sep 17 00:10:02.948689 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.948660    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nsp6k" event={"ID":"63dc5909-1a82-42ae-bd7d-e3be851bde86","Type":"ContainerStarted","Data":"a768391f6d5669dc5e67190a4a086509841a526d7f3a4c507f86613d35661265"}
Sep 17 00:10:02.952187 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.952160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh" event={"ID":"13c90c3a-8f98-4f15-9341-01ac50730012","Type":"ContainerStarted","Data":"de3e220443754da7dca03bfc735ed510c68fbabc6275497150b58f0a503106a7"}
Sep 17 00:10:02.953679 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.953651    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-whcmk" event={"ID":"37dbbfd8-ffbf-4601-b41b-b23df76d380f","Type":"ContainerStarted","Data":"4e5a7bdc48fa1fa6bcfd6dca013e94cabab7bad41e61b08371c5f5ace647238f"}
Sep 17 00:10:02.956123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.956052    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4c9q" event={"ID":"9d5fad81-0837-4f67-85fd-c65c5d5a01bc","Type":"ContainerStarted","Data":"a4d6121cf8ca1934553807b5e34a3cb57af4f3ef0ffd8cb616e1002606a945f7"}
Sep 17 00:10:02.959963 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.959910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m5sg5" event={"ID":"56bd23f3-6be8-4b22-ad3c-ba0156a5f08e","Type":"ContainerStarted","Data":"9199bd055ac6d90c4764467f3e3d4ee8d474d491ed52c829ad5b686e3b5bb99f"}
Sep 17 00:10:02.965453 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.965429    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8k8fb" event={"ID":"28411be7-9487-4a51-8a36-900ad3555d09","Type":"ContainerStarted","Data":"c6f5c0307626d87319cfa83f66558fcde4bfc796e7b9e50285a383236cad2f71"}
Sep 17 00:10:02.971659 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:02.971632    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c" event={"ID":"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba","Type":"ContainerStarted","Data":"9a4bf246831edf0a21906b1814261e3e424074a7fe48354be773004a05f2f5fd"}
Sep 17 00:10:03.437066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:03.436987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:03.437066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:03.437038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:03.437253 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:03.437182    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:03.437253 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:03.437243    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs podName:fa2489c7-1864-4abe-bc0f-4bfea881a246 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:05.437223799 +0000 UTC m=+5.963963255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs") pod "network-metrics-daemon-w28gk" (UID: "fa2489c7-1864-4abe-bc0f-4bfea881a246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:03.437765 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:03.437634    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:03.437765 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:03.437689    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret podName:345076c3-2bd1-4142-ae90-0fd15c7242f9 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:05.437673526 +0000 UTC m=+5.964412986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret") pod "global-pull-secret-syncer-kjjvd" (UID: "345076c3-2bd1-4142-ae90-0fd15c7242f9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:03.639110 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:03.639074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thqqt\" (UniqueName: \"kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt\") pod \"network-check-target-dctfb\" (UID: \"a5159d33-9894-4022-9611-cf85fa5b4c56\") " pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:03.639281 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:03.639252    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:03.639281 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:03.639280    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:03.639403 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:03.639294    2565 projected.go:196] Error preparing data for projected volume kube-api-access-thqqt for pod openshift-network-diagnostics/network-check-target-dctfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:03.639403 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:03.639362    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt podName:a5159d33-9894-4022-9611-cf85fa5b4c56 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:05.639343165 +0000 UTC m=+6.166082635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-thqqt" (UniqueName: "kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt") pod "network-check-target-dctfb" (UID: "a5159d33-9894-4022-9611-cf85fa5b4c56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:03.845633 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:03.845550    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 00:05:01 +0000 UTC" deadline="2028-02-26 08:29:39.364684294 +0000 UTC"
Sep 17 00:10:03.845633 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:03.845587    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12656h19m35.519100981s"
Sep 17 00:10:03.920627 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:03.920599    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:03.920762 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:03.920735    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:03.921859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:03.921157    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:03.921859 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:03.921259    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:03.983960 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:03.983924    2565 generic.go:356] "Generic (PLEG): container finished" podID="ed0806145607cf8ffdc220e9b1119389" containerID="04231137347e2f07c9947a086e6d4e2291ae9e5995f00a38be421be236603b57" exitCode=0
Sep 17 00:10:03.984118 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:03.983982    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal" event={"ID":"ed0806145607cf8ffdc220e9b1119389","Type":"ContainerDied","Data":"04231137347e2f07c9947a086e6d4e2291ae9e5995f00a38be421be236603b57"}
Sep 17 00:10:04.920409 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:04.920383    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:04.920856 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:04.920479    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:05.454356 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:05.454289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:05.454530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:05.454384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:05.454530 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:05.454500    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:05.454655 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:05.454558    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret podName:345076c3-2bd1-4142-ae90-0fd15c7242f9 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:09.454540854 +0000 UTC m=+9.981280321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret") pod "global-pull-secret-syncer-kjjvd" (UID: "345076c3-2bd1-4142-ae90-0fd15c7242f9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:05.455076 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:05.454941    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:05.455076 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:05.454993    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs podName:fa2489c7-1864-4abe-bc0f-4bfea881a246 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:09.45497803 +0000 UTC m=+9.981717491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs") pod "network-metrics-daemon-w28gk" (UID: "fa2489c7-1864-4abe-bc0f-4bfea881a246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:05.655933 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:05.655659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thqqt\" (UniqueName: \"kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt\") pod \"network-check-target-dctfb\" (UID: \"a5159d33-9894-4022-9611-cf85fa5b4c56\") " pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:05.655933 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:05.655873    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:05.655933 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:05.655892    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:05.655933 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:05.655904    2565 projected.go:196] Error preparing data for projected volume kube-api-access-thqqt for pod openshift-network-diagnostics/network-check-target-dctfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:05.656328 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:05.655961    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt podName:a5159d33-9894-4022-9611-cf85fa5b4c56 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:09.655944189 +0000 UTC m=+10.182683654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-thqqt" (UniqueName: "kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt") pod "network-check-target-dctfb" (UID: "a5159d33-9894-4022-9611-cf85fa5b4c56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:05.923486 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:05.923413    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:05.923930 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:05.923534    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:05.923930 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:05.923908    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:05.924040 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:05.924016    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:06.919907 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:06.919872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:06.920071 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:06.920003    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:07.923934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:07.923902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:07.924358 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:07.923945    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:07.924358 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:07.924025    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:07.924358 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:07.924151    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:08.920310 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:08.919999    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:08.920457 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:08.920352    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:09.485912 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:09.485882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:09.486367 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:09.485925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:09.486367 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:09.486082    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:09.486367 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:09.486142    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs podName:fa2489c7-1864-4abe-bc0f-4bfea881a246 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:17.486122683 +0000 UTC m=+18.012862140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs") pod "network-metrics-daemon-w28gk" (UID: "fa2489c7-1864-4abe-bc0f-4bfea881a246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:09.486566 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:09.486540    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:09.486680 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:09.486602    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret podName:345076c3-2bd1-4142-ae90-0fd15c7242f9 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:17.486585489 +0000 UTC m=+18.013324949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret") pod "global-pull-secret-syncer-kjjvd" (UID: "345076c3-2bd1-4142-ae90-0fd15c7242f9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:09.687349 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:09.687269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thqqt\" (UniqueName: \"kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt\") pod \"network-check-target-dctfb\" (UID: \"a5159d33-9894-4022-9611-cf85fa5b4c56\") " pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:09.687516 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:09.687406    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:09.687516 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:09.687424    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:09.687516 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:09.687448    2565 projected.go:196] Error preparing data for projected volume kube-api-access-thqqt for pod openshift-network-diagnostics/network-check-target-dctfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:09.687516 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:09.687503    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt podName:a5159d33-9894-4022-9611-cf85fa5b4c56 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:17.6874864 +0000 UTC m=+18.214225855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-thqqt" (UniqueName: "kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt") pod "network-check-target-dctfb" (UID: "a5159d33-9894-4022-9611-cf85fa5b4c56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:09.920376 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:09.920305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:09.920528 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:09.920437    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:09.923108 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:09.920761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:09.923108 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:09.920876    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:10.920538 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:10.920455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:10.920994 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:10.920570    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:11.920703 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:11.920212    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:11.920703 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:11.920252    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:11.920703 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:11.920341    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:11.920703 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:11.920461    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:12.920225 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:12.920200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:12.920337 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:12.920289    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:13.922643 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:13.922608    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:13.923101 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:13.922730    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:13.923101 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:13.922788    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:13.923101 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:13.922903    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:14.919934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:14.919905    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:14.920093 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:14.919998    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:15.920172 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:15.920135    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:15.920172 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:15.920162    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:15.920651 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:15.920266    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:15.920651 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:15.920362    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:16.920304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:16.920228    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:16.920795 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:16.920331    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:17.543381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:17.543297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:17.543542 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:17.543399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:17.543542 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:17.543448    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:17.543542 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:17.543511    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret podName:345076c3-2bd1-4142-ae90-0fd15c7242f9 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:33.54349445 +0000 UTC m=+34.070233907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret") pod "global-pull-secret-syncer-kjjvd" (UID: "345076c3-2bd1-4142-ae90-0fd15c7242f9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:17.543542 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:17.543521    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:17.543724 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:17.543570    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs podName:fa2489c7-1864-4abe-bc0f-4bfea881a246 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:33.543553863 +0000 UTC m=+34.070293326 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs") pod "network-metrics-daemon-w28gk" (UID: "fa2489c7-1864-4abe-bc0f-4bfea881a246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:17.744501 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:17.744466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thqqt\" (UniqueName: \"kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt\") pod \"network-check-target-dctfb\" (UID: \"a5159d33-9894-4022-9611-cf85fa5b4c56\") " pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:17.744640 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:17.744621    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:17.744680 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:17.744647    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:17.744680 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:17.744661    2565 projected.go:196] Error preparing data for projected volume kube-api-access-thqqt for pod openshift-network-diagnostics/network-check-target-dctfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:17.744768 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:17.744720    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt podName:a5159d33-9894-4022-9611-cf85fa5b4c56 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:33.744701135 +0000 UTC m=+34.271440610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-thqqt" (UniqueName: "kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt") pod "network-check-target-dctfb" (UID: "a5159d33-9894-4022-9611-cf85fa5b4c56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:17.920349 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:17.920273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:17.920349 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:17.920274    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:17.920783 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:17.920389    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:17.920783 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:17.920515    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:18.920558 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:18.920530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:18.920942 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:18.920629    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:19.920887 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:19.920854    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:19.921331 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:19.920947    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:19.921331 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:19.920997    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:19.921331 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:19.921076    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:20.920262 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:20.919973    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:20.920349 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:20.920338    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:21.017100 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.017075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c" event={"ID":"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba","Type":"ContainerStarted","Data":"93869c116a946b937eb080cbf54f712da7031b8f7e32abe1146d935c4178b7a4"}
Sep 17 00:10:21.018545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.018520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjln9" event={"ID":"bef72613-f5cb-4857-8549-33e3692289b2","Type":"ContainerStarted","Data":"9f6c254be5bb759b2652659ad575660772f16db0f9959455f77792c42f6b13d4"}
Sep 17 00:10:21.019922 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.019897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-211.ec2.internal" event={"ID":"0bc175423b8a32cb6a5dcc25bbd2083d","Type":"ContainerStarted","Data":"ffdb11ab21618710ae94c60f7b4f0c2524682fb0c2c1f9d6daa39dbd5e983de3"}
Sep 17 00:10:21.021599 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.021576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal" event={"ID":"ed0806145607cf8ffdc220e9b1119389","Type":"ContainerStarted","Data":"aab7244660fdf16c905ef2fc304926ca2d871cde64a5a52eca5275e82cbe5972"}
Sep 17 00:10:21.023028 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.023007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5gjhc" event={"ID":"99ef898a-6b18-4def-851a-defedc9752f0","Type":"ContainerStarted","Data":"51ca41008747bda247d9199c92f9eed257dcc29b0c081d98ce008edd06f644eb"}
Sep 17 00:10:21.024475 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.024456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nsp6k" event={"ID":"63dc5909-1a82-42ae-bd7d-e3be851bde86","Type":"ContainerStarted","Data":"0c1c3a1900f00d674d9c0c1fecf6c2c023f4b51e58bb1f7ef97707810481b9e2"}
Sep 17 00:10:21.027367 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.027348    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh" event={"ID":"13c90c3a-8f98-4f15-9341-01ac50730012","Type":"ContainerStarted","Data":"7ba39a88878a34c6d64eab88dd7ef77d028da2da4e63f3355ab3e6896a819a1f"}
Sep 17 00:10:21.027454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.027410    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh" event={"ID":"13c90c3a-8f98-4f15-9341-01ac50730012","Type":"ContainerStarted","Data":"a7d5b2b0e372265df7cf4015a7078bee402a251a9e24dd08b9b8796304e033d1"}
Sep 17 00:10:21.027520 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.027457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh" event={"ID":"13c90c3a-8f98-4f15-9341-01ac50730012","Type":"ContainerStarted","Data":"47a88bb526c47a3cee27e2a243e826735aaa029ad38ae077d2d4b6bc4c0324f3"}
Sep 17 00:10:21.027520 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.027506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh" event={"ID":"13c90c3a-8f98-4f15-9341-01ac50730012","Type":"ContainerStarted","Data":"c3ec395efb0009924b8c713d6275cc58e68fdc3b67f221602ea5f624ab9cd4be"}
Sep 17 00:10:21.028995 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.028976    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-whcmk" event={"ID":"37dbbfd8-ffbf-4601-b41b-b23df76d380f","Type":"ContainerStarted","Data":"f74971e77ca362b513af7decb989c164dfca4c1a7af8e5aa27cf47b94b57cffb"}
Sep 17 00:10:21.030567 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.030546    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d5fad81-0837-4f67-85fd-c65c5d5a01bc" containerID="15b40a5ca41e86d55dd722723bd4633586bd1ad18d4d13a54a62181225c25d97" exitCode=0
Sep 17 00:10:21.030672 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.030608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4c9q" event={"ID":"9d5fad81-0837-4f67-85fd-c65c5d5a01bc","Type":"ContainerDied","Data":"15b40a5ca41e86d55dd722723bd4633586bd1ad18d4d13a54a62181225c25d97"}
Sep 17 00:10:21.033886 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.033836    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fjln9" podStartSLOduration=3.818778096 podStartE2EDuration="22.033819148s" totalImagesPullingTime="18.215041052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:21.033336195 +0000 UTC m=+21.560075696" watchObservedRunningTime="2026-09-17 00:10:21.033819148 +0000 UTC m=+21.560558624"
Sep 17 00:10:21.035547 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.035527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m5sg5" event={"ID":"56bd23f3-6be8-4b22-ad3c-ba0156a5f08e","Type":"ContainerStarted","Data":"ca58710a6c13c0b4227e8cde66e603681288ee1d2ac5b1e61eda33608b86f3b2"}
Sep 17 00:10:21.048238 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.048200    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nsp6k" podStartSLOduration=2.785422069 podStartE2EDuration="21.048188431s" totalImagesPullingTime="18.262766362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:21.047789193 +0000 UTC m=+21.574528682" watchObservedRunningTime="2026-09-17 00:10:21.048188431 +0000 UTC m=+21.574927909"
Sep 17 00:10:21.061554 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.061520    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5gjhc" podStartSLOduration=2.849725943 podStartE2EDuration="21.061508817s" totalImagesPullingTime="18.211782874s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:21.061276153 +0000 UTC m=+21.588015660" watchObservedRunningTime="2026-09-17 00:10:21.061508817 +0000 UTC m=+21.588248295"
Sep 17 00:10:21.075164 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.075126    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-211.ec2.internal" podStartSLOduration=20.075109429 podStartE2EDuration="20.075109429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:21.074937542 +0000 UTC m=+21.601677032" watchObservedRunningTime="2026-09-17 00:10:21.075109429 +0000 UTC m=+21.601848942"
Sep 17 00:10:21.109455 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.109414    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-211.ec2.internal" podStartSLOduration=20.109401001 podStartE2EDuration="20.109401001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:21.108926453 +0000 UTC m=+21.635665956" watchObservedRunningTime="2026-09-17 00:10:21.109401001 +0000 UTC m=+21.636140480"
Sep 17 00:10:21.124308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.124273    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-whcmk" podStartSLOduration=2.8849923090000003 podStartE2EDuration="21.124261544s" totalImagesPullingTime="18.239269235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:21.124052733 +0000 UTC m=+21.650792213" watchObservedRunningTime="2026-09-17 00:10:21.124261544 +0000 UTC m=+21.651001021"
Sep 17 00:10:21.138281 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.138251    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-m5sg5" podStartSLOduration=2.938783549 podStartE2EDuration="21.138241577s" totalImagesPullingTime="18.199458028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:21.13805227 +0000 UTC m=+21.664791747" watchObservedRunningTime="2026-09-17 00:10:21.138241577 +0000 UTC m=+21.664981055"
Sep 17 00:10:21.781282 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.781224    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:21.782100 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.782077    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:21.846646 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.846627    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 00:10:21.877022 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.876924    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T00:10:21.846642488Z","UUID":"67ce4eeb-9738-4811-8d77-f411fe9569a5","Handler":null,"Name":"","Endpoint":""}
Sep 17 00:10:21.878299 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.878283    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 00:10:21.878398 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.878314    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 00:10:21.920269 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.920247    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:21.920376 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:21.920358    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:21.920435 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:21.920415    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:21.920534 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:21.920515    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:22.043300 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:22.043241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh" event={"ID":"13c90c3a-8f98-4f15-9341-01ac50730012","Type":"ContainerStarted","Data":"29844ed5f988da5b64c9c24b0c46d8d21b374c954a9897b19755e4679cb4f29d"}
Sep 17 00:10:22.043661 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:22.043316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh" event={"ID":"13c90c3a-8f98-4f15-9341-01ac50730012","Type":"ContainerStarted","Data":"ece240db97df52967a38de1f3fc1af957a5710b8565913559e9b83d3b9f6a162"}
Sep 17 00:10:22.044989 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:22.044816    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8k8fb" event={"ID":"28411be7-9487-4a51-8a36-900ad3555d09","Type":"ContainerStarted","Data":"ef23a00a77b4debfd60c44a6baca935b59f8a848ee8f96f225e2fe1542628b0c"}
Sep 17 00:10:22.046720 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:22.046652    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c" event={"ID":"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba","Type":"ContainerStarted","Data":"1c33e5e51227fc539cb2b0c17c682ac8b795f1530aba77701bfd8263710b92ff"}
Sep 17 00:10:22.047190 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:22.046984    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:22.048403 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:22.048374    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fjln9"
Sep 17 00:10:22.059462 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:22.059415    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8k8fb" podStartSLOduration=7.745958872 podStartE2EDuration="22.05940368s" totalImagesPullingTime="14.313444808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:22.05902562 +0000 UTC m=+22.585765122" watchObservedRunningTime="2026-09-17 00:10:22.05940368 +0000 UTC m=+22.586143157"
Sep 17 00:10:22.836448 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:22.836417    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:22.919677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:22.919641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:22.919677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:22.919667    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:22.919904 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:22.919777    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:23.221986 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:23.221957    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:23.318573 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:23.318550    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:23.920164 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:23.920014    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:23.920406 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:23.920024    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:23.920406 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:23.920265    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:23.920406 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:23.920302    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:24.054049 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:24.054017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c" event={"ID":"16b783ee-8f6b-4d75-9ebd-e83aa0e66fba","Type":"ContainerStarted","Data":"344009b6a9582afa66eb307e048f28240772e329d1c99ff74fe3e0b09b5adcc8"}
Sep 17 00:10:24.057920 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:24.057893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh" event={"ID":"13c90c3a-8f98-4f15-9341-01ac50730012","Type":"ContainerStarted","Data":"460789c6f200aab07a323c9ea6482b5c878750a1c27075efe1849e6d8a8934c4"}
Sep 17 00:10:24.072437 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:24.072396    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2zz5c" podStartSLOduration=3.519883298 podStartE2EDuration="24.072379724s" totalImagesPullingTime="20.552496426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:24.071759285 +0000 UTC m=+24.598498772" watchObservedRunningTime="2026-09-17 00:10:24.072379724 +0000 UTC m=+24.599119202"
Sep 17 00:10:24.920476 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:24.920444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:24.920943 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:24.920547    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:25.920751 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:25.920598    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:25.921277 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:25.920599    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:25.921277 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:25.920837    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:25.921277 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:25.920898    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:26.063246 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:26.063225    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d5fad81-0837-4f67-85fd-c65c5d5a01bc" containerID="cef3fd84833ac7ca17760106f6ac6f3ba12cf654cff70b99ed85ade67d458129" exitCode=0
Sep 17 00:10:26.063341 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:26.063315    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4c9q" event={"ID":"9d5fad81-0837-4f67-85fd-c65c5d5a01bc","Type":"ContainerDied","Data":"cef3fd84833ac7ca17760106f6ac6f3ba12cf654cff70b99ed85ade67d458129"}
Sep 17 00:10:26.067260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:26.067235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh" event={"ID":"13c90c3a-8f98-4f15-9341-01ac50730012","Type":"ContainerStarted","Data":"25e8330156dd72c68668cc8e458824f4f48e1e59cbb3a41764151794ab765121"}
Sep 17 00:10:26.067582 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:26.067565    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:26.082635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:26.082618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:26.104103 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:26.104069    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh" podStartSLOduration=7.554987216 podStartE2EDuration="26.104057263s" totalImagesPullingTime="18.549070047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:26.102566789 +0000 UTC m=+26.629306266" watchObservedRunningTime="2026-09-17 00:10:26.104057263 +0000 UTC m=+26.630796742"
Sep 17 00:10:26.919670 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:26.919634    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:26.919843 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:26.919759    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:27.075032 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:27.075011    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:27.075307 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:27.075205    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:27.089128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:27.089108    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:27.166537 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:27.166508    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:27.611925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:27.611899    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kjjvd"]
Sep 17 00:10:27.612039 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:27.612005    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:27.612105 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:27.612085    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:27.614530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:27.614505    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w28gk"]
Sep 17 00:10:27.614638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:27.614624    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:27.614749 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:27.614731    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:27.615060 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:27.615042    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dctfb"]
Sep 17 00:10:27.615139 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:27.615127    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:27.615225 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:27.615206    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:27.717291 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:27.717234    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:28.079067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:28.079036    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d5fad81-0837-4f67-85fd-c65c5d5a01bc" containerID="944cbabd033985b323ee5a255339ed0962ffea62f838e443d673041f935248f2" exitCode=0
Sep 17 00:10:28.079402 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:28.079132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4c9q" event={"ID":"9d5fad81-0837-4f67-85fd-c65c5d5a01bc","Type":"ContainerDied","Data":"944cbabd033985b323ee5a255339ed0962ffea62f838e443d673041f935248f2"}
Sep 17 00:10:28.920549 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:28.920407    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:28.920635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:28.920457    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:28.920635 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:28.920625    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:28.920707 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:28.920687    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:29.087611 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:29.087580    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d5fad81-0837-4f67-85fd-c65c5d5a01bc" containerID="ff5928c4cc40a424ed9707df08d95b3691abbab54c3235eed04b037f23d5593d" exitCode=0
Sep 17 00:10:29.087971 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:29.087645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4c9q" event={"ID":"9d5fad81-0837-4f67-85fd-c65c5d5a01bc","Type":"ContainerDied","Data":"ff5928c4cc40a424ed9707df08d95b3691abbab54c3235eed04b037f23d5593d"}
Sep 17 00:10:29.920547 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:29.920523    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:29.920649 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:29.920600    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:30.920446 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:30.920414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:30.921007 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:30.920524    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:30.921007 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:30.920552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:30.921007 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:30.920614    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:31.081156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:31.081123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:31.139768 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:31.139702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:31.668121 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:31.668092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:31.768753 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:31.768719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:31.920033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:31.919972    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:31.920158 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:31.920092    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:32.919895 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:32.919858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:32.919895 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:32.919876    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:32.920565 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:32.919963    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dctfb" podUID="a5159d33-9894-4022-9611-cf85fa5b4c56"
Sep 17 00:10:32.920565 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:32.920054    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kjjvd" podUID="345076c3-2bd1-4142-ae90-0fd15c7242f9"
Sep 17 00:10:33.569474 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:33.569438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:33.569627 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:33.569537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:33.569627 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:33.569597    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:33.569627 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:33.569621    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:33.569760 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:33.569662    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs podName:fa2489c7-1864-4abe-bc0f-4bfea881a246 nodeName:}" failed. No retries permitted until 2026-09-17 00:11:05.569644632 +0000 UTC m=+66.096384092 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs") pod "network-metrics-daemon-w28gk" (UID: "fa2489c7-1864-4abe-bc0f-4bfea881a246") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:33.569760 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:33.569680    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret podName:345076c3-2bd1-4142-ae90-0fd15c7242f9 nodeName:}" failed. No retries permitted until 2026-09-17 00:11:05.569671261 +0000 UTC m=+66.096410720 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret") pod "global-pull-secret-syncer-kjjvd" (UID: "345076c3-2bd1-4142-ae90-0fd15c7242f9") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:33.770929 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:33.770848    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thqqt\" (UniqueName: \"kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt\") pod \"network-check-target-dctfb\" (UID: \"a5159d33-9894-4022-9611-cf85fa5b4c56\") " pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:33.771061 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:33.770972    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:33.771061 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:33.770992    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:33.771061 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:33.771004    2565 projected.go:196] Error preparing data for projected volume kube-api-access-thqqt for pod openshift-network-diagnostics/network-check-target-dctfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:33.771061 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:33.771060    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt podName:a5159d33-9894-4022-9611-cf85fa5b4c56 nodeName:}" failed. No retries permitted until 2026-09-17 00:11:05.771044586 +0000 UTC m=+66.297784050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-thqqt" (UniqueName: "kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt") pod "network-check-target-dctfb" (UID: "a5159d33-9894-4022-9611-cf85fa5b4c56") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:33.920478 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:33.920452    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:33.920882 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:33.920569    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:10:34.231671 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.231650    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-211.ec2.internal" event="NodeReady"
Sep 17 00:10:34.231782 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.231742    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 00:10:34.270016 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.269985    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cd46g"]
Sep 17 00:10:34.287442 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.287384    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rcljv"]
Sep 17 00:10:34.287655 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.287635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.290429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.290400    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 00:10:34.290429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.290421    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d74lr\""
Sep 17 00:10:34.290576 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.290468    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 00:10:34.307317 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.307294    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cd46g"]
Sep 17 00:10:34.307410 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.307327    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rcljv"]
Sep 17 00:10:34.307410 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.307404    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rcljv"
Sep 17 00:10:34.309755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.309734    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 00:10:34.309932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.309785    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cbrk8\""
Sep 17 00:10:34.309932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.309915    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 00:10:34.310091 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.310073    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 00:10:34.475861 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.475844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqrtl\" (UniqueName: \"kubernetes.io/projected/f492cc67-feac-490d-9c0a-60489a020da3-kube-api-access-vqrtl\") pod \"ingress-canary-rcljv\" (UID: \"f492cc67-feac-490d-9c0a-60489a020da3\") " pod="openshift-ingress-canary/ingress-canary-rcljv"
Sep 17 00:10:34.475928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.475874    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.475928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.475897    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktcdv\" (UniqueName: \"kubernetes.io/projected/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-kube-api-access-ktcdv\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.476031 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.475981    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-config-volume\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.476069 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.476030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f492cc67-feac-490d-9c0a-60489a020da3-cert\") pod \"ingress-canary-rcljv\" (UID: \"f492cc67-feac-490d-9c0a-60489a020da3\") " pod="openshift-ingress-canary/ingress-canary-rcljv"
Sep 17 00:10:34.476119 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.476071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-tmp-dir\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.577038 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.577014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-config-volume\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.577127 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.577044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f492cc67-feac-490d-9c0a-60489a020da3-cert\") pod \"ingress-canary-rcljv\" (UID: \"f492cc67-feac-490d-9c0a-60489a020da3\") " pod="openshift-ingress-canary/ingress-canary-rcljv"
Sep 17 00:10:34.577127 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.577071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-tmp-dir\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.577127 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.577100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqrtl\" (UniqueName: \"kubernetes.io/projected/f492cc67-feac-490d-9c0a-60489a020da3-kube-api-access-vqrtl\") pod \"ingress-canary-rcljv\" (UID: \"f492cc67-feac-490d-9c0a-60489a020da3\") " pod="openshift-ingress-canary/ingress-canary-rcljv"
Sep 17 00:10:34.577127 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.577124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.577301 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.577144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktcdv\" (UniqueName: \"kubernetes.io/projected/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-kube-api-access-ktcdv\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.577301 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:34.577288    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:34.577397 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.577349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-tmp-dir\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.577397 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:34.577368    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls podName:dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae nodeName:}" failed. No retries permitted until 2026-09-17 00:10:35.077346947 +0000 UTC m=+35.604086407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls") pod "dns-default-cd46g" (UID: "dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:34.577624 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.577603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-config-volume\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.580758 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.580736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f492cc67-feac-490d-9c0a-60489a020da3-cert\") pod \"ingress-canary-rcljv\" (UID: \"f492cc67-feac-490d-9c0a-60489a020da3\") " pod="openshift-ingress-canary/ingress-canary-rcljv"
Sep 17 00:10:34.585613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.585589    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktcdv\" (UniqueName: \"kubernetes.io/projected/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-kube-api-access-ktcdv\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:34.585690 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.585625    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqrtl\" (UniqueName: \"kubernetes.io/projected/f492cc67-feac-490d-9c0a-60489a020da3-kube-api-access-vqrtl\") pod \"ingress-canary-rcljv\" (UID: \"f492cc67-feac-490d-9c0a-60489a020da3\") " pod="openshift-ingress-canary/ingress-canary-rcljv"
Sep 17 00:10:34.614783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.614756    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rcljv"
Sep 17 00:10:34.908780 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.908754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rcljv"]
Sep 17 00:10:34.911961 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:10:34.911932    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf492cc67_feac_490d_9c0a_60489a020da3.slice/crio-09566e62c54e15d344a2a7ca3164dbc2e3d38289da0508d61ad3d01237de34fd WatchSource:0}: Error finding container 09566e62c54e15d344a2a7ca3164dbc2e3d38289da0508d61ad3d01237de34fd: Status 404 returned error can't find the container with id 09566e62c54e15d344a2a7ca3164dbc2e3d38289da0508d61ad3d01237de34fd
Sep 17 00:10:34.920653 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.920632    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:10:34.921141 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.920666    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:10:34.922879 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.922857    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 00:10:34.923020 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.923000    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86j4t\""
Sep 17 00:10:34.923095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.923033    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 00:10:34.923943 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:34.923925    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 00:10:35.081108 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:35.081080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:35.081227 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:35.081211    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:35.081287 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:35.081277    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls podName:dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae nodeName:}" failed. No retries permitted until 2026-09-17 00:10:36.081263779 +0000 UTC m=+36.608003235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls") pod "dns-default-cd46g" (UID: "dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:35.104678 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:35.104639    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d5fad81-0837-4f67-85fd-c65c5d5a01bc" containerID="f0ede5ed5e08eb5a2cf9394204f3503bf84c5840af6a8286630d9f6340c23a17" exitCode=0
Sep 17 00:10:35.104785 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:35.104676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4c9q" event={"ID":"9d5fad81-0837-4f67-85fd-c65c5d5a01bc","Type":"ContainerDied","Data":"f0ede5ed5e08eb5a2cf9394204f3503bf84c5840af6a8286630d9f6340c23a17"}
Sep 17 00:10:35.106097 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:35.106072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rcljv" event={"ID":"f492cc67-feac-490d-9c0a-60489a020da3","Type":"ContainerStarted","Data":"09566e62c54e15d344a2a7ca3164dbc2e3d38289da0508d61ad3d01237de34fd"}
Sep 17 00:10:35.923605 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:35.923577    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:10:35.926428 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:35.926408    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxlvp\""
Sep 17 00:10:35.926547 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:35.926408    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 00:10:36.088979 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:36.088956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:36.089122 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:36.089059    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:36.089122 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:36.089117    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls podName:dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae nodeName:}" failed. No retries permitted until 2026-09-17 00:10:38.089100325 +0000 UTC m=+38.615839782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls") pod "dns-default-cd46g" (UID: "dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:36.112479 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:36.112444    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d5fad81-0837-4f67-85fd-c65c5d5a01bc" containerID="4012673042b24cd64353a7025cbf574655c1f54e2d6d3cda38022fdd79e81371" exitCode=0
Sep 17 00:10:36.112591 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:36.112508    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4c9q" event={"ID":"9d5fad81-0837-4f67-85fd-c65c5d5a01bc","Type":"ContainerDied","Data":"4012673042b24cd64353a7025cbf574655c1f54e2d6d3cda38022fdd79e81371"}
Sep 17 00:10:37.118587 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:37.118555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d4c9q" event={"ID":"9d5fad81-0837-4f67-85fd-c65c5d5a01bc","Type":"ContainerStarted","Data":"6a2ab1ad8754289ceb995561057a9111d4fb767bacdff4036d5e2bb00355d60f"}
Sep 17 00:10:37.139221 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:37.138915    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d4c9q" podStartSLOduration=8.289069034 podStartE2EDuration="38.138902023s" totalImagesPullingTime="29.849832989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:37.137429121 +0000 UTC m=+37.664168616" watchObservedRunningTime="2026-09-17 00:10:37.138902023 +0000 UTC m=+37.665641499"
Sep 17 00:10:37.527391 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:37.527365    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:37.577547 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:37.577409    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:37.762066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:37.761988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:37.854719 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:37.854689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:37.948196 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:37.948168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:38.104472 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:38.104456    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:38.104580 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:38.104568    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:38.104630 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:38.104616    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls podName:dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae nodeName:}" failed. No retries permitted until 2026-09-17 00:10:42.104604603 +0000 UTC m=+42.631344071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls") pod "dns-default-cd46g" (UID: "dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:38.122352 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:38.122324    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rcljv" event={"ID":"f492cc67-feac-490d-9c0a-60489a020da3","Type":"ContainerStarted","Data":"2855aade7e82aaa09f1b648ae5e16113716178ae31fa463eee1b69750b10a74c"}
Sep 17 00:10:38.143674 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:38.143637    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rcljv" podStartSLOduration=1.5526498480000002 podStartE2EDuration="4.143623081s" totalImagesPullingTime="2.590973233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:38.141859429 +0000 UTC m=+38.668598912" watchObservedRunningTime="2026-09-17 00:10:38.143623081 +0000 UTC m=+38.670362557"
Sep 17 00:10:38.405117 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:38.405041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:38.504968 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:38.504936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:42.129438 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:42.129407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:42.129819 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:42.129504    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:42.129819 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:42.129554    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls podName:dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae nodeName:}" failed. No retries permitted until 2026-09-17 00:10:50.129540438 +0000 UTC m=+50.656279892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls") pod "dns-default-cd46g" (UID: "dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:48.072631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:48.072591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:48.124274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:48.124245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:50.176250 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:50.176224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:10:50.176724 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:50.176382    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:50.176724 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:10:50.176448    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls podName:dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae nodeName:}" failed. No retries permitted until 2026-09-17 00:11:06.17642864 +0000 UTC m=+66.703168113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls") pod "dns-default-cd46g" (UID: "dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:59.098741 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:59.098709    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6ljnh"
Sep 17 00:10:59.248265 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:59.248230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:59.346088 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:59.346055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:59.751962 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:59.751930    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:10:59.806536 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:10:59.806510    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:11:02.684495 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:02.684438    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:11:05.572554 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.572526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:11:05.572554 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.572558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:11:05.575673 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.575655    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 00:11:05.575743 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.575701    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 00:11:05.582848 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:11:05.582826    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 00:11:05.582937 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:11:05.582891    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs podName:fa2489c7-1864-4abe-bc0f-4bfea881a246 nodeName:}" failed. No retries permitted until 2026-09-17 00:12:09.582877221 +0000 UTC m=+130.109616676 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs") pod "network-metrics-daemon-w28gk" (UID: "fa2489c7-1864-4abe-bc0f-4bfea881a246") : secret "metrics-daemon-secret" not found
Sep 17 00:11:05.586280 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.586258    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/345076c3-2bd1-4142-ae90-0fd15c7242f9-original-pull-secret\") pod \"global-pull-secret-syncer-kjjvd\" (UID: \"345076c3-2bd1-4142-ae90-0fd15c7242f9\") " pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:11:05.773932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.773901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thqqt\" (UniqueName: \"kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt\") pod \"network-check-target-dctfb\" (UID: \"a5159d33-9894-4022-9611-cf85fa5b4c56\") " pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:11:05.776461 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.776446    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 00:11:05.786630 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.786613    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 00:11:05.796752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.796734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thqqt\" (UniqueName: \"kubernetes.io/projected/a5159d33-9894-4022-9611-cf85fa5b4c56-kube-api-access-thqqt\") pod \"network-check-target-dctfb\" (UID: \"a5159d33-9894-4022-9611-cf85fa5b4c56\") " pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:11:05.832740 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.832690    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86j4t\""
Sep 17 00:11:05.835622 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.835609    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kjjvd"
Sep 17 00:11:05.840955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:05.840938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:11:06.108640 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:06.108585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kjjvd"]
Sep 17 00:11:06.110571 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:06.110548    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dctfb"]
Sep 17 00:11:06.112021 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:11:06.111947    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345076c3_2bd1_4142_ae90_0fd15c7242f9.slice/crio-c6b73db3585d92831d85d5a6fb292cbb03090d5e5b939f4d8c5d80379c03eae0 WatchSource:0}: Error finding container c6b73db3585d92831d85d5a6fb292cbb03090d5e5b939f4d8c5d80379c03eae0: Status 404 returned error can't find the container with id c6b73db3585d92831d85d5a6fb292cbb03090d5e5b939f4d8c5d80379c03eae0
Sep 17 00:11:06.113628 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:11:06.113608    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5159d33_9894_4022_9611_cf85fa5b4c56.slice/crio-6dbad1f27dad9294175af3d16d5fc63b8fc35b1e88bd1c4694adaa740ad1f9fc WatchSource:0}: Error finding container 6dbad1f27dad9294175af3d16d5fc63b8fc35b1e88bd1c4694adaa740ad1f9fc: Status 404 returned error can't find the container with id 6dbad1f27dad9294175af3d16d5fc63b8fc35b1e88bd1c4694adaa740ad1f9fc
Sep 17 00:11:06.176786 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:06.176766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:11:06.176914 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:11:06.176895    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:11:06.176966 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:11:06.176956    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls podName:dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae nodeName:}" failed. No retries permitted until 2026-09-17 00:11:38.176936271 +0000 UTC m=+98.703675729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls") pod "dns-default-cd46g" (UID: "dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae") : secret "dns-default-metrics-tls" not found
Sep 17 00:11:06.183446 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:06.183423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kjjvd" event={"ID":"345076c3-2bd1-4142-ae90-0fd15c7242f9","Type":"ContainerStarted","Data":"c6b73db3585d92831d85d5a6fb292cbb03090d5e5b939f4d8c5d80379c03eae0"}
Sep 17 00:11:06.184472 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:06.184450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dctfb" event={"ID":"a5159d33-9894-4022-9611-cf85fa5b4c56","Type":"ContainerStarted","Data":"6dbad1f27dad9294175af3d16d5fc63b8fc35b1e88bd1c4694adaa740ad1f9fc"}
Sep 17 00:11:11.199289 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:11.199246    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dctfb" event={"ID":"a5159d33-9894-4022-9611-cf85fa5b4c56","Type":"ContainerStarted","Data":"4723e5807ca8274c12dfe2d3b207d4528b5b971b8d8bd575ff0c6e34fc72e09d"}
Sep 17 00:11:11.199752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:11.199389    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:11:11.201141 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:11.201110    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kjjvd" event={"ID":"345076c3-2bd1-4142-ae90-0fd15c7242f9","Type":"ContainerStarted","Data":"a15cdff54797a1d3dcade1bf979729fc8543118f2f624db2a1f76354fa642b44"}
Sep 17 00:11:11.213687 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:11.213634    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dctfb" podStartSLOduration=66.690064097 podStartE2EDuration="1m11.213617477s" totalImagesPullingTime="4.52355338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:11:11.212960482 +0000 UTC m=+71.739699980" watchObservedRunningTime="2026-09-17 00:11:11.213617477 +0000 UTC m=+71.740356953"
Sep 17 00:11:11.226183 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:11.226139    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kjjvd" podStartSLOduration=66.689402211 podStartE2EDuration="1m11.226127582s" totalImagesPullingTime="4.536725371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:11:11.225825499 +0000 UTC m=+71.752564998" watchObservedRunningTime="2026-09-17 00:11:11.226127582 +0000 UTC m=+71.752867099"
Sep 17 00:11:26.284229 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:26.284188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:11:26.331146 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:26.331108    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:11:38.179413 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:38.179358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:11:38.179884 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:11:38.179516    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:11:38.179884 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:11:38.179598    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls podName:dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae nodeName:}" failed. No retries permitted until 2026-09-17 00:12:42.17958021 +0000 UTC m=+162.706319666 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls") pod "dns-default-cd46g" (UID: "dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae") : secret "dns-default-metrics-tls" not found
Sep 17 00:11:42.205901 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:11:42.205868    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dctfb"
Sep 17 00:12:09.592975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:12:09.592931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:12:09.593523 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:12:09.593046    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 00:12:09.593523 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:12:09.593106    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs podName:fa2489c7-1864-4abe-bc0f-4bfea881a246 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:11.593091003 +0000 UTC m=+252.119830459 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs") pod "network-metrics-daemon-w28gk" (UID: "fa2489c7-1864-4abe-bc0f-4bfea881a246") : secret "metrics-daemon-secret" not found
Sep 17 00:12:13.979139 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:12:13.979108    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:12:37.297160 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:12:37.297103    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cd46g" podUID="dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae"
Sep 17 00:12:37.406499 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:12:37.406416    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cd46g"
Sep 17 00:12:38.933162 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:12:38.933116    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-w28gk" podUID="fa2489c7-1864-4abe-bc0f-4bfea881a246"
Sep 17 00:12:42.221328 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:12:42.221282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:12:42.221883 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:12:42.221431    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:12:42.221883 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:12:42.221495    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls podName:dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae nodeName:}" failed. No retries permitted until 2026-09-17 00:14:44.221478284 +0000 UTC m=+284.748217740 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls") pod "dns-default-cd46g" (UID: "dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae") : secret "dns-default-metrics-tls" not found
Sep 17 00:12:52.920740 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:12:52.920645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:13:24.223414 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:24.223369    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:52.002763 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.002725    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"]
Sep 17 00:13:52.004543 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.004523    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"
Sep 17 00:13:52.005930 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.005894    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"]
Sep 17 00:13:52.007523 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.007503    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"
Sep 17 00:13:52.009182 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.009156    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7c7d59dc6d-jbgwm"]
Sep 17 00:13:52.009291 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.009190    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mxb4x\""
Sep 17 00:13:52.009366 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.009353    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:13:52.009509 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.009493    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 17 00:13:52.009624 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.009613    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 17 00:13:52.009775 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.009747    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 17 00:13:52.010129 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.010115    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 17 00:13:52.010319 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.010306    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:13:52.010524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.010503    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 17 00:13:52.010667 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.010654    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8spn8\""
Sep 17 00:13:52.010780 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.010768    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 17 00:13:52.010862 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.010771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.014112 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.014085    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 17 00:13:52.014512 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.014356    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 00:13:52.015122 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.015098    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 17 00:13:52.015235 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.015101    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 17 00:13:52.015235 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.015136    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6n77n\""
Sep 17 00:13:52.015235 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.015162    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 00:13:52.015235 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.015098    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 17 00:13:52.019995 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.019970    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"]
Sep 17 00:13:52.023624 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.023597    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"]
Sep 17 00:13:52.028587 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.028557    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c7d59dc6d-jbgwm"]
Sep 17 00:13:52.074562 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.074507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.074562 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.074566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7229633c-b031-453d-ab8e-9077fd3bbd59-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qf5cs\" (UID: \"7229633c-b031-453d-ab8e-9077fd3bbd59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"
Sep 17 00:13:52.074859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.074594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6l2r\" (UniqueName: \"kubernetes.io/projected/7229633c-b031-453d-ab8e-9077fd3bbd59-kube-api-access-f6l2r\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qf5cs\" (UID: \"7229633c-b031-453d-ab8e-9077fd3bbd59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"
Sep 17 00:13:52.074859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.074618    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpsth\" (UniqueName: \"kubernetes.io/projected/b683f874-010b-48cc-b54e-050cbb485410-kube-api-access-hpsth\") pod \"service-ca-operator-cf7c776b7-x8j5l\" (UID: \"b683f874-010b-48cc-b54e-050cbb485410\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"
Sep 17 00:13:52.074859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.074642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7229633c-b031-453d-ab8e-9077fd3bbd59-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qf5cs\" (UID: \"7229633c-b031-453d-ab8e-9077fd3bbd59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"
Sep 17 00:13:52.074859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.074664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b683f874-010b-48cc-b54e-050cbb485410-serving-cert\") pod \"service-ca-operator-cf7c776b7-x8j5l\" (UID: \"b683f874-010b-48cc-b54e-050cbb485410\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"
Sep 17 00:13:52.074859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.074685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-stats-auth\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.074859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.074723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwv28\" (UniqueName: \"kubernetes.io/projected/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-kube-api-access-kwv28\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.074859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.074747    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.074859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.074827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b683f874-010b-48cc-b54e-050cbb485410-config\") pod \"service-ca-operator-cf7c776b7-x8j5l\" (UID: \"b683f874-010b-48cc-b54e-050cbb485410\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"
Sep 17 00:13:52.074859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.074858    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-default-certificate\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.102565 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.102521    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-xxd5z"]
Sep 17 00:13:52.104571 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.104544    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.107029 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.106993    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 17 00:13:52.107328 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.107311    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 17 00:13:52.107731 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.107714    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hjpwb\""
Sep 17 00:13:52.108654 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.108634    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:13:52.108751 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.108656    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 17 00:13:52.117919 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.117887    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 17 00:13:52.119393 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.119368    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-xxd5z"]
Sep 17 00:13:52.175411 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7229633c-b031-453d-ab8e-9077fd3bbd59-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qf5cs\" (UID: \"7229633c-b031-453d-ab8e-9077fd3bbd59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"
Sep 17 00:13:52.175411 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b683f874-010b-48cc-b54e-050cbb485410-serving-cert\") pod \"service-ca-operator-cf7c776b7-x8j5l\" (UID: \"b683f874-010b-48cc-b54e-050cbb485410\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"
Sep 17 00:13:52.175660 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175427    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-stats-auth\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.175660 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwv28\" (UniqueName: \"kubernetes.io/projected/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-kube-api-access-kwv28\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.175660 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mcnq\" (UniqueName: \"kubernetes.io/projected/572e13ec-05ba-4339-8aaf-c728bbd2307a-kube-api-access-7mcnq\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.175660 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.175660 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175523    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/572e13ec-05ba-4339-8aaf-c728bbd2307a-trusted-ca\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.175660 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b683f874-010b-48cc-b54e-050cbb485410-config\") pod \"service-ca-operator-cf7c776b7-x8j5l\" (UID: \"b683f874-010b-48cc-b54e-050cbb485410\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"
Sep 17 00:13:52.175660 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-default-certificate\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.175660 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/572e13ec-05ba-4339-8aaf-c728bbd2307a-config\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.175660 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:52.175657    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 00:13:52.176159 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/572e13ec-05ba-4339-8aaf-c728bbd2307a-serving-cert\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.176159 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.176159 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:52.175734    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs podName:d2521dc9-47dd-445a-a28d-d05c7a7eb9b6 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:52.675711948 +0000 UTC m=+233.202451426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs") pod "router-default-7c7d59dc6d-jbgwm" (UID: "d2521dc9-47dd-445a-a28d-d05c7a7eb9b6") : secret "router-metrics-certs-default" not found
Sep 17 00:13:52.176159 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7229633c-b031-453d-ab8e-9077fd3bbd59-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qf5cs\" (UID: \"7229633c-b031-453d-ab8e-9077fd3bbd59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"
Sep 17 00:13:52.176159 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:52.175830    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle podName:d2521dc9-47dd-445a-a28d-d05c7a7eb9b6 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:52.675784644 +0000 UTC m=+233.202524125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle") pod "router-default-7c7d59dc6d-jbgwm" (UID: "d2521dc9-47dd-445a-a28d-d05c7a7eb9b6") : configmap references non-existent config key: service-ca.crt
Sep 17 00:13:52.176159 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6l2r\" (UniqueName: \"kubernetes.io/projected/7229633c-b031-453d-ab8e-9077fd3bbd59-kube-api-access-f6l2r\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qf5cs\" (UID: \"7229633c-b031-453d-ab8e-9077fd3bbd59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"
Sep 17 00:13:52.176159 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.175901    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpsth\" (UniqueName: \"kubernetes.io/projected/b683f874-010b-48cc-b54e-050cbb485410-kube-api-access-hpsth\") pod \"service-ca-operator-cf7c776b7-x8j5l\" (UID: \"b683f874-010b-48cc-b54e-050cbb485410\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"
Sep 17 00:13:52.176460 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.176205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7229633c-b031-453d-ab8e-9077fd3bbd59-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qf5cs\" (UID: \"7229633c-b031-453d-ab8e-9077fd3bbd59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"
Sep 17 00:13:52.176460 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.176262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b683f874-010b-48cc-b54e-050cbb485410-config\") pod \"service-ca-operator-cf7c776b7-x8j5l\" (UID: \"b683f874-010b-48cc-b54e-050cbb485410\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"
Sep 17 00:13:52.178080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.178054    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7229633c-b031-453d-ab8e-9077fd3bbd59-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qf5cs\" (UID: \"7229633c-b031-453d-ab8e-9077fd3bbd59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"
Sep 17 00:13:52.178223 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.178200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-stats-auth\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.178347 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.178272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b683f874-010b-48cc-b54e-050cbb485410-serving-cert\") pod \"service-ca-operator-cf7c776b7-x8j5l\" (UID: \"b683f874-010b-48cc-b54e-050cbb485410\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"
Sep 17 00:13:52.178559 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.178538    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-default-certificate\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.186358 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.186321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6l2r\" (UniqueName: \"kubernetes.io/projected/7229633c-b031-453d-ab8e-9077fd3bbd59-kube-api-access-f6l2r\") pod \"kube-storage-version-migrator-operator-6c8f84f897-qf5cs\" (UID: \"7229633c-b031-453d-ab8e-9077fd3bbd59\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"
Sep 17 00:13:52.186506 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.186368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpsth\" (UniqueName: \"kubernetes.io/projected/b683f874-010b-48cc-b54e-050cbb485410-kube-api-access-hpsth\") pod \"service-ca-operator-cf7c776b7-x8j5l\" (UID: \"b683f874-010b-48cc-b54e-050cbb485410\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"
Sep 17 00:13:52.186506 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.186433    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwv28\" (UniqueName: \"kubernetes.io/projected/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-kube-api-access-kwv28\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.242013 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.241973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:52.277078 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.276990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mcnq\" (UniqueName: \"kubernetes.io/projected/572e13ec-05ba-4339-8aaf-c728bbd2307a-kube-api-access-7mcnq\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.277078 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.277068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/572e13ec-05ba-4339-8aaf-c728bbd2307a-trusted-ca\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.277202 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.277137    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/572e13ec-05ba-4339-8aaf-c728bbd2307a-config\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.277202 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.277159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/572e13ec-05ba-4339-8aaf-c728bbd2307a-serving-cert\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.277825 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.277769    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/572e13ec-05ba-4339-8aaf-c728bbd2307a-config\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.277999 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.277979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/572e13ec-05ba-4339-8aaf-c728bbd2307a-trusted-ca\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.279635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.279611    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/572e13ec-05ba-4339-8aaf-c728bbd2307a-serving-cert\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.284602 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.284573    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mcnq\" (UniqueName: \"kubernetes.io/projected/572e13ec-05ba-4339-8aaf-c728bbd2307a-kube-api-access-7mcnq\") pod \"console-operator-696884fb9c-xxd5z\" (UID: \"572e13ec-05ba-4339-8aaf-c728bbd2307a\") " pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.293164 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.293130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:52.318111 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.318077    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"
Sep 17 00:13:52.325825 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.325777    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"
Sep 17 00:13:52.414317 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.414268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:13:52.592974 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.592945    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs"]
Sep 17 00:13:52.595461 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:13:52.595436    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7229633c_b031_453d_ab8e_9077fd3bbd59.slice/crio-1912bb50d5975eac32912d55e9d156814c2081a525006897420486621444d26f WatchSource:0}: Error finding container 1912bb50d5975eac32912d55e9d156814c2081a525006897420486621444d26f: Status 404 returned error can't find the container with id 1912bb50d5975eac32912d55e9d156814c2081a525006897420486621444d26f
Sep 17 00:13:52.598435 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.598344    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l"]
Sep 17 00:13:52.600544 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:13:52.600522    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb683f874_010b_48cc_b54e_050cbb485410.slice/crio-6fb02f4c641e274beb790e09e305acd0c32ab2e5a5282a363664278017c88707 WatchSource:0}: Error finding container 6fb02f4c641e274beb790e09e305acd0c32ab2e5a5282a363664278017c88707: Status 404 returned error can't find the container with id 6fb02f4c641e274beb790e09e305acd0c32ab2e5a5282a363664278017c88707
Sep 17 00:13:52.680642 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.680619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.680711 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.680670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:52.680768 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:52.680750    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 00:13:52.680816 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:52.680788    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle podName:d2521dc9-47dd-445a-a28d-d05c7a7eb9b6 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:53.680774153 +0000 UTC m=+234.207513609 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle") pod "router-default-7c7d59dc6d-jbgwm" (UID: "d2521dc9-47dd-445a-a28d-d05c7a7eb9b6") : configmap references non-existent config key: service-ca.crt
Sep 17 00:13:52.680860 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:52.680823    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs podName:d2521dc9-47dd-445a-a28d-d05c7a7eb9b6 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:53.680797406 +0000 UTC m=+234.207536862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs") pod "router-default-7c7d59dc6d-jbgwm" (UID: "d2521dc9-47dd-445a-a28d-d05c7a7eb9b6") : secret "router-metrics-certs-default" not found
Sep 17 00:13:52.683569 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:52.683546    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-xxd5z"]
Sep 17 00:13:52.685595 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:13:52.685575    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572e13ec_05ba_4339_8aaf_c728bbd2307a.slice/crio-b6c4927d76e7056e71cc0bd41300271ba08022ae046a4751ec820d069733c835 WatchSource:0}: Error finding container b6c4927d76e7056e71cc0bd41300271ba08022ae046a4751ec820d069733c835: Status 404 returned error can't find the container with id b6c4927d76e7056e71cc0bd41300271ba08022ae046a4751ec820d069733c835
Sep 17 00:13:53.586701 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:53.586622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" event={"ID":"572e13ec-05ba-4339-8aaf-c728bbd2307a","Type":"ContainerStarted","Data":"b6c4927d76e7056e71cc0bd41300271ba08022ae046a4751ec820d069733c835"}
Sep 17 00:13:53.589123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:53.589065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l" event={"ID":"b683f874-010b-48cc-b54e-050cbb485410","Type":"ContainerStarted","Data":"6fb02f4c641e274beb790e09e305acd0c32ab2e5a5282a363664278017c88707"}
Sep 17 00:13:53.590740 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:53.590686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs" event={"ID":"7229633c-b031-453d-ab8e-9077fd3bbd59","Type":"ContainerStarted","Data":"1912bb50d5975eac32912d55e9d156814c2081a525006897420486621444d26f"}
Sep 17 00:13:53.688520 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:53.688276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:53.688520 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:53.688367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:53.688520 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:53.688401    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 00:13:53.688520 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:53.688463    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs podName:d2521dc9-47dd-445a-a28d-d05c7a7eb9b6 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:55.688448809 +0000 UTC m=+236.215188265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs") pod "router-default-7c7d59dc6d-jbgwm" (UID: "d2521dc9-47dd-445a-a28d-d05c7a7eb9b6") : secret "router-metrics-certs-default" not found
Sep 17 00:13:53.688520 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:53.688494    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle podName:d2521dc9-47dd-445a-a28d-d05c7a7eb9b6 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:55.688477767 +0000 UTC m=+236.215217229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle") pod "router-default-7c7d59dc6d-jbgwm" (UID: "d2521dc9-47dd-445a-a28d-d05c7a7eb9b6") : configmap references non-existent config key: service-ca.crt
Sep 17 00:13:55.255394 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:55.255345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:55.355487 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:55.355448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:55.705140 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:55.705109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:55.705298 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:55.705170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:55.705298 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:55.705284    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 00:13:55.705367 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:55.705300    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle podName:d2521dc9-47dd-445a-a28d-d05c7a7eb9b6 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:59.705282071 +0000 UTC m=+240.232021547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle") pod "router-default-7c7d59dc6d-jbgwm" (UID: "d2521dc9-47dd-445a-a28d-d05c7a7eb9b6") : configmap references non-existent config key: service-ca.crt
Sep 17 00:13:55.705367 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:55.705321    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs podName:d2521dc9-47dd-445a-a28d-d05c7a7eb9b6 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:59.70531066 +0000 UTC m=+240.232050117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs") pod "router-default-7c7d59dc6d-jbgwm" (UID: "d2521dc9-47dd-445a-a28d-d05c7a7eb9b6") : secret "router-metrics-certs-default" not found
Sep 17 00:13:56.110330 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.110300    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7jkgf"]
Sep 17 00:13:56.112636 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.112617    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.115031 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.115003    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 00:13:56.116098 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.116077    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 00:13:56.116098 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.116089    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2jxk2\""
Sep 17 00:13:56.116250 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.116086    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 00:13:56.116250 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.116089    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 00:13:56.124162 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.124139    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7jkgf"]
Sep 17 00:13:56.130381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.130358    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:56.182924 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.182906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:56.209906 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.209886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-data-volume\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.209991 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.209910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.209991 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.209943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-crio-socket\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.210121 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.209996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gpbb\" (UniqueName: \"kubernetes.io/projected/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-api-access-4gpbb\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.210121 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.210029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.310888 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.310862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.311170 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.310951    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-data-volume\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.311170 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.310990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.311170 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:56.311025    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:56.311170 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.311044    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-crio-socket\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.311170 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:56.311086    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls podName:1e9aaf50-6db2-424c-83a8-8660c6aeb9ce nodeName:}" failed. No retries permitted until 2026-09-17 00:13:56.811069509 +0000 UTC m=+237.337808971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7jkgf" (UID: "1e9aaf50-6db2-424c-83a8-8660c6aeb9ce") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:56.311170 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.311108    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gpbb\" (UniqueName: \"kubernetes.io/projected/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-api-access-4gpbb\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.311170 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:56.311130    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 00:13:56.311450 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.311135    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-crio-socket\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.311450 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:56.311237    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm podName:1e9aaf50-6db2-424c-83a8-8660c6aeb9ce nodeName:}" failed. No retries permitted until 2026-09-17 00:13:56.811218311 +0000 UTC m=+237.337957783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7jkgf" (UID: "1e9aaf50-6db2-424c-83a8-8660c6aeb9ce") : configmap "kube-rbac-proxy" not found
Sep 17 00:13:56.311450 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.311285    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-data-volume\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.318199 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.318182    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gpbb\" (UniqueName: \"kubernetes.io/projected/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-api-access-4gpbb\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.605958 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.605937    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/0.log"
Sep 17 00:13:56.606058 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.605970    2565 generic.go:356] "Generic (PLEG): container finished" podID="572e13ec-05ba-4339-8aaf-c728bbd2307a" containerID="41d012d41dc7f7ea81c58bc1dfd8abb75efacace78c18a9f1ef6f7f813967072" exitCode=255
Sep 17 00:13:56.606058 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.606044    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" event={"ID":"572e13ec-05ba-4339-8aaf-c728bbd2307a","Type":"ContainerDied","Data":"41d012d41dc7f7ea81c58bc1dfd8abb75efacace78c18a9f1ef6f7f813967072"}
Sep 17 00:13:56.606302 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.606282    2565 scope.go:117] "RemoveContainer" containerID="41d012d41dc7f7ea81c58bc1dfd8abb75efacace78c18a9f1ef6f7f813967072"
Sep 17 00:13:56.607787 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.607761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l" event={"ID":"b683f874-010b-48cc-b54e-050cbb485410","Type":"ContainerStarted","Data":"7394874a3a2d44edc4df82981adc30bb319d87952ddb8fda80d312e98902e034"}
Sep 17 00:13:56.609350 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.609325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs" event={"ID":"7229633c-b031-453d-ab8e-9077fd3bbd59","Type":"ContainerStarted","Data":"f10a1342d2a01b184aa28aaad8b099a158ae209e11c6c48997603191724e4326"}
Sep 17 00:13:56.635408 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.635370    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs" podStartSLOduration=2.511667859 podStartE2EDuration="5.635358335s" totalImagesPullingTime="3.123690476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:13:56.634659354 +0000 UTC m=+237.161398833" watchObservedRunningTime="2026-09-17 00:13:56.635358335 +0000 UTC m=+237.162097812"
Sep 17 00:13:56.648634 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.648588    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l" podStartSLOduration=2.527483013 podStartE2EDuration="5.648571771s" totalImagesPullingTime="3.121088758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:13:56.647343666 +0000 UTC m=+237.174083145" watchObservedRunningTime="2026-09-17 00:13:56.648571771 +0000 UTC m=+237.175311250"
Sep 17 00:13:56.814859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.814833    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.814977 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:56.814931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:56.814977 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:56.814965    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 00:13:56.815070 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:56.815044    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm podName:1e9aaf50-6db2-424c-83a8-8660c6aeb9ce nodeName:}" failed. No retries permitted until 2026-09-17 00:13:57.81502587 +0000 UTC m=+238.341765332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7jkgf" (UID: "1e9aaf50-6db2-424c-83a8-8660c6aeb9ce") : configmap "kube-rbac-proxy" not found
Sep 17 00:13:56.815118 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:56.815070    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:56.815157 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:56.815130    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls podName:1e9aaf50-6db2-424c-83a8-8660c6aeb9ce nodeName:}" failed. No retries permitted until 2026-09-17 00:13:57.815114587 +0000 UTC m=+238.341854050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7jkgf" (UID: "1e9aaf50-6db2-424c-83a8-8660c6aeb9ce") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:57.133786 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.133750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:57.231345 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.231317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:57.328518 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.328488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:57.539695 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.539628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:57.590252 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.590224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:57.614296 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.614276    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/1.log"
Sep 17 00:13:57.614684 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.614668    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/0.log"
Sep 17 00:13:57.614754 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.614703    2565 generic.go:356] "Generic (PLEG): container finished" podID="572e13ec-05ba-4339-8aaf-c728bbd2307a" containerID="e0d664a9cbaa010af9079b52a04a682df91bac7e020161d26dcde5fe1fc0770f" exitCode=255
Sep 17 00:13:57.614823 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.614780    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" event={"ID":"572e13ec-05ba-4339-8aaf-c728bbd2307a","Type":"ContainerDied","Data":"e0d664a9cbaa010af9079b52a04a682df91bac7e020161d26dcde5fe1fc0770f"}
Sep 17 00:13:57.614883 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.614848    2565 scope.go:117] "RemoveContainer" containerID="41d012d41dc7f7ea81c58bc1dfd8abb75efacace78c18a9f1ef6f7f813967072"
Sep 17 00:13:57.615046 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.615026    2565 scope.go:117] "RemoveContainer" containerID="e0d664a9cbaa010af9079b52a04a682df91bac7e020161d26dcde5fe1fc0770f"
Sep 17 00:13:57.615240 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:57.615210    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-xxd5z_openshift-console-operator(572e13ec-05ba-4339-8aaf-c728bbd2307a)\"" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" podUID="572e13ec-05ba-4339-8aaf-c728bbd2307a"
Sep 17 00:13:57.821772 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.821746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:57.822652 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.822632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:57.822722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.822690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:57.822779 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:57.822740    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 00:13:57.822779 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:57.822772    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:57.822903 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:57.822819    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm podName:1e9aaf50-6db2-424c-83a8-8660c6aeb9ce nodeName:}" failed. No retries permitted until 2026-09-17 00:13:59.822783985 +0000 UTC m=+240.349523444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7jkgf" (UID: "1e9aaf50-6db2-424c-83a8-8660c6aeb9ce") : configmap "kube-rbac-proxy" not found
Sep 17 00:13:57.822903 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:57.822837    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls podName:1e9aaf50-6db2-424c-83a8-8660c6aeb9ce nodeName:}" failed. No retries permitted until 2026-09-17 00:13:59.822826851 +0000 UTC m=+240.349566307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7jkgf" (UID: "1e9aaf50-6db2-424c-83a8-8660c6aeb9ce") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:57.921210 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:57.921180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:58.197499 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:58.197403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:58.284153 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:58.284126    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m5sg5_56bd23f3-6be8-4b22-ad3c-ba0156a5f08e/dns-node-resolver/0.log"
Sep 17 00:13:58.619470 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:58.619446    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/1.log"
Sep 17 00:13:58.619849 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:58.619751    2565 scope.go:117] "RemoveContainer" containerID="e0d664a9cbaa010af9079b52a04a682df91bac7e020161d26dcde5fe1fc0770f"
Sep 17 00:13:58.619955 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:58.619934    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-xxd5z_openshift-console-operator(572e13ec-05ba-4339-8aaf-c728bbd2307a)\"" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" podUID="572e13ec-05ba-4339-8aaf-c728bbd2307a"
Sep 17 00:13:59.283640 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.283615    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-whcmk_37dbbfd8-ffbf-4601-b41b-b23df76d380f/node-ca/0.log"
Sep 17 00:13:59.412544 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.412495    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-4ntz6"]
Sep 17 00:13:59.415059 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.415041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-4ntz6"
Sep 17 00:13:59.417438 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.417414    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 00:13:59.417551 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.417495    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 00:13:59.418494 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.418472    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vwnfs\""
Sep 17 00:13:59.418584 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.418545    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 00:13:59.418666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.418649    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 00:13:59.423925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.423905    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-4ntz6"]
Sep 17 00:13:59.448931 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.448908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:59.500698 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.500672    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:13:59.534354 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.534312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/82910bab-7045-4b68-ac78-596046f9f243-signing-cabundle\") pod \"service-ca-568869fdc5-4ntz6\" (UID: \"82910bab-7045-4b68-ac78-596046f9f243\") " pod="openshift-service-ca/service-ca-568869fdc5-4ntz6"
Sep 17 00:13:59.534354 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.534349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmq62\" (UniqueName: \"kubernetes.io/projected/82910bab-7045-4b68-ac78-596046f9f243-kube-api-access-xmq62\") pod \"service-ca-568869fdc5-4ntz6\" (UID: \"82910bab-7045-4b68-ac78-596046f9f243\") " pod="openshift-service-ca/service-ca-568869fdc5-4ntz6"
Sep 17 00:13:59.534478 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.534462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/82910bab-7045-4b68-ac78-596046f9f243-signing-key\") pod \"service-ca-568869fdc5-4ntz6\" (UID: \"82910bab-7045-4b68-ac78-596046f9f243\") " pod="openshift-service-ca/service-ca-568869fdc5-4ntz6"
Sep 17 00:13:59.635083 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.635057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmq62\" (UniqueName: \"kubernetes.io/projected/82910bab-7045-4b68-ac78-596046f9f243-kube-api-access-xmq62\") pod \"service-ca-568869fdc5-4ntz6\" (UID: \"82910bab-7045-4b68-ac78-596046f9f243\") " pod="openshift-service-ca/service-ca-568869fdc5-4ntz6"
Sep 17 00:13:59.635417 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.635170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/82910bab-7045-4b68-ac78-596046f9f243-signing-key\") pod \"service-ca-568869fdc5-4ntz6\" (UID: \"82910bab-7045-4b68-ac78-596046f9f243\") " pod="openshift-service-ca/service-ca-568869fdc5-4ntz6"
Sep 17 00:13:59.635417 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.635236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/82910bab-7045-4b68-ac78-596046f9f243-signing-cabundle\") pod \"service-ca-568869fdc5-4ntz6\" (UID: \"82910bab-7045-4b68-ac78-596046f9f243\") " pod="openshift-service-ca/service-ca-568869fdc5-4ntz6"
Sep 17 00:13:59.635877 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.635860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/82910bab-7045-4b68-ac78-596046f9f243-signing-cabundle\") pod \"service-ca-568869fdc5-4ntz6\" (UID: \"82910bab-7045-4b68-ac78-596046f9f243\") " pod="openshift-service-ca/service-ca-568869fdc5-4ntz6"
Sep 17 00:13:59.637481 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.637463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/82910bab-7045-4b68-ac78-596046f9f243-signing-key\") pod \"service-ca-568869fdc5-4ntz6\" (UID: \"82910bab-7045-4b68-ac78-596046f9f243\") " pod="openshift-service-ca/service-ca-568869fdc5-4ntz6"
Sep 17 00:13:59.643001 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.642974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmq62\" (UniqueName: \"kubernetes.io/projected/82910bab-7045-4b68-ac78-596046f9f243-kube-api-access-xmq62\") pod \"service-ca-568869fdc5-4ntz6\" (UID: \"82910bab-7045-4b68-ac78-596046f9f243\") " pod="openshift-service-ca/service-ca-568869fdc5-4ntz6"
Sep 17 00:13:59.724917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.724893    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-4ntz6"
Sep 17 00:13:59.735960 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.735927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:59.736074 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.736039    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:13:59.736074 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:59.736051    2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 17 00:13:59.736183 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:59.736106    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs podName:d2521dc9-47dd-445a-a28d-d05c7a7eb9b6 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:07.736087329 +0000 UTC m=+248.262826832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs") pod "router-default-7c7d59dc6d-jbgwm" (UID: "d2521dc9-47dd-445a-a28d-d05c7a7eb9b6") : secret "router-metrics-certs-default" not found
Sep 17 00:13:59.736183 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:59.736136    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle podName:d2521dc9-47dd-445a-a28d-d05c7a7eb9b6 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:07.736123477 +0000 UTC m=+248.262862933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle") pod "router-default-7c7d59dc6d-jbgwm" (UID: "d2521dc9-47dd-445a-a28d-d05c7a7eb9b6") : configmap references non-existent config key: service-ca.crt
Sep 17 00:13:59.837189 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.837165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:59.837341 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.837223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:59.837341 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:59.837295    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:59.837452 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:13:59.837355    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls podName:1e9aaf50-6db2-424c-83a8-8660c6aeb9ce nodeName:}" failed. No retries permitted until 2026-09-17 00:14:03.837337757 +0000 UTC m=+244.364077213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7jkgf" (UID: "1e9aaf50-6db2-424c-83a8-8660c6aeb9ce") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:59.837744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.837725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:13:59.883864 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.883837    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rcljv_f492cc67-feac-490d-9c0a-60489a020da3/serve-healthcheck-canary/0.log"
Sep 17 00:13:59.993445 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:13:59.993410    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-4ntz6"]
Sep 17 00:13:59.996032 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:13:59.995999    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82910bab_7045_4b68_ac78_596046f9f243.slice/crio-2878308b917bbc0a90f138db988bd582f04bb64022bfa7b40e0514bad7f91356 WatchSource:0}: Error finding container 2878308b917bbc0a90f138db988bd582f04bb64022bfa7b40e0514bad7f91356: Status 404 returned error can't find the container with id 2878308b917bbc0a90f138db988bd582f04bb64022bfa7b40e0514bad7f91356
Sep 17 00:14:00.290669 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:00.290579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:00.627406 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:00.627368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-4ntz6" event={"ID":"82910bab-7045-4b68-ac78-596046f9f243","Type":"ContainerStarted","Data":"49ace2b9f1425850101b43381d97f5fec847cf19b3bf1c546c34a014bf2a192c"}
Sep 17 00:14:00.627598 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:00.627420    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-4ntz6" event={"ID":"82910bab-7045-4b68-ac78-596046f9f243","Type":"ContainerStarted","Data":"2878308b917bbc0a90f138db988bd582f04bb64022bfa7b40e0514bad7f91356"}
Sep 17 00:14:00.643954 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:00.643901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-4ntz6" podStartSLOduration=1.643881692 podStartE2EDuration="1.643881692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:00.641925421 +0000 UTC m=+241.168664910" watchObservedRunningTime="2026-09-17 00:14:00.643881692 +0000 UTC m=+241.170621169"
Sep 17 00:14:01.526523 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:01.526481    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:01.657571 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:01.657536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:01.758130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:01.758093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:01.858723 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:01.858682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:01.959987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:01.959949    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:02.059122 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:02.059077    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:02.211926 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:02.211797    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:02.415025 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:02.414983    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:14:02.415213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:02.415052    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:14:02.415401 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:02.415388    2565 scope.go:117] "RemoveContainer" containerID="e0d664a9cbaa010af9079b52a04a682df91bac7e020161d26dcde5fe1fc0770f"
Sep 17 00:14:02.415564 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:02.415547    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-xxd5z_openshift-console-operator(572e13ec-05ba-4339-8aaf-c728bbd2307a)\"" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" podUID="572e13ec-05ba-4339-8aaf-c728bbd2307a"
Sep 17 00:14:03.100568 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:03.100524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:03.423023 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:03.422925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:03.624216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:03.624180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:03.812298 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:03.812256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:03.871417 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:03.871381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:14:03.871580 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:03.871554    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:14:03.871670 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:03.871659    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls podName:1e9aaf50-6db2-424c-83a8-8660c6aeb9ce nodeName:}" failed. No retries permitted until 2026-09-17 00:14:11.871638862 +0000 UTC m=+252.398378333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7jkgf" (UID: "1e9aaf50-6db2-424c-83a8-8660c6aeb9ce") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:14:04.015076 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:04.015039    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:04.214130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:04.214027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:05.020306 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:05.020259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:05.410074 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:05.410011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:05.460277 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:05.460194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:05.618192 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:05.618142    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:05.821511 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:05.821468    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:06.013604 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:06.013570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:06.211795 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:06.211702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:06.397151 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:06.397107    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:07.413987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:07.413943    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:07.616925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:07.616877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:07.808176 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:07.808142    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:14:07.808381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:07.808250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:14:07.809012 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:07.808985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-service-ca-bundle\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:14:07.809473 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:07.809433    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:07.811015 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:07.810994    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2521dc9-47dd-445a-a28d-d05c7a7eb9b6-metrics-certs\") pod \"router-default-7c7d59dc6d-jbgwm\" (UID: \"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6\") " pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:14:07.911267 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:07.911184    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:07.935894 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:07.935831    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-6n77n\""
Sep 17 00:14:07.943313 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:07.943237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:14:08.015095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:08.015047    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:08.210786 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:08.210673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:08.247092 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:08.247057    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7c7d59dc6d-jbgwm"]
Sep 17 00:14:08.250171 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:08.250142    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2521dc9_47dd_445a_a28d_d05c7a7eb9b6.slice/crio-9365a70cb07e6ffbf4e912d5de67e323da292f5ff8b1dd50780011daa62640ce WatchSource:0}: Error finding container 9365a70cb07e6ffbf4e912d5de67e323da292f5ff8b1dd50780011daa62640ce: Status 404 returned error can't find the container with id 9365a70cb07e6ffbf4e912d5de67e323da292f5ff8b1dd50780011daa62640ce
Sep 17 00:14:08.656321 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:08.656284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm" event={"ID":"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6","Type":"ContainerStarted","Data":"d790d8f68fa0439fea1f613fb15fc7b0957d8a1a7d761651e2b7346c81c0ad39"}
Sep 17 00:14:08.656717 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:08.656344    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm" event={"ID":"d2521dc9-47dd-445a-a28d-d05c7a7eb9b6","Type":"ContainerStarted","Data":"9365a70cb07e6ffbf4e912d5de67e323da292f5ff8b1dd50780011daa62640ce"}
Sep 17 00:14:08.674175 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:08.674108    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm" podStartSLOduration=17.67408868 podStartE2EDuration="17.67408868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:08.673648429 +0000 UTC m=+249.200387929" watchObservedRunningTime="2026-09-17 00:14:08.67408868 +0000 UTC m=+249.200828157"
Sep 17 00:14:08.944480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:08.944260    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:14:08.949837 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:08.949749    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:14:09.215756 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:09.215645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:09.615666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:09.615631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:09.660621 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:09.660591    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:14:09.662040 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:09.662018    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7c7d59dc6d-jbgwm"
Sep 17 00:14:09.812699 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:09.812645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:10.014569 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:10.014471    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:10.212044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:10.211997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:11.210285 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:11.210239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:11.613619 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:11.613575    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:11.641637 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:11.641605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:14:11.643913 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:11.643896    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa2489c7-1864-4abe-bc0f-4bfea881a246-metrics-certs\") pod \"network-metrics-daemon-w28gk\" (UID: \"fa2489c7-1864-4abe-bc0f-4bfea881a246\") " pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:14:11.811452 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:11.811423    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:11.823906 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:11.823881    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxlvp\""
Sep 17 00:14:11.831759 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:11.831735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w28gk"
Sep 17 00:14:11.944400 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:11.944371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:14:11.946468 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:11.946446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1e9aaf50-6db2-424c-83a8-8660c6aeb9ce-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7jkgf\" (UID: \"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce\") " pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:14:12.010583 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:12.010548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:12.026665 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:12.026645    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2jxk2\""
Sep 17 00:14:12.032698 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:12.032682    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7jkgf"
Sep 17 00:14:12.097463 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:12.097441    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w28gk"]
Sep 17 00:14:12.100455 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:12.100430    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2489c7_1864_4abe_bc0f_4bfea881a246.slice/crio-b47a74f6de7b990e70e3ce0042529618ae3aaead1a47114ef6c17c91da2850c8 WatchSource:0}: Error finding container b47a74f6de7b990e70e3ce0042529618ae3aaead1a47114ef6c17c91da2850c8: Status 404 returned error can't find the container with id b47a74f6de7b990e70e3ce0042529618ae3aaead1a47114ef6c17c91da2850c8
Sep 17 00:14:12.212701 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:12.212643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:12.298001 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:12.297902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7jkgf"]
Sep 17 00:14:12.300409 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:12.300386    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9aaf50_6db2_424c_83a8_8660c6aeb9ce.slice/crio-fd52d662b09eb18dc34abcdab4a265b4b3bf90dca0820ca82f9d64c8dd6859d6 WatchSource:0}: Error finding container fd52d662b09eb18dc34abcdab4a265b4b3bf90dca0820ca82f9d64c8dd6859d6: Status 404 returned error can't find the container with id fd52d662b09eb18dc34abcdab4a265b4b3bf90dca0820ca82f9d64c8dd6859d6
Sep 17 00:14:12.670602 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:12.670573    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jkgf" event={"ID":"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce","Type":"ContainerStarted","Data":"9466ca13fcff24ebd74614599ed2f4cc396fee1025d3ff50aa83061801e3a641"}
Sep 17 00:14:12.670764 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:12.670627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jkgf" event={"ID":"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce","Type":"ContainerStarted","Data":"fd52d662b09eb18dc34abcdab4a265b4b3bf90dca0820ca82f9d64c8dd6859d6"}
Sep 17 00:14:12.671884 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:12.671842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w28gk" event={"ID":"fa2489c7-1864-4abe-bc0f-4bfea881a246","Type":"ContainerStarted","Data":"b47a74f6de7b990e70e3ce0042529618ae3aaead1a47114ef6c17c91da2850c8"}
Sep 17 00:14:13.679342 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:13.679304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w28gk" event={"ID":"fa2489c7-1864-4abe-bc0f-4bfea881a246","Type":"ContainerStarted","Data":"d08f5b84aef43a29da2f6c4bc029b468798a54ff78abc701b78a76c9aed3092e"}
Sep 17 00:14:13.679788 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:13.679379    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w28gk" event={"ID":"fa2489c7-1864-4abe-bc0f-4bfea881a246","Type":"ContainerStarted","Data":"3a5b4c308c81bd2d203d797dde1fb00e98257d49faa9f7fcb4fa90504e644d64"}
Sep 17 00:14:13.681917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:13.681885    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jkgf" event={"ID":"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce","Type":"ContainerStarted","Data":"96ef2eef41b75fe6ade31a8dbe95ed517055d8455637f243816e6054246236e6"}
Sep 17 00:14:13.694307 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:13.694256    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w28gk" podStartSLOduration=253.903997682 podStartE2EDuration="4m14.694240274s" totalImagesPullingTime="790.242592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:13.69387513 +0000 UTC m=+254.220614636" watchObservedRunningTime="2026-09-17 00:14:13.694240274 +0000 UTC m=+254.220979821"
Sep 17 00:14:14.921117 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:14.921021    2565 scope.go:117] "RemoveContainer" containerID="e0d664a9cbaa010af9079b52a04a682df91bac7e020161d26dcde5fe1fc0770f"
Sep 17 00:14:15.691080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:15.691039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7jkgf" event={"ID":"1e9aaf50-6db2-424c-83a8-8660c6aeb9ce","Type":"ContainerStarted","Data":"59054dbd47ea7a50c754a33ec0d591654842dde2e384142341fe2ed6f096ea64"}
Sep 17 00:14:15.692578 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:15.692555    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:14:15.692970 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:15.692954    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/1.log"
Sep 17 00:14:15.693016 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:15.692986    2565 generic.go:356] "Generic (PLEG): container finished" podID="572e13ec-05ba-4339-8aaf-c728bbd2307a" containerID="5c9014f59f1d09698719c7b259b8aee9cfd36759b22e566f744235b4c39a6ebe" exitCode=255
Sep 17 00:14:15.693066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:15.693015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" event={"ID":"572e13ec-05ba-4339-8aaf-c728bbd2307a","Type":"ContainerDied","Data":"5c9014f59f1d09698719c7b259b8aee9cfd36759b22e566f744235b4c39a6ebe"}
Sep 17 00:14:15.693066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:15.693048    2565 scope.go:117] "RemoveContainer" containerID="e0d664a9cbaa010af9079b52a04a682df91bac7e020161d26dcde5fe1fc0770f"
Sep 17 00:14:15.693327 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:15.693303    2565 scope.go:117] "RemoveContainer" containerID="5c9014f59f1d09698719c7b259b8aee9cfd36759b22e566f744235b4c39a6ebe"
Sep 17 00:14:15.693481 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:15.693464    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-xxd5z_openshift-console-operator(572e13ec-05ba-4339-8aaf-c728bbd2307a)\"" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" podUID="572e13ec-05ba-4339-8aaf-c728bbd2307a"
Sep 17 00:14:15.707104 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:15.707059    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7jkgf" podStartSLOduration=17.485756958 podStartE2EDuration="19.707044248s" totalImagesPullingTime="2.22128729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:13:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:15.706073383 +0000 UTC m=+256.232812855" watchObservedRunningTime="2026-09-17 00:14:15.707044248 +0000 UTC m=+256.233783727"
Sep 17 00:14:16.676411 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:16.676368    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:16.699853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:16.699822    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:14:16.723363 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:16.723329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:19.011331 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.011301    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bd75f8759-tq8ql"]
Sep 17 00:14:19.013611 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.013589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.016101 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.016076    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j25ch\""
Sep 17 00:14:19.016213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.016080    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 00:14:19.016213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.016080    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 00:14:19.016293 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.016229    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 00:14:19.021357 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.021338    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 00:14:19.025946 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.025925    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bd75f8759-tq8ql"]
Sep 17 00:14:19.067550 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.067520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:19.101400 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.101375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-installation-pull-secrets\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.101539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.101409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-registry-certificates\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.101539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.101429    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-registry-tls\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.101539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.101443    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swnsq\" (UniqueName: \"kubernetes.io/projected/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-kube-api-access-swnsq\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.101539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.101485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-bound-sa-token\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.101539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.101509    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-trusted-ca\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.101687 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.101548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-ca-trust-extracted\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.101687 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.101569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-image-registry-private-configuration\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.161816 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.161753    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:19.202108 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.202083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-registry-certificates\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.202222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.202111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-registry-tls\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.202222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.202129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swnsq\" (UniqueName: \"kubernetes.io/projected/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-kube-api-access-swnsq\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.202222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.202150    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-bound-sa-token\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.202222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.202179    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-trusted-ca\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.202222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.202221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-ca-trust-extracted\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.202467 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.202252    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-image-registry-private-configuration\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.202467 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.202305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-installation-pull-secrets\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.202733 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.202693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-ca-trust-extracted\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.202996 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.202977    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-registry-certificates\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.203111 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.203094    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-trusted-ca\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.204732 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.204707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-installation-pull-secrets\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.205144 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.205125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-registry-tls\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.205186 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.205125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-image-registry-private-configuration\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.212409 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.212387    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-bound-sa-token\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.212744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.212728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swnsq\" (UniqueName: \"kubernetes.io/projected/0a2a5ace-6c6a-4a18-9f2c-582583bc805b-kube-api-access-swnsq\") pod \"image-registry-7bd75f8759-tq8ql\" (UID: \"0a2a5ace-6c6a-4a18-9f2c-582583bc805b\") " pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.262227 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.262169    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:19.323626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.323604    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.610997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.610964    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bd75f8759-tq8ql"]
Sep 17 00:14:19.613052 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:19.613025    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a2a5ace_6c6a_4a18_9f2c_582583bc805b.slice/crio-b6348686002f177cce8b37e8b2045118244c45e20293acc87ed4415b392562a1 WatchSource:0}: Error finding container b6348686002f177cce8b37e8b2045118244c45e20293acc87ed4415b392562a1: Status 404 returned error can't find the container with id b6348686002f177cce8b37e8b2045118244c45e20293acc87ed4415b392562a1
Sep 17 00:14:19.709594 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.709567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql" event={"ID":"0a2a5ace-6c6a-4a18-9f2c-582583bc805b","Type":"ContainerStarted","Data":"0dc98d1027ae52b033ebee4d553756070199ca959f3e976a1a50a7137b452ea6"}
Sep 17 00:14:19.709730 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.709616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql" event={"ID":"0a2a5ace-6c6a-4a18-9f2c-582583bc805b","Type":"ContainerStarted","Data":"b6348686002f177cce8b37e8b2045118244c45e20293acc87ed4415b392562a1"}
Sep 17 00:14:19.709730 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.709644    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:19.727513 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:19.727465    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql" podStartSLOduration=1.727445795 podStartE2EDuration="1.727445795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:19.726645952 +0000 UTC m=+260.253385435" watchObservedRunningTime="2026-09-17 00:14:19.727445795 +0000 UTC m=+260.254185278"
Sep 17 00:14:22.414950 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:22.414873    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:14:22.414950 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:22.414929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:14:22.415325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:22.415243    2565 scope.go:117] "RemoveContainer" containerID="5c9014f59f1d09698719c7b259b8aee9cfd36759b22e566f744235b4c39a6ebe"
Sep 17 00:14:22.415408 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:22.415387    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-xxd5z_openshift-console-operator(572e13ec-05ba-4339-8aaf-c728bbd2307a)\"" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" podUID="572e13ec-05ba-4339-8aaf-c728bbd2307a"
Sep 17 00:14:26.720132 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:26.720096    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:26.819876 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:26.819798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:26.879486 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:26.879449    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2"]
Sep 17 00:14:26.880351 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:26.880324    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:26.883844 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:26.883825    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2"
Sep 17 00:14:26.886186 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:26.886161    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 17 00:14:26.886311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:26.886262    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-62stc\""
Sep 17 00:14:26.891504 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:26.891478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2"]
Sep 17 00:14:26.957427 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:26.957382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/36b5fa3c-265f-476c-b8e0-0b16b4b18bee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-wvpk2\" (UID: \"36b5fa3c-265f-476c-b8e0-0b16b4b18bee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2"
Sep 17 00:14:27.058009 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:27.057967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/36b5fa3c-265f-476c-b8e0-0b16b4b18bee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-wvpk2\" (UID: \"36b5fa3c-265f-476c-b8e0-0b16b4b18bee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2"
Sep 17 00:14:27.058174 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:27.058121    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 17 00:14:27.058214 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:27.058193    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36b5fa3c-265f-476c-b8e0-0b16b4b18bee-tls-certificates podName:36b5fa3c-265f-476c-b8e0-0b16b4b18bee nodeName:}" failed. No retries permitted until 2026-09-17 00:14:27.558176468 +0000 UTC m=+268.084915925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/36b5fa3c-265f-476c-b8e0-0b16b4b18bee-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-wvpk2" (UID: "36b5fa3c-265f-476c-b8e0-0b16b4b18bee") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 17 00:14:27.419917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:27.419798    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:27.561546 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:27.561496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/36b5fa3c-265f-476c-b8e0-0b16b4b18bee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-wvpk2\" (UID: \"36b5fa3c-265f-476c-b8e0-0b16b4b18bee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2"
Sep 17 00:14:27.563980 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:27.563949    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/36b5fa3c-265f-476c-b8e0-0b16b4b18bee-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-wvpk2\" (UID: \"36b5fa3c-265f-476c-b8e0-0b16b4b18bee\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2"
Sep 17 00:14:27.794312 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:27.794269    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2"
Sep 17 00:14:28.061378 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:28.061294    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2"]
Sep 17 00:14:28.065367 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:28.065339    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b5fa3c_265f_476c_b8e0_0b16b4b18bee.slice/crio-5791c358703d4adeed0ba57d25f879d99d3ffdc99883295564055249261fa927 WatchSource:0}: Error finding container 5791c358703d4adeed0ba57d25f879d99d3ffdc99883295564055249261fa927: Status 404 returned error can't find the container with id 5791c358703d4adeed0ba57d25f879d99d3ffdc99883295564055249261fa927
Sep 17 00:14:28.740440 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:28.740403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2" event={"ID":"36b5fa3c-265f-476c-b8e0-0b16b4b18bee","Type":"ContainerStarted","Data":"5791c358703d4adeed0ba57d25f879d99d3ffdc99883295564055249261fa927"}
Sep 17 00:14:30.749189 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.749157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2" event={"ID":"36b5fa3c-265f-476c-b8e0-0b16b4b18bee","Type":"ContainerStarted","Data":"ef7b6fd0c6e492ed608d816ef74fe16cf88f889ecbe2c20daf4000f9e8f7711a"}
Sep 17 00:14:30.749563 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.749359    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2"
Sep 17 00:14:30.754038 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.754010    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2"
Sep 17 00:14:30.765792 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.765747    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-wvpk2" podStartSLOduration=3.094974827 podStartE2EDuration="4.765731888s" totalImagesPullingTime="1.670757061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:30.764489994 +0000 UTC m=+271.291229483" watchObservedRunningTime="2026-09-17 00:14:30.765731888 +0000 UTC m=+271.292471366"
Sep 17 00:14:30.901774 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.901733    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:30.932308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.932282    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"]
Sep 17 00:14:30.934214 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.934200    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:30.936632 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.936614    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-dms2p\""
Sep 17 00:14:30.936899 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.936877    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 00:14:30.937027 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.936929    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 00:14:30.937027 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.936928    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 17 00:14:30.937027 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.936936    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 17 00:14:30.937173 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.936938    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 00:14:30.944996 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.944976    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"]
Sep 17 00:14:30.961793 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.961766    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:30.986817 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.986779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/962c83c1-cd83-44cc-b359-0b5bfe55d637-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:30.986899 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.986829    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4958m\" (UniqueName: \"kubernetes.io/projected/962c83c1-cd83-44cc-b359-0b5bfe55d637-kube-api-access-4958m\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:30.986946 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.986910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962c83c1-cd83-44cc-b359-0b5bfe55d637-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:30.986985 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:30.986947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/962c83c1-cd83-44cc-b359-0b5bfe55d637-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:31.088040 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.088019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962c83c1-cd83-44cc-b359-0b5bfe55d637-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:31.088128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.088058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/962c83c1-cd83-44cc-b359-0b5bfe55d637-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:31.088128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.088100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/962c83c1-cd83-44cc-b359-0b5bfe55d637-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:31.088128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.088122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4958m\" (UniqueName: \"kubernetes.io/projected/962c83c1-cd83-44cc-b359-0b5bfe55d637-kube-api-access-4958m\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:31.088267 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:31.088248    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 17 00:14:31.088333 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:31.088321    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/962c83c1-cd83-44cc-b359-0b5bfe55d637-prometheus-operator-tls podName:962c83c1-cd83-44cc-b359-0b5bfe55d637 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:31.588301965 +0000 UTC m=+272.115041438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/962c83c1-cd83-44cc-b359-0b5bfe55d637-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-xhsgs" (UID: "962c83c1-cd83-44cc-b359-0b5bfe55d637") : secret "prometheus-operator-tls" not found
Sep 17 00:14:31.089385 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.089360    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962c83c1-cd83-44cc-b359-0b5bfe55d637-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:31.090389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.090372    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/962c83c1-cd83-44cc-b359-0b5bfe55d637-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:31.096301 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.096279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4958m\" (UniqueName: \"kubernetes.io/projected/962c83c1-cd83-44cc-b359-0b5bfe55d637-kube-api-access-4958m\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:31.500523 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.500468    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:31.592615 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.592591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/962c83c1-cd83-44cc-b359-0b5bfe55d637-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:31.594677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.594653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/962c83c1-cd83-44cc-b359-0b5bfe55d637-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-xhsgs\" (UID: \"962c83c1-cd83-44cc-b359-0b5bfe55d637\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:31.677736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.677712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:31.724636 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.724608    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:31.842845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:31.842830    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"
Sep 17 00:14:32.107997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:32.107932    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs"]
Sep 17 00:14:32.110535 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:32.110503    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962c83c1_cd83_44cc_b359_0b5bfe55d637.slice/crio-d6069eb22b20f1103fcbe9258918c0e3073da425baa566f56cce2144695b2707 WatchSource:0}: Error finding container d6069eb22b20f1103fcbe9258918c0e3073da425baa566f56cce2144695b2707: Status 404 returned error can't find the container with id d6069eb22b20f1103fcbe9258918c0e3073da425baa566f56cce2144695b2707
Sep 17 00:14:32.756995 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:32.756954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs" event={"ID":"962c83c1-cd83-44cc-b359-0b5bfe55d637","Type":"ContainerStarted","Data":"d6069eb22b20f1103fcbe9258918c0e3073da425baa566f56cce2144695b2707"}
Sep 17 00:14:33.744970 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:33.744932    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:33.762313 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:33.762243    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs" event={"ID":"962c83c1-cd83-44cc-b359-0b5bfe55d637","Type":"ContainerStarted","Data":"d030ae56d34b8a217b76c1a5e64eda17044ea6ae63840193290c912173b6c901"}
Sep 17 00:14:33.762313 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:33.762302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs" event={"ID":"962c83c1-cd83-44cc-b359-0b5bfe55d637","Type":"ContainerStarted","Data":"8d8563c8ca2f3da879d928edbeb2a7afed9985441c3deda6034e5d1fadca8a27"}
Sep 17 00:14:33.778390 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:33.778310    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-xhsgs" podStartSLOduration=2.381024158 podStartE2EDuration="3.778297077s" totalImagesPullingTime="1.397272919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:33.77694242 +0000 UTC m=+274.303681899" watchObservedRunningTime="2026-09-17 00:14:33.778297077 +0000 UTC m=+274.305036555"
Sep 17 00:14:33.920924 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:33.920897    2565 scope.go:117] "RemoveContainer" containerID="5c9014f59f1d09698719c7b259b8aee9cfd36759b22e566f744235b4c39a6ebe"
Sep 17 00:14:33.921104 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:33.921081    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-xxd5z_openshift-console-operator(572e13ec-05ba-4339-8aaf-c728bbd2307a)\"" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" podUID="572e13ec-05ba-4339-8aaf-c728bbd2307a"
Sep 17 00:14:35.032400 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.032369    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:35.249296 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.249270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:35.291069 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.291011    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wsxnb"]
Sep 17 00:14:35.294662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.294643    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.297641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.297618    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 00:14:35.297896 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.297877    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-klwx5\""
Sep 17 00:14:35.298003 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.297933    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 00:14:35.298003 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.297933    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 00:14:35.319082 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.319058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-root\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.319252 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.319236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrqf9\" (UniqueName: \"kubernetes.io/projected/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-kube-api-access-mrqf9\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.319390 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.319374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-accelerators-collector-config\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.319492 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.319478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-sys\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.319591 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.319577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-textfile\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.319687 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.319671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-wtmp\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.319795 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.319782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-tls\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.319933 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.319918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-metrics-client-ca\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.320028 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.320015    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.332847 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.332817    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:35.393787 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.393759    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:35.420949 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.420927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-wtmp\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421056 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.420975    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-tls\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421056 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-metrics-client-ca\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421056 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-root\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrqf9\" (UniqueName: \"kubernetes.io/projected/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-kube-api-access-mrqf9\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421121    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-wtmp\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-accelerators-collector-config\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-sys\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-root\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-textfile\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421540 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-textfile\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421629 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-metrics-client-ca\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421695 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.421680    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-sys\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.421745 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:35.421736    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 00:14:35.421798 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:35.421790    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-tls podName:d5bac9f2-55e3-4ed0-a497-74cd8fca955a nodeName:}" failed. No retries permitted until 2026-09-17 00:14:35.921773665 +0000 UTC m=+276.448513126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-tls") pod "node-exporter-wsxnb" (UID: "d5bac9f2-55e3-4ed0-a497-74cd8fca955a") : secret "node-exporter-tls" not found
Sep 17 00:14:35.422071 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.422051    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-accelerators-collector-config\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.424264 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.424244    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.429644 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.429604    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrqf9\" (UniqueName: \"kubernetes.io/projected/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-kube-api-access-mrqf9\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.544864 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.544830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:35.645925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.645894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:35.709931 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.709904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:35.761382 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.761359    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:35.868117 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.868066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:35.923949 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.923927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-tls\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.926117 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.926092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d5bac9f2-55e3-4ed0-a497-74cd8fca955a-node-exporter-tls\") pod \"node-exporter-wsxnb\" (UID: \"d5bac9f2-55e3-4ed0-a497-74cd8fca955a\") " pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:35.962356 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:35.962331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:36.063066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.063043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:36.207011 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.206957    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wsxnb"
Sep 17 00:14:36.216876 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:36.216842    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bac9f2_55e3_4ed0_a497_74cd8fca955a.slice/crio-262bbd33e38516b4349be5a7037db3a5481785bf82289fb9e7a45fd65e1a3411 WatchSource:0}: Error finding container 262bbd33e38516b4349be5a7037db3a5481785bf82289fb9e7a45fd65e1a3411: Status 404 returned error can't find the container with id 262bbd33e38516b4349be5a7037db3a5481785bf82289fb9e7a45fd65e1a3411
Sep 17 00:14:36.262080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.262056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:36.339641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.339613    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 00:14:36.343371 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.343289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.343944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.343920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:36.346206 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.346183    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 00:14:36.346396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.346376    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xqbcv\""
Sep 17 00:14:36.346466 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.346424    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 00:14:36.346523 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.346476    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 00:14:36.347492 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.347473    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 00:14:36.347587 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.347554    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 00:14:36.347587 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.347572    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 00:14:36.347692 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.347606    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 00:14:36.347832 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.347794    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 00:14:36.347920 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.347839    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 00:14:36.356026 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.356002    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 00:14:36.427591 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427749 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427749 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427847 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-config-volume\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427847 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427847 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427941 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427941 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-web-config\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427941 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-config-out\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427941 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.427941 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.427934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrm9j\" (UniqueName: \"kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-kube-api-access-nrm9j\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.502090 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.502029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:36.528234 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-config-volume\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528329 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528329 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528329 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528329 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-web-config\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-config-out\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrm9j\" (UniqueName: \"kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-kube-api-access-nrm9j\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528750 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528938 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.528938 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:36.528902    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-trusted-ca-bundle podName:735000cb-d712-449e-89b4-b1156caed39d nodeName:}" failed. No retries permitted until 2026-09-17 00:14:37.028881667 +0000 UTC m=+277.555621128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "735000cb-d712-449e-89b4-b1156caed39d") : configmap references non-existent config key: ca-bundle.crt
Sep 17 00:14:36.529615 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.529531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.529615 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.528821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.531193 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.531170    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-config-out\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.531476 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.531451    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-config-volume\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.531796 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.531775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.531957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.531937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.532018 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.531971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-web-config\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.532654 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.532630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.532654 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.532649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.532782 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.532676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.533127 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.533107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.536289 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.536273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrm9j\" (UniqueName: \"kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-kube-api-access-nrm9j\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:36.774248 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:36.774172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wsxnb" event={"ID":"d5bac9f2-55e3-4ed0-a497-74cd8fca955a","Type":"ContainerStarted","Data":"262bbd33e38516b4349be5a7037db3a5481785bf82289fb9e7a45fd65e1a3411"}
Sep 17 00:14:37.033042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:37.032970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:37.033749 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:37.033726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:37.254297 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:37.254272    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:14:37.530762 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:37.530737    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 00:14:37.531448 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:37.531415    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735000cb_d712_449e_89b4_b1156caed39d.slice/crio-e5068b23a06f20fd54b6193f37de8b3e995449470459056038bafec6561e6013 WatchSource:0}: Error finding container e5068b23a06f20fd54b6193f37de8b3e995449470459056038bafec6561e6013: Status 404 returned error can't find the container with id e5068b23a06f20fd54b6193f37de8b3e995449470459056038bafec6561e6013
Sep 17 00:14:37.779771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:37.779704    2565 generic.go:356] "Generic (PLEG): container finished" podID="d5bac9f2-55e3-4ed0-a497-74cd8fca955a" containerID="d118077427cc6ceab4223a25c68c7f8fab0cda0546c0221e6d4a7633b8389fa4" exitCode=0
Sep 17 00:14:37.779903 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:37.779794    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wsxnb" event={"ID":"d5bac9f2-55e3-4ed0-a497-74cd8fca955a","Type":"ContainerDied","Data":"d118077427cc6ceab4223a25c68c7f8fab0cda0546c0221e6d4a7633b8389fa4"}
Sep 17 00:14:37.781103 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:37.781075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerStarted","Data":"e5068b23a06f20fd54b6193f37de8b3e995449470459056038bafec6561e6013"}
Sep 17 00:14:38.179531 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:38.179500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:38.279974 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:38.279881    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:38.337248 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:38.337218    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:38.410195 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:38.410166    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:38.791622 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:38.791596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wsxnb" event={"ID":"d5bac9f2-55e3-4ed0-a497-74cd8fca955a","Type":"ContainerStarted","Data":"1c26404c42e07c46c1a6b1ca492726f22e90a0bc22967a3a6fe1df46547aff48"}
Sep 17 00:14:38.791739 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:38.791688    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wsxnb" event={"ID":"d5bac9f2-55e3-4ed0-a497-74cd8fca955a","Type":"ContainerStarted","Data":"334b6e41419f73eb8ec51338802555ff091a99d5169814c938ed5e4ebc827866"}
Sep 17 00:14:38.793161 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:38.793139    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerStarted","Data":"283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e"}
Sep 17 00:14:38.809815 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:38.809763    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wsxnb" podStartSLOduration=2.775594287 podStartE2EDuration="3.809750426s" totalImagesPullingTime="965.367961ms" totalInitContainerRuntime="68.788178ms" isStatefulPod=true podCreationTimestamp="2026-09-17 00:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:38.808186203 +0000 UTC m=+279.334925703" watchObservedRunningTime="2026-09-17 00:14:38.809750426 +0000 UTC m=+279.336489903"
Sep 17 00:14:39.110310 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.110274    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:39.168195 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.168160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:39.328028 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.328003    2565 patch_prober.go:28] interesting pod/image-registry-7bd75f8759-tq8ql container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 00:14:39.328307 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.328051    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql" podUID="0a2a5ace-6c6a-4a18-9f2c-582583bc805b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:14:39.579575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.579543    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5d8b9644c8-265jf"]
Sep 17 00:14:39.581736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.581718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.585463 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.585442    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 00:14:39.585626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.585512    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gkc72\""
Sep 17 00:14:39.586591 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.586561    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 17 00:14:39.586591 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.586576    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 17 00:14:39.586753 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.586624    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cro0lpiq19o2l\""
Sep 17 00:14:39.589535 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.589513    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 17 00:14:39.603679 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.603648    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d8b9644c8-265jf"]
Sep 17 00:14:39.650539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.650513    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d416e68b-2001-4338-8b9a-8cff5c3f55f9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.650664 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.650546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d416e68b-2001-4338-8b9a-8cff5c3f55f9-secret-metrics-server-tls\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.650664 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.650565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d416e68b-2001-4338-8b9a-8cff5c3f55f9-audit-log\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.650664 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.650589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d416e68b-2001-4338-8b9a-8cff5c3f55f9-metrics-server-audit-profiles\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.650664 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.650632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d416e68b-2001-4338-8b9a-8cff5c3f55f9-secret-metrics-server-client-certs\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.650836 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.650699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d416e68b-2001-4338-8b9a-8cff5c3f55f9-client-ca-bundle\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.650836 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.650721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ghq9\" (UniqueName: \"kubernetes.io/projected/d416e68b-2001-4338-8b9a-8cff5c3f55f9-kube-api-access-7ghq9\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.751747 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.751719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d416e68b-2001-4338-8b9a-8cff5c3f55f9-secret-metrics-server-tls\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.751747 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.751747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d416e68b-2001-4338-8b9a-8cff5c3f55f9-audit-log\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.751932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.751771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d416e68b-2001-4338-8b9a-8cff5c3f55f9-metrics-server-audit-profiles\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.751932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.751791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d416e68b-2001-4338-8b9a-8cff5c3f55f9-secret-metrics-server-client-certs\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.751932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.751847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d416e68b-2001-4338-8b9a-8cff5c3f55f9-client-ca-bundle\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.751932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.751874    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ghq9\" (UniqueName: \"kubernetes.io/projected/d416e68b-2001-4338-8b9a-8cff5c3f55f9-kube-api-access-7ghq9\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.752116 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.751944    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d416e68b-2001-4338-8b9a-8cff5c3f55f9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.752168 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.752156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d416e68b-2001-4338-8b9a-8cff5c3f55f9-audit-log\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.752632 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.752602    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d416e68b-2001-4338-8b9a-8cff5c3f55f9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.752940 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.752842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d416e68b-2001-4338-8b9a-8cff5c3f55f9-metrics-server-audit-profiles\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.754722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.754696    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d416e68b-2001-4338-8b9a-8cff5c3f55f9-secret-metrics-server-tls\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.754830 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.754753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d416e68b-2001-4338-8b9a-8cff5c3f55f9-secret-metrics-server-client-certs\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.754830 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.754754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d416e68b-2001-4338-8b9a-8cff5c3f55f9-client-ca-bundle\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.759347 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.759327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ghq9\" (UniqueName: \"kubernetes.io/projected/d416e68b-2001-4338-8b9a-8cff5c3f55f9-kube-api-access-7ghq9\") pod \"metrics-server-5d8b9644c8-265jf\" (UID: \"d416e68b-2001-4338-8b9a-8cff5c3f55f9\") " pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:39.798048 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.798020    2565 generic.go:356] "Generic (PLEG): container finished" podID="735000cb-d712-449e-89b4-b1156caed39d" containerID="283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e" exitCode=0
Sep 17 00:14:39.798120 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.798100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerDied","Data":"283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e"}
Sep 17 00:14:39.892693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:39.892633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:40.050108 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.050079    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"]
Sep 17 00:14:40.052944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.052923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"
Sep 17 00:14:40.054412 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.054383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:40.055355 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.055335    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 17 00:14:40.055435 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.055419    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vjbc6\""
Sep 17 00:14:40.061744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.061722    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"]
Sep 17 00:14:40.155772 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.155718    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc489\" (UniqueName: \"kubernetes.io/projected/99523fb9-10b2-40c6-9e29-6db4d2fc8544-kube-api-access-nc489\") pod \"monitoring-plugin-5d85778b9d-v5h77\" (UID: \"99523fb9-10b2-40c6-9e29-6db4d2fc8544\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"
Sep 17 00:14:40.155903 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.155774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/99523fb9-10b2-40c6-9e29-6db4d2fc8544-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-v5h77\" (UID: \"99523fb9-10b2-40c6-9e29-6db4d2fc8544\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"
Sep 17 00:14:40.160050 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.160032    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5d8b9644c8-265jf"]
Sep 17 00:14:40.161938 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:40.161913    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd416e68b_2001_4338_8b9a_8cff5c3f55f9.slice/crio-2c2a66c06b84f6bb61d74b7f2777bc29115df0adaf0c6420341ae7eaa52c8562 WatchSource:0}: Error finding container 2c2a66c06b84f6bb61d74b7f2777bc29115df0adaf0c6420341ae7eaa52c8562: Status 404 returned error can't find the container with id 2c2a66c06b84f6bb61d74b7f2777bc29115df0adaf0c6420341ae7eaa52c8562
Sep 17 00:14:40.256932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.256908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc489\" (UniqueName: \"kubernetes.io/projected/99523fb9-10b2-40c6-9e29-6db4d2fc8544-kube-api-access-nc489\") pod \"monitoring-plugin-5d85778b9d-v5h77\" (UID: \"99523fb9-10b2-40c6-9e29-6db4d2fc8544\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"
Sep 17 00:14:40.257030 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.256953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/99523fb9-10b2-40c6-9e29-6db4d2fc8544-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-v5h77\" (UID: \"99523fb9-10b2-40c6-9e29-6db4d2fc8544\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"
Sep 17 00:14:40.257143 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:40.257071    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 17 00:14:40.257143 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:40.257113    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99523fb9-10b2-40c6-9e29-6db4d2fc8544-monitoring-plugin-cert podName:99523fb9-10b2-40c6-9e29-6db4d2fc8544 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:40.757101246 +0000 UTC m=+281.283840703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/99523fb9-10b2-40c6-9e29-6db4d2fc8544-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-v5h77" (UID: "99523fb9-10b2-40c6-9e29-6db4d2fc8544") : secret "monitoring-plugin-cert" not found
Sep 17 00:14:40.265540 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.265522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc489\" (UniqueName: \"kubernetes.io/projected/99523fb9-10b2-40c6-9e29-6db4d2fc8544-kube-api-access-nc489\") pod \"monitoring-plugin-5d85778b9d-v5h77\" (UID: \"99523fb9-10b2-40c6-9e29-6db4d2fc8544\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"
Sep 17 00:14:40.388041 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.388015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:40.406927 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:14:40.406874    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cd46g" podUID="dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae"
Sep 17 00:14:40.719866 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.719769    2565 patch_prober.go:28] interesting pod/image-registry-7bd75f8759-tq8ql container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 00:14:40.719866 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.719846    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql" podUID="0a2a5ace-6c6a-4a18-9f2c-582583bc805b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:14:40.762009 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.761983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/99523fb9-10b2-40c6-9e29-6db4d2fc8544-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-v5h77\" (UID: \"99523fb9-10b2-40c6-9e29-6db4d2fc8544\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"
Sep 17 00:14:40.764326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.764306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/99523fb9-10b2-40c6-9e29-6db4d2fc8544-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-v5h77\" (UID: \"99523fb9-10b2-40c6-9e29-6db4d2fc8544\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"
Sep 17 00:14:40.802298 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.802269    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf" event={"ID":"d416e68b-2001-4338-8b9a-8cff5c3f55f9","Type":"ContainerStarted","Data":"2c2a66c06b84f6bb61d74b7f2777bc29115df0adaf0c6420341ae7eaa52c8562"}
Sep 17 00:14:40.802298 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.802289    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cd46g"
Sep 17 00:14:40.963311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:40.963282    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"
Sep 17 00:14:41.242821 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:41.242775    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"]
Sep 17 00:14:41.468213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:41.468183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:41.533426 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:41.533355    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99523fb9_10b2_40c6_9e29_6db4d2fc8544.slice/crio-25e9b5e032a828ce39b83795d32bc65f20c878e3e5b847ff5d5c25b2bb7a5b58 WatchSource:0}: Error finding container 25e9b5e032a828ce39b83795d32bc65f20c878e3e5b847ff5d5c25b2bb7a5b58: Status 404 returned error can't find the container with id 25e9b5e032a828ce39b83795d32bc65f20c878e3e5b847ff5d5c25b2bb7a5b58
Sep 17 00:14:41.807610 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:41.807570    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77" event={"ID":"99523fb9-10b2-40c6-9e29-6db4d2fc8544","Type":"ContainerStarted","Data":"25e9b5e032a828ce39b83795d32bc65f20c878e3e5b847ff5d5c25b2bb7a5b58"}
Sep 17 00:14:42.814408 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:42.814370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf" event={"ID":"d416e68b-2001-4338-8b9a-8cff5c3f55f9","Type":"ContainerStarted","Data":"cc80c5659901325a4eda8ec87e86f82d90d62f034bad2c5612a9edbe491ca49c"}
Sep 17 00:14:42.818377 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:42.818347    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerStarted","Data":"1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c"}
Sep 17 00:14:42.818496 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:42.818416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerStarted","Data":"0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74"}
Sep 17 00:14:42.818496 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:42.818456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerStarted","Data":"61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0"}
Sep 17 00:14:42.818496 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:42.818493    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerStarted","Data":"2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2"}
Sep 17 00:14:42.818648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:42.818529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerStarted","Data":"fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1"}
Sep 17 00:14:42.831535 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:42.831481    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf" podStartSLOduration=1.9753118440000001 podStartE2EDuration="3.831461601s" totalImagesPullingTime="1.856149757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:42.830687166 +0000 UTC m=+283.357426677" watchObservedRunningTime="2026-09-17 00:14:42.831461601 +0000 UTC m=+283.358201081"
Sep 17 00:14:43.823891 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:43.823857    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77" event={"ID":"99523fb9-10b2-40c6-9e29-6db4d2fc8544","Type":"ContainerStarted","Data":"ad6f40e8527f6496c8e604d6b2818a3fc64387b362785dde9e7e565ee4547d14"}
Sep 17 00:14:43.824254 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:43.823921    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"
Sep 17 00:14:43.827909 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:43.827880    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerStarted","Data":"455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c"}
Sep 17 00:14:43.829330 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:43.829310    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77"
Sep 17 00:14:43.838064 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:43.838023    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-v5h77" podStartSLOduration=2.372331971 podStartE2EDuration="3.838004893s" totalImagesPullingTime="1.465672922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:43.837489718 +0000 UTC m=+284.364229210" watchObservedRunningTime="2026-09-17 00:14:43.838004893 +0000 UTC m=+284.364744372"
Sep 17 00:14:43.874736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:43.874691    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.293968221 podStartE2EDuration="7.874675952s" totalImagesPullingTime="4.561933536s" totalInitContainerRuntime="18.774195ms" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:43.872549365 +0000 UTC m=+284.399288856" watchObservedRunningTime="2026-09-17 00:14:43.874675952 +0000 UTC m=+284.401415430"
Sep 17 00:14:44.299336 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:44.299300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:14:44.301622 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:44.301602    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae-metrics-tls\") pod \"dns-default-cd46g\" (UID: \"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae\") " pod="openshift-dns/dns-default-cd46g"
Sep 17 00:14:44.405132 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:44.405101    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d74lr\""
Sep 17 00:14:44.413082 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:44.413056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cd46g"
Sep 17 00:14:44.686600 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:44.686569    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cd46g"]
Sep 17 00:14:44.692316 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:44.689774    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab7c9b5_9bd4_45e5_a4d4_48ab0d4bf1ae.slice/crio-bfd0746b8fe0c1804113f3a9e31618be4690d9a8419cb1d15860ee5649cbaa30 WatchSource:0}: Error finding container bfd0746b8fe0c1804113f3a9e31618be4690d9a8419cb1d15860ee5649cbaa30: Status 404 returned error can't find the container with id bfd0746b8fe0c1804113f3a9e31618be4690d9a8419cb1d15860ee5649cbaa30
Sep 17 00:14:44.834374 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:44.834336    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cd46g" event={"ID":"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae","Type":"ContainerStarted","Data":"bfd0746b8fe0c1804113f3a9e31618be4690d9a8419cb1d15860ee5649cbaa30"}
Sep 17 00:14:46.729057 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:46.729021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:46.829340 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:46.829303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:46.844894 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:46.844864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cd46g" event={"ID":"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae","Type":"ContainerStarted","Data":"583e8d2ce199260fb475b1ff4c0793f0c5cfe2e29e6ca3bbcfe5cf4112105d35"}
Sep 17 00:14:46.845026 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:46.844913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cd46g" event={"ID":"dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae","Type":"ContainerStarted","Data":"094c987a44af95046f6b601e56b1bfe4b15b1ce4b8eb883abf0a09958585f7b0"}
Sep 17 00:14:46.845026 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:46.844966    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cd46g"
Sep 17 00:14:46.861978 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:46.861929    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cd46g" podStartSLOduration=251.439078364 podStartE2EDuration="4m12.861913646s" totalImagesPullingTime="1.422835282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:10:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:46.859866934 +0000 UTC m=+287.386606423" watchObservedRunningTime="2026-09-17 00:14:46.861913646 +0000 UTC m=+287.388653124"
Sep 17 00:14:46.920411 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:46.920386    2565 scope.go:117] "RemoveContainer" containerID="5c9014f59f1d09698719c7b259b8aee9cfd36759b22e566f744235b4c39a6ebe"
Sep 17 00:14:47.021638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.021551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:47.122464 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.122426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:47.174436 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.174391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:47.851336 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.851309    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:14:47.851699 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.851433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" event={"ID":"572e13ec-05ba-4339-8aaf-c728bbd2307a","Type":"ContainerStarted","Data":"7c76c1ccb82c56a950dc10be344cc8ac79647ec1bd7f3d76735c73286ddf3880"}
Sep 17 00:14:47.851796 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.851779    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:14:47.856662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.856641    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z"
Sep 17 00:14:47.869579 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.869541    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-xxd5z" podStartSLOduration=52.840219487 podStartE2EDuration="55.869526194s" totalImagesPullingTime="3.029306707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:47.868449303 +0000 UTC m=+288.395188798" watchObservedRunningTime="2026-09-17 00:14:47.869526194 +0000 UTC m=+288.396265676"
Sep 17 00:14:47.956508 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.956476    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-nbvl7"]
Sep 17 00:14:47.959898 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.959876    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-nbvl7"
Sep 17 00:14:47.966926 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.962783    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 17 00:14:47.966926 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.963150    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2l6wv\""
Sep 17 00:14:47.966926 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.964559    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 17 00:14:47.969403 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.969379    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-nbvl7"]
Sep 17 00:14:47.971223 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:47.971199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:48.033083 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:48.033062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg245\" (UniqueName: \"kubernetes.io/projected/c1b149bf-8777-49fe-b455-fb14c36e47b0-kube-api-access-fg245\") pod \"downloads-76f99584f4-nbvl7\" (UID: \"c1b149bf-8777-49fe-b455-fb14c36e47b0\") " pod="openshift-console/downloads-76f99584f4-nbvl7"
Sep 17 00:14:48.066885 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:48.066854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:48.120210 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:48.120153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:48.134130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:48.134110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg245\" (UniqueName: \"kubernetes.io/projected/c1b149bf-8777-49fe-b455-fb14c36e47b0-kube-api-access-fg245\") pod \"downloads-76f99584f4-nbvl7\" (UID: \"c1b149bf-8777-49fe-b455-fb14c36e47b0\") " pod="openshift-console/downloads-76f99584f4-nbvl7"
Sep 17 00:14:48.142024 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:48.142005    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg245\" (UniqueName: \"kubernetes.io/projected/c1b149bf-8777-49fe-b455-fb14c36e47b0-kube-api-access-fg245\") pod \"downloads-76f99584f4-nbvl7\" (UID: \"c1b149bf-8777-49fe-b455-fb14c36e47b0\") " pod="openshift-console/downloads-76f99584f4-nbvl7"
Sep 17 00:14:48.256843 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:48.256759    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:48.274683 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:48.274646    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-nbvl7"
Sep 17 00:14:48.549748 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:48.549717    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1b149bf_8777_49fe_b455_fb14c36e47b0.slice/crio-348d6663242f89e2c96aef0ab12f8c28681cd556f8936ce9f529163e068fe67e WatchSource:0}: Error finding container 348d6663242f89e2c96aef0ab12f8c28681cd556f8936ce9f529163e068fe67e: Status 404 returned error can't find the container with id 348d6663242f89e2c96aef0ab12f8c28681cd556f8936ce9f529163e068fe67e
Sep 17 00:14:48.550592 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:48.550566    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-nbvl7"]
Sep 17 00:14:48.633708 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:48.633683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:48.734815 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:48.734782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:48.857067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:48.857011    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-nbvl7" event={"ID":"c1b149bf-8777-49fe-b455-fb14c36e47b0","Type":"ContainerStarted","Data":"348d6663242f89e2c96aef0ab12f8c28681cd556f8936ce9f529163e068fe67e"}
Sep 17 00:14:49.041143 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:49.041098    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:49.329953 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:49.329919    2565 patch_prober.go:28] interesting pod/image-registry-7bd75f8759-tq8ql container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 00:14:49.330113 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:49.329979    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql" podUID="0a2a5ace-6c6a-4a18-9f2c-582583bc805b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:14:49.716754 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:49.716669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:49.771384 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:49.771347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:49.841991 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:49.841931    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:50.719098 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:50.719069    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bd75f8759-tq8ql"
Sep 17 00:14:51.391880 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:51.391843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:53.648009 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:53.647947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:53.748164 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:53.748124    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:54.524704 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.524670    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bf7f77d66-hb8xc"]
Sep 17 00:14:54.528319 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.528297    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.532042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.531891    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 17 00:14:54.532042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.531909    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-76j2s\""
Sep 17 00:14:54.532042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.531962    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 17 00:14:54.532042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.531991    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 17 00:14:54.532042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.531965    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 17 00:14:54.532345 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.532058    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 17 00:14:54.535627 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.535603    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf7f77d66-hb8xc"]
Sep 17 00:14:54.593718 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.593691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-service-ca\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.593850 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.593735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-oauth-config\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.593850 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.593772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58f2k\" (UniqueName: \"kubernetes.io/projected/64227fbc-2219-4269-9459-ac60f69e9eb4-kube-api-access-58f2k\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.593850 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.593796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-oauth-serving-cert\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.593998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.593915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-serving-cert\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.594075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.594055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-console-config\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.694709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.694671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58f2k\" (UniqueName: \"kubernetes.io/projected/64227fbc-2219-4269-9459-ac60f69e9eb4-kube-api-access-58f2k\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.694709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.694714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-oauth-serving-cert\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.695243 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.694759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-serving-cert\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.695243 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.694830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-console-config\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.695243 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.694865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-service-ca\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.695243 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.694895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-oauth-config\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.695669 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.695622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-service-ca\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.695669 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.695644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-oauth-serving-cert\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.695669 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.695622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-console-config\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.697696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.697672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-oauth-config\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.697835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.697796    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-serving-cert\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.702545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.702524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58f2k\" (UniqueName: \"kubernetes.io/projected/64227fbc-2219-4269-9459-ac60f69e9eb4-kube-api-access-58f2k\") pod \"console-bf7f77d66-hb8xc\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") " pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:54.800657 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.800622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:14:54.841457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:54.841424    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:14:55.124607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:55.124585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bf7f77d66-hb8xc"]
Sep 17 00:14:55.126361 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:14:55.126338    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64227fbc_2219_4269_9459_ac60f69e9eb4.slice/crio-dad30d48d9cbb5dec153085e56ab66f0133b119fa054fe9027ab689e3ccc887c WatchSource:0}: Error finding container dad30d48d9cbb5dec153085e56ab66f0133b119fa054fe9027ab689e3ccc887c: Status 404 returned error can't find the container with id dad30d48d9cbb5dec153085e56ab66f0133b119fa054fe9027ab689e3ccc887c
Sep 17 00:14:55.890707 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:55.890660    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf7f77d66-hb8xc" event={"ID":"64227fbc-2219-4269-9459-ac60f69e9eb4","Type":"ContainerStarted","Data":"dad30d48d9cbb5dec153085e56ab66f0133b119fa054fe9027ab689e3ccc887c"}
Sep 17 00:14:56.854201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:56.854166    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cd46g"
Sep 17 00:14:59.893596 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:59.893457    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:14:59.893596 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:14:59.893507    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:15:01.676468 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:01.676399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:01.728274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:01.728223    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:02.720758 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:02.720717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:02.772633 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:02.772578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:02.932738 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:02.932702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:03.860188 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:03.860155    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c6bb49f8-slwfh"]
Sep 17 00:15:03.864376 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:03.864353    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:03.872538 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:03.872518    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 17 00:15:03.875076 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:03.875054    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6bb49f8-slwfh"]
Sep 17 00:15:03.980046 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:03.980017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx8h2\" (UniqueName: \"kubernetes.io/projected/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-kube-api-access-qx8h2\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:03.980193 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:03.980076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-oauth-config\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:03.980193 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:03.980110    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-trusted-ca-bundle\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:03.980193 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:03.980145    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-config\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:03.980193 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:03.980183    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-serving-cert\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:03.980369 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:03.980201    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-service-ca\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:03.980369 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:03.980221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-oauth-serving-cert\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.081625 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.081596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-config\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.081820 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.081654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-serving-cert\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.081820 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.081682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-service-ca\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.081820 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.081707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-oauth-serving-cert\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.081979 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.081922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx8h2\" (UniqueName: \"kubernetes.io/projected/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-kube-api-access-qx8h2\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.082027 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.082010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-oauth-config\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.082074 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.082048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-trusted-ca-bundle\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.082440 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.082385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-config\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.082440 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.082421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-service-ca\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.082440 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.082444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-oauth-serving-cert\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.082927 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.082902    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-trusted-ca-bundle\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.084586 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.084565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-oauth-config\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.084733 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.084711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-serving-cert\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.089712 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.089693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx8h2\" (UniqueName: \"kubernetes.io/projected/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-kube-api-access-qx8h2\") pod \"console-5c6bb49f8-slwfh\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") " pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:04.175656 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:04.175591    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:05.540314 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.540270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:05.596566 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.596540    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:15:05.596755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.596734    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:15:05.614634 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.614610    2565 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 00:15:05.638526 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.638482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:05.833974 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.833949    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c6bb49f8-slwfh"]
Sep 17 00:15:05.836871 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:15:05.836841    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dde79e3_f4cd_4af1_a9fb_1fbcdd5072dc.slice/crio-79e0707586b90bf923ab711037fcb6f1560c63b019e6724d474ca500d841f82e WatchSource:0}: Error finding container 79e0707586b90bf923ab711037fcb6f1560c63b019e6724d474ca500d841f82e: Status 404 returned error can't find the container with id 79e0707586b90bf923ab711037fcb6f1560c63b019e6724d474ca500d841f82e
Sep 17 00:15:05.937310 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.937066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf7f77d66-hb8xc" event={"ID":"64227fbc-2219-4269-9459-ac60f69e9eb4","Type":"ContainerStarted","Data":"2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225"}
Sep 17 00:15:05.939461 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.939437    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6bb49f8-slwfh" event={"ID":"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc","Type":"ContainerStarted","Data":"55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de"}
Sep 17 00:15:05.939684 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.939657    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6bb49f8-slwfh" event={"ID":"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc","Type":"ContainerStarted","Data":"79e0707586b90bf923ab711037fcb6f1560c63b019e6724d474ca500d841f82e"}
Sep 17 00:15:05.941538 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.941515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-nbvl7" event={"ID":"c1b149bf-8777-49fe-b455-fb14c36e47b0","Type":"ContainerStarted","Data":"c71642dbb78a4094a0147c06242e99bb7c9bfacae0e8ae6efe80fdcb9384385f"}
Sep 17 00:15:05.941791 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.941774    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-nbvl7"
Sep 17 00:15:05.954086 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.954062    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-nbvl7"
Sep 17 00:15:05.956072 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.956026    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bf7f77d66-hb8xc" podStartSLOduration=1.518140486 podStartE2EDuration="11.956009343s" totalImagesPullingTime="10.437868857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:15:05.954046731 +0000 UTC m=+306.480786211" watchObservedRunningTime="2026-09-17 00:15:05.956009343 +0000 UTC m=+306.482748822"
Sep 17 00:15:05.970822 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.969916    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c6bb49f8-slwfh" podStartSLOduration=2.9699000399999997 podStartE2EDuration="2.96990004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:15:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:15:05.969366016 +0000 UTC m=+306.496105519" watchObservedRunningTime="2026-09-17 00:15:05.96990004 +0000 UTC m=+306.496639519"
Sep 17 00:15:05.984152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:05.984115    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-nbvl7" podStartSLOduration=1.909570552 podStartE2EDuration="18.984096031s" totalImagesPullingTime="17.074525479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:15:05.983726362 +0000 UTC m=+306.510465889" watchObservedRunningTime="2026-09-17 00:15:05.984096031 +0000 UTC m=+306.510835510"
Sep 17 00:15:06.948358 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:06.948259    2565 generic.go:356] "Generic (PLEG): container finished" podID="b683f874-010b-48cc-b54e-050cbb485410" containerID="7394874a3a2d44edc4df82981adc30bb319d87952ddb8fda80d312e98902e034" exitCode=0
Sep 17 00:15:06.948776 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:06.948605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l" event={"ID":"b683f874-010b-48cc-b54e-050cbb485410","Type":"ContainerDied","Data":"7394874a3a2d44edc4df82981adc30bb319d87952ddb8fda80d312e98902e034"}
Sep 17 00:15:06.949077 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:06.949052    2565 scope.go:117] "RemoveContainer" containerID="7394874a3a2d44edc4df82981adc30bb319d87952ddb8fda80d312e98902e034"
Sep 17 00:15:07.958323 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:07.958285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-x8j5l" event={"ID":"b683f874-010b-48cc-b54e-050cbb485410","Type":"ContainerStarted","Data":"371beafc8ca974e220e89ae63c0326fbe327aa4fa4a3d964b8405be704d917ac"}
Sep 17 00:15:11.274819 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:11.274762    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:11.326625 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:11.326582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:14.176615 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:14.176575    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:14.177065 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:14.176641    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:14.182526 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:14.182500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:14.841687 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:14.841656    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:15:14.841906 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:14.841764    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:15:14.846459 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:14.846437    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:15:14.996194 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:14.996163    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:15:14.996490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:14.996465    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:15:15.059470 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:15.059437    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf7f77d66-hb8xc"]
Sep 17 00:15:15.143745 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:15.143652    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:15.495256 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:15.495176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:15.592845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:15.592795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:16.026320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:16.026275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:16.126708 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:16.126681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:16.719511 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:16.719479    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:16.820221 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:16.820194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:19.898788 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:19.898759    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:15:19.907748 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:19.907714    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5d8b9644c8-265jf"
Sep 17 00:15:27.038671 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:27.038633    2565 generic.go:356] "Generic (PLEG): container finished" podID="7229633c-b031-453d-ab8e-9077fd3bbd59" containerID="f10a1342d2a01b184aa28aaad8b099a158ae209e11c6c48997603191724e4326" exitCode=0
Sep 17 00:15:27.039126 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:27.038704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs" event={"ID":"7229633c-b031-453d-ab8e-9077fd3bbd59","Type":"ContainerDied","Data":"f10a1342d2a01b184aa28aaad8b099a158ae209e11c6c48997603191724e4326"}
Sep 17 00:15:27.039126 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:27.039037    2565 scope.go:117] "RemoveContainer" containerID="f10a1342d2a01b184aa28aaad8b099a158ae209e11c6c48997603191724e4326"
Sep 17 00:15:28.044112 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:28.044066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-qf5cs" event={"ID":"7229633c-b031-453d-ab8e-9077fd3bbd59","Type":"ContainerStarted","Data":"9ef1068ccb2af41ab949738654eea335bed3b888f8aefa0f0010102050b0f49e"}
Sep 17 00:15:31.681856 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:31.681815    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:31.731100 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:31.731066    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:42.017653 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.017611    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bf7f77d66-hb8xc" podUID="64227fbc-2219-4269-9459-ac60f69e9eb4" containerName="console" containerID="cri-o://2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225" gracePeriod=15
Sep 17 00:15:42.293763 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.293741    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:15:42.404564 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.404533    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58f2k\" (UniqueName: \"kubernetes.io/projected/64227fbc-2219-4269-9459-ac60f69e9eb4-kube-api-access-58f2k\") pod \"64227fbc-2219-4269-9459-ac60f69e9eb4\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") "
Sep 17 00:15:42.404675 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.404571    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-oauth-serving-cert\") pod \"64227fbc-2219-4269-9459-ac60f69e9eb4\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") "
Sep 17 00:15:42.404675 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.404609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-serving-cert\") pod \"64227fbc-2219-4269-9459-ac60f69e9eb4\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") "
Sep 17 00:15:42.404675 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.404654    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-console-config\") pod \"64227fbc-2219-4269-9459-ac60f69e9eb4\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") "
Sep 17 00:15:42.404675 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.404674    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-oauth-config\") pod \"64227fbc-2219-4269-9459-ac60f69e9eb4\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") "
Sep 17 00:15:42.404843 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.404707    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-service-ca\") pod \"64227fbc-2219-4269-9459-ac60f69e9eb4\" (UID: \"64227fbc-2219-4269-9459-ac60f69e9eb4\") "
Sep 17 00:15:42.405101 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.405074    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-console-config" (OuterVolumeSpecName: "console-config") pod "64227fbc-2219-4269-9459-ac60f69e9eb4" (UID: "64227fbc-2219-4269-9459-ac60f69e9eb4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:15:42.405201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.405075    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "64227fbc-2219-4269-9459-ac60f69e9eb4" (UID: "64227fbc-2219-4269-9459-ac60f69e9eb4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:15:42.405201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.405176    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-service-ca" (OuterVolumeSpecName: "service-ca") pod "64227fbc-2219-4269-9459-ac60f69e9eb4" (UID: "64227fbc-2219-4269-9459-ac60f69e9eb4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:15:42.406838 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.406787    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64227fbc-2219-4269-9459-ac60f69e9eb4-kube-api-access-58f2k" (OuterVolumeSpecName: "kube-api-access-58f2k") pod "64227fbc-2219-4269-9459-ac60f69e9eb4" (UID: "64227fbc-2219-4269-9459-ac60f69e9eb4"). InnerVolumeSpecName "kube-api-access-58f2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:15:42.406838 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.406818    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "64227fbc-2219-4269-9459-ac60f69e9eb4" (UID: "64227fbc-2219-4269-9459-ac60f69e9eb4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:15:42.406972 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.406855    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "64227fbc-2219-4269-9459-ac60f69e9eb4" (UID: "64227fbc-2219-4269-9459-ac60f69e9eb4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:15:42.505415 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.505374    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-oauth-config\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:42.505415 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.505406    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-service-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:42.505415 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.505416    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58f2k\" (UniqueName: \"kubernetes.io/projected/64227fbc-2219-4269-9459-ac60f69e9eb4-kube-api-access-58f2k\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:42.505415 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.505425    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-oauth-serving-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:42.505676 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.505434    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64227fbc-2219-4269-9459-ac60f69e9eb4-console-serving-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:42.505676 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:42.505443    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64227fbc-2219-4269-9459-ac60f69e9eb4-console-config\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:43.110582 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:43.110540    2565 generic.go:356] "Generic (PLEG): container finished" podID="64227fbc-2219-4269-9459-ac60f69e9eb4" containerID="2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225" exitCode=0
Sep 17 00:15:43.111107 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:43.110594    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bf7f77d66-hb8xc"
Sep 17 00:15:43.111107 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:43.110601    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf7f77d66-hb8xc" event={"ID":"64227fbc-2219-4269-9459-ac60f69e9eb4","Type":"ContainerDied","Data":"2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225"}
Sep 17 00:15:43.111107 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:43.110652    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bf7f77d66-hb8xc" event={"ID":"64227fbc-2219-4269-9459-ac60f69e9eb4","Type":"ContainerDied","Data":"dad30d48d9cbb5dec153085e56ab66f0133b119fa054fe9027ab689e3ccc887c"}
Sep 17 00:15:43.111107 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:43.110677    2565 scope.go:117] "RemoveContainer" containerID="2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225"
Sep 17 00:15:43.122476 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:43.122459    2565 scope.go:117] "RemoveContainer" containerID="2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225"
Sep 17 00:15:43.122751 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:15:43.122732    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225\": container with ID starting with 2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225 not found: ID does not exist" containerID="2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225"
Sep 17 00:15:43.122793 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:43.122758    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225"} err="failed to get container status \"2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225\": rpc error: code = NotFound desc = could not find container \"2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225\": container with ID starting with 2bd237fff64b437b819de454195d313c0ec5d4c1341285122253dc4e67d94225 not found: ID does not exist"
Sep 17 00:15:43.130946 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:43.130924    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bf7f77d66-hb8xc"]
Sep 17 00:15:43.134302 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:43.134282    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bf7f77d66-hb8xc"]
Sep 17 00:15:43.925425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:43.925385    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64227fbc-2219-4269-9459-ac60f69e9eb4" path="/var/lib/kubelet/pods/64227fbc-2219-4269-9459-ac60f69e9eb4/volumes"
Sep 17 00:15:51.320587 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:51.320548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:51.372760 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:51.372727    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:15:55.547895 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:55.547785    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 00:15:55.548317 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:55.548131    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="alertmanager" containerID="cri-o://fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1" gracePeriod=120
Sep 17 00:15:55.548317 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:55.548281    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="config-reloader" containerID="cri-o://2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2" gracePeriod=120
Sep 17 00:15:55.548317 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:55.548305    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="prom-label-proxy" containerID="cri-o://455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c" gracePeriod=120
Sep 17 00:15:55.548483 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:55.548318    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy" containerID="cri-o://0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74" gracePeriod=120
Sep 17 00:15:55.548483 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:55.548277    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy-web" containerID="cri-o://61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0" gracePeriod=120
Sep 17 00:15:55.548483 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:55.548277    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy-metric" containerID="cri-o://1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c" gracePeriod=120
Sep 17 00:15:56.167033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.166987    2565 generic.go:356] "Generic (PLEG): container finished" podID="735000cb-d712-449e-89b4-b1156caed39d" containerID="455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c" exitCode=0
Sep 17 00:15:56.167033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.167020    2565 generic.go:356] "Generic (PLEG): container finished" podID="735000cb-d712-449e-89b4-b1156caed39d" containerID="0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74" exitCode=0
Sep 17 00:15:56.167033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.167027    2565 generic.go:356] "Generic (PLEG): container finished" podID="735000cb-d712-449e-89b4-b1156caed39d" containerID="2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2" exitCode=0
Sep 17 00:15:56.167033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.167033    2565 generic.go:356] "Generic (PLEG): container finished" podID="735000cb-d712-449e-89b4-b1156caed39d" containerID="fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1" exitCode=0
Sep 17 00:15:56.167304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.167055    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerDied","Data":"455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c"}
Sep 17 00:15:56.167304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.167125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerDied","Data":"0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74"}
Sep 17 00:15:56.167304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.167151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerDied","Data":"2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2"}
Sep 17 00:15:56.167304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.167175    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerDied","Data":"fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1"}
Sep 17 00:15:56.792313 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.792291    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:56.922364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-trusted-ca-bundle\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.922364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922328    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-config-out\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.922536 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922370    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-main-db\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.922536 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922482    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-main-tls\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.922536 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922522    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrm9j\" (UniqueName: \"kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-kube-api-access-nrm9j\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.922638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922554    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-cluster-tls-config\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.922638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922583    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-config-volume\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.922638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-web-config\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.922789 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922648    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.922789 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922662    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:15:56.922789 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922694    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.922789 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922761    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-tls-assets\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.922789 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922785    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-web\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.923068 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922690    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:15:56.923068 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.922856    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-metrics-client-ca\") pod \"735000cb-d712-449e-89b4-b1156caed39d\" (UID: \"735000cb-d712-449e-89b4-b1156caed39d\") "
Sep 17 00:15:56.923168 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.923120    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:56.923168 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.923140    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-alertmanager-main-db\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:56.923538 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.923493    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:15:56.925667 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.925624    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:15:56.925922 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.925881    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-config-volume" (OuterVolumeSpecName: "config-volume") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:15:56.926015 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.925948    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-config-out" (OuterVolumeSpecName: "config-out") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:15:56.926150 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.926119    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-kube-api-access-nrm9j" (OuterVolumeSpecName: "kube-api-access-nrm9j") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "kube-api-access-nrm9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:15:56.926270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.926234    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:15:56.926270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.926247    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:15:56.926407 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.926385    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:15:56.927012 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.926989    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:15:56.929436 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.929406    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:15:56.936485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:56.936464    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-web-config" (OuterVolumeSpecName: "web-config") pod "735000cb-d712-449e-89b4-b1156caed39d" (UID: "735000cb-d712-449e-89b4-b1156caed39d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:15:57.023878 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.023857    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:57.023878 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.023877    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:57.023987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.023888    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-tls-assets\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:57.023987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.023897    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:57.023987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.023905    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/735000cb-d712-449e-89b4-b1156caed39d-metrics-client-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:57.023987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.023914    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/735000cb-d712-449e-89b4-b1156caed39d-config-out\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:57.023987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.023923    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-secret-alertmanager-main-tls\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:57.023987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.023931    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrm9j\" (UniqueName: \"kubernetes.io/projected/735000cb-d712-449e-89b4-b1156caed39d-kube-api-access-nrm9j\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:57.023987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.023939    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-cluster-tls-config\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:57.023987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.023947    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:57.023987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.023954    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/735000cb-d712-449e-89b4-b1156caed39d-web-config\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:15:57.174066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.174011    2565 generic.go:356] "Generic (PLEG): container finished" podID="735000cb-d712-449e-89b4-b1156caed39d" containerID="1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c" exitCode=0
Sep 17 00:15:57.174066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.174032    2565 generic.go:356] "Generic (PLEG): container finished" podID="735000cb-d712-449e-89b4-b1156caed39d" containerID="61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0" exitCode=0
Sep 17 00:15:57.174232 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.174099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerDied","Data":"1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c"}
Sep 17 00:15:57.174232 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.174165    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerDied","Data":"61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0"}
Sep 17 00:15:57.174232 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.174104    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.174232 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.174203    2565 scope.go:117] "RemoveContainer" containerID="455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c"
Sep 17 00:15:57.174425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.174193    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"735000cb-d712-449e-89b4-b1156caed39d","Type":"ContainerDied","Data":"e5068b23a06f20fd54b6193f37de8b3e995449470459056038bafec6561e6013"}
Sep 17 00:15:57.181756 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.181738    2565 scope.go:117] "RemoveContainer" containerID="1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c"
Sep 17 00:15:57.188488 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.188473    2565 scope.go:117] "RemoveContainer" containerID="0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74"
Sep 17 00:15:57.194898 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.194874    2565 scope.go:117] "RemoveContainer" containerID="61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0"
Sep 17 00:15:57.197222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.197202    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 00:15:57.201839 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.201821    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 00:15:57.201896 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.201859    2565 scope.go:117] "RemoveContainer" containerID="2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2"
Sep 17 00:15:57.208411 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.208393    2565 scope.go:117] "RemoveContainer" containerID="fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1"
Sep 17 00:15:57.214890 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.214873    2565 scope.go:117] "RemoveContainer" containerID="283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e"
Sep 17 00:15:57.221300 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.221285    2565 scope.go:117] "RemoveContainer" containerID="455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c"
Sep 17 00:15:57.221550 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:15:57.221534    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c\": container with ID starting with 455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c not found: ID does not exist" containerID="455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c"
Sep 17 00:15:57.221603 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.221556    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c"} err="failed to get container status \"455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c\": rpc error: code = NotFound desc = could not find container \"455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c\": container with ID starting with 455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c not found: ID does not exist"
Sep 17 00:15:57.221603 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.221571    2565 scope.go:117] "RemoveContainer" containerID="1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c"
Sep 17 00:15:57.221796 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:15:57.221779    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c\": container with ID starting with 1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c not found: ID does not exist" containerID="1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c"
Sep 17 00:15:57.221857 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.221821    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c"} err="failed to get container status \"1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c\": rpc error: code = NotFound desc = could not find container \"1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c\": container with ID starting with 1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c not found: ID does not exist"
Sep 17 00:15:57.221857 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.221837    2565 scope.go:117] "RemoveContainer" containerID="0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74"
Sep 17 00:15:57.222047 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:15:57.222033    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74\": container with ID starting with 0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74 not found: ID does not exist" containerID="0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74"
Sep 17 00:15:57.222087 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.222048    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74"} err="failed to get container status \"0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74\": rpc error: code = NotFound desc = could not find container \"0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74\": container with ID starting with 0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74 not found: ID does not exist"
Sep 17 00:15:57.222087 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.222060    2565 scope.go:117] "RemoveContainer" containerID="61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0"
Sep 17 00:15:57.222277 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:15:57.222260    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0\": container with ID starting with 61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0 not found: ID does not exist" containerID="61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0"
Sep 17 00:15:57.222338 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.222286    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0"} err="failed to get container status \"61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0\": rpc error: code = NotFound desc = could not find container \"61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0\": container with ID starting with 61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0 not found: ID does not exist"
Sep 17 00:15:57.222338 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.222307    2565 scope.go:117] "RemoveContainer" containerID="2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2"
Sep 17 00:15:57.222543 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:15:57.222528    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2\": container with ID starting with 2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2 not found: ID does not exist" containerID="2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2"
Sep 17 00:15:57.222607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.222548    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2"} err="failed to get container status \"2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2\": rpc error: code = NotFound desc = could not find container \"2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2\": container with ID starting with 2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2 not found: ID does not exist"
Sep 17 00:15:57.222607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.222561    2565 scope.go:117] "RemoveContainer" containerID="fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1"
Sep 17 00:15:57.222754 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:15:57.222739    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1\": container with ID starting with fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1 not found: ID does not exist" containerID="fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1"
Sep 17 00:15:57.222823 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.222761    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1"} err="failed to get container status \"fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1\": rpc error: code = NotFound desc = could not find container \"fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1\": container with ID starting with fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1 not found: ID does not exist"
Sep 17 00:15:57.222823 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.222780    2565 scope.go:117] "RemoveContainer" containerID="283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e"
Sep 17 00:15:57.223025 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:15:57.223010    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e\": container with ID starting with 283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e not found: ID does not exist" containerID="283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e"
Sep 17 00:15:57.223066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.223028    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e"} err="failed to get container status \"283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e\": rpc error: code = NotFound desc = could not find container \"283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e\": container with ID starting with 283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e not found: ID does not exist"
Sep 17 00:15:57.223066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.223046    2565 scope.go:117] "RemoveContainer" containerID="455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c"
Sep 17 00:15:57.223242 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.223222    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c"} err="failed to get container status \"455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c\": rpc error: code = NotFound desc = could not find container \"455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c\": container with ID starting with 455587863cdf7909204c49613732ab6806997c4101d19eb938354867f21e308c not found: ID does not exist"
Sep 17 00:15:57.223317 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.223243    2565 scope.go:117] "RemoveContainer" containerID="1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c"
Sep 17 00:15:57.223459 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.223443    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c"} err="failed to get container status \"1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c\": rpc error: code = NotFound desc = could not find container \"1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c\": container with ID starting with 1fc1e94987ff8357ee02a50e69a8101185b5e4fd37c65b5631fa17896238081c not found: ID does not exist"
Sep 17 00:15:57.223507 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.223460    2565 scope.go:117] "RemoveContainer" containerID="0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74"
Sep 17 00:15:57.223666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.223651    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74"} err="failed to get container status \"0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74\": rpc error: code = NotFound desc = could not find container \"0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74\": container with ID starting with 0f0e5ec32557e50f63038e6dc2c373a330e80ff8b54fb2a4eaea93c4aada2b74 not found: ID does not exist"
Sep 17 00:15:57.223709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.223666    2565 scope.go:117] "RemoveContainer" containerID="61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0"
Sep 17 00:15:57.223880 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.223864    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0"} err="failed to get container status \"61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0\": rpc error: code = NotFound desc = could not find container \"61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0\": container with ID starting with 61a7a4b557fa54ed0b3dd3592c8683aaa5cab5fc2d45cf33a975658a6f0222f0 not found: ID does not exist"
Sep 17 00:15:57.223880 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.223879    2565 scope.go:117] "RemoveContainer" containerID="2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2"
Sep 17 00:15:57.224052 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.224038    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2"} err="failed to get container status \"2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2\": rpc error: code = NotFound desc = could not find container \"2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2\": container with ID starting with 2015b3c306055de25f255cb8eb9705035cdb4d3b39f080f335d962f9bf503de2 not found: ID does not exist"
Sep 17 00:15:57.224100 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.224051    2565 scope.go:117] "RemoveContainer" containerID="fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1"
Sep 17 00:15:57.224239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.224222    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1"} err="failed to get container status \"fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1\": rpc error: code = NotFound desc = could not find container \"fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1\": container with ID starting with fb711d1c326a7de93026fbfcdeae6890aeea3a4fbc9f5ad7e329fa9a8aecada1 not found: ID does not exist"
Sep 17 00:15:57.224301 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.224241    2565 scope.go:117] "RemoveContainer" containerID="283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e"
Sep 17 00:15:57.224546 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.224527    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e"} err="failed to get container status \"283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e\": rpc error: code = NotFound desc = could not find container \"283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e\": container with ID starting with 283b22bd6411bba54b1a80fff815db7db25a5b14573e5ca53da8503b1a4c4b6e not found: ID does not exist"
Sep 17 00:15:57.226672 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.226645    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 00:15:57.226947 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.226934    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="init-config-reloader"
Sep 17 00:15:57.226998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.226948    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="init-config-reloader"
Sep 17 00:15:57.226998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.226956    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy-metric"
Sep 17 00:15:57.226998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.226961    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy-metric"
Sep 17 00:15:57.226998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.226972    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="prom-label-proxy"
Sep 17 00:15:57.226998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.226978    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="prom-label-proxy"
Sep 17 00:15:57.226998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.226989    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="config-reloader"
Sep 17 00:15:57.226998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.226994    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="config-reloader"
Sep 17 00:15:57.226998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227000    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64227fbc-2219-4269-9459-ac60f69e9eb4" containerName="console"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227005    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64227fbc-2219-4269-9459-ac60f69e9eb4" containerName="console"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227012    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy-web"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227017    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy-web"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227026    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227032    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227039    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="alertmanager"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227044    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="alertmanager"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227090    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="alertmanager"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227096    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy-metric"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227101    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="prom-label-proxy"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227107    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="64227fbc-2219-4269-9459-ac60f69e9eb4" containerName="console"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227114    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy-web"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227120    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="config-reloader"
Sep 17 00:15:57.227216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.227127    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="735000cb-d712-449e-89b4-b1156caed39d" containerName="kube-rbac-proxy"
Sep 17 00:15:57.231133 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.231117    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.234196 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.233797    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 17 00:15:57.234196 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.233848    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 17 00:15:57.234196 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.233994    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xqbcv\""
Sep 17 00:15:57.234196 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.234063    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 17 00:15:57.234474 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.234280    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 17 00:15:57.234522 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.234473    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 17 00:15:57.234675 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.234658    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 17 00:15:57.234766 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.234748    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 17 00:15:57.235042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.235026    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 17 00:15:57.238673 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.238653    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 17 00:15:57.243176 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.243156    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 00:15:57.325190 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4759f5dc-d80d-40b7-bedf-f8953959cc3f-config-out\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-web-config\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325301    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325348    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325414    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4759f5dc-d80d-40b7-bedf-f8953959cc3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325455    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvvs8\" (UniqueName: \"kubernetes.io/projected/4759f5dc-d80d-40b7-bedf-f8953959cc3f-kube-api-access-xvvs8\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4759f5dc-d80d-40b7-bedf-f8953959cc3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325521    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4759f5dc-d80d-40b7-bedf-f8953959cc3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.325771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.325563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4759f5dc-d80d-40b7-bedf-f8953959cc3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.426575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.426492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-web-config\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.426575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.426535    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.426575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.426559    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.426835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.426593    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.426835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.426620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4759f5dc-d80d-40b7-bedf-f8953959cc3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.426835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.426641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.426835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.426665    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvvs8\" (UniqueName: \"kubernetes.io/projected/4759f5dc-d80d-40b7-bedf-f8953959cc3f-kube-api-access-xvvs8\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.426835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.426691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.426835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.426713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4759f5dc-d80d-40b7-bedf-f8953959cc3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.426835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.426739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4759f5dc-d80d-40b7-bedf-f8953959cc3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.427192 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.427168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4759f5dc-d80d-40b7-bedf-f8953959cc3f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.428067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.428034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4759f5dc-d80d-40b7-bedf-f8953959cc3f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.428154 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.428093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.428154 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.428129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4759f5dc-d80d-40b7-bedf-f8953959cc3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.428263 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.428165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4759f5dc-d80d-40b7-bedf-f8953959cc3f-config-out\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.429919 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.429887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.429919 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.429890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.430080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.429922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-config-volume\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.430080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.429990    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-web-config\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.430080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.430062    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.430227 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.430062    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.430379 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.430360    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4759f5dc-d80d-40b7-bedf-f8953959cc3f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.430418 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.430383    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4759f5dc-d80d-40b7-bedf-f8953959cc3f-config-out\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.430462 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.430445    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4759f5dc-d80d-40b7-bedf-f8953959cc3f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.431721 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.431705    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4759f5dc-d80d-40b7-bedf-f8953959cc3f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.437240 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.437218    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvvs8\" (UniqueName: \"kubernetes.io/projected/4759f5dc-d80d-40b7-bedf-f8953959cc3f-kube-api-access-xvvs8\") pod \"alertmanager-main-0\" (UID: \"4759f5dc-d80d-40b7-bedf-f8953959cc3f\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.540944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.540924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 17 00:15:57.822536 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.822510    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 17 00:15:57.825998 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:15:57.825974    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4759f5dc_d80d_40b7_bedf_f8953959cc3f.slice/crio-6b3c9c20f814c52eb22d5d28bd2b35a5d093802633d501044716460100d5d501 WatchSource:0}: Error finding container 6b3c9c20f814c52eb22d5d28bd2b35a5d093802633d501044716460100d5d501: Status 404 returned error can't find the container with id 6b3c9c20f814c52eb22d5d28bd2b35a5d093802633d501044716460100d5d501
Sep 17 00:15:57.925065 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:57.925038    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="735000cb-d712-449e-89b4-b1156caed39d" path="/var/lib/kubelet/pods/735000cb-d712-449e-89b4-b1156caed39d/volumes"
Sep 17 00:15:58.180477 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:58.180387    2565 generic.go:356] "Generic (PLEG): container finished" podID="4759f5dc-d80d-40b7-bedf-f8953959cc3f" containerID="12c4fe4ef8579572848dc199e0ca13eb15a6f42f4d9fb7dff811d87eccd848ad" exitCode=0
Sep 17 00:15:58.180616 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:58.180477    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4759f5dc-d80d-40b7-bedf-f8953959cc3f","Type":"ContainerDied","Data":"12c4fe4ef8579572848dc199e0ca13eb15a6f42f4d9fb7dff811d87eccd848ad"}
Sep 17 00:15:58.180616 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:58.180558    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4759f5dc-d80d-40b7-bedf-f8953959cc3f","Type":"ContainerStarted","Data":"6b3c9c20f814c52eb22d5d28bd2b35a5d093802633d501044716460100d5d501"}
Sep 17 00:15:59.187599 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:59.187570    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4759f5dc-d80d-40b7-bedf-f8953959cc3f","Type":"ContainerStarted","Data":"11a3f1fdbaaec07b55e39198b986c6b295f049714bfefc5d69c96642d1a2d191"}
Sep 17 00:15:59.187981 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:59.187634    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4759f5dc-d80d-40b7-bedf-f8953959cc3f","Type":"ContainerStarted","Data":"e8ff1ef338d2b4092bfc317236038a3cae7d36ad64d47fda5dde0caa9f4e0ee1"}
Sep 17 00:15:59.187981 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:59.187669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4759f5dc-d80d-40b7-bedf-f8953959cc3f","Type":"ContainerStarted","Data":"66b99a4297a2072fce1a0e287dcddd65724b931c0bcdac08956360dfc0035f24"}
Sep 17 00:15:59.187981 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:59.187693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4759f5dc-d80d-40b7-bedf-f8953959cc3f","Type":"ContainerStarted","Data":"3e6b35e2742002638831865fabc760b239b72e3c90c04d6a3795ece30a3c633c"}
Sep 17 00:15:59.187981 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:59.187723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4759f5dc-d80d-40b7-bedf-f8953959cc3f","Type":"ContainerStarted","Data":"30a98afcc5c6e5dd3dc93d7fbad5d45c6a50a1fdf403640cfe03a0222d88d7d6"}
Sep 17 00:15:59.187981 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:59.187759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4759f5dc-d80d-40b7-bedf-f8953959cc3f","Type":"ContainerStarted","Data":"9352b5f0965db614225fe66e7a358581576aa1c0b7bce4e96d2f1cf0445fa814"}
Sep 17 00:15:59.212054 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:15:59.212007    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.196022918 podStartE2EDuration="2.211993487s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.970569ms" isStatefulPod=false podCreationTimestamp="2026-09-17 00:15:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:15:59.211679046 +0000 UTC m=+359.738418537" watchObservedRunningTime="2026-09-17 00:15:59.211993487 +0000 UTC m=+359.738732965"
Sep 17 00:16:03.113086 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:03.113029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:03.212782 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:03.212747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:16.679775 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:16.679736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:16.795532 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:16.795498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:16.898042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:16.898011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:24.355186 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.355137    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-544bfd64c7-xrt9x"]
Sep 17 00:16:24.357695 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.357673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.368498 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.368474    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544bfd64c7-xrt9x"]
Sep 17 00:16:24.432221 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.432192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-oauth-config\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.432311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.432232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-trusted-ca-bundle\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.432359 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.432317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-config\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.432398 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.432360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-service-ca\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.432398 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.432387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99v4z\" (UniqueName: \"kubernetes.io/projected/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-kube-api-access-99v4z\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.432485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.432417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-serving-cert\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.432538 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.432499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-oauth-serving-cert\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.447639 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.447618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:24.496233 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.496209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:24.532927 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.532904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-serving-cert\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.533004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.532940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-oauth-serving-cert\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.533004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.532976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-oauth-config\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.533004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.532999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-trusted-ca-bundle\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.533109 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.533060    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-config\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.533109 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.533093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-service-ca\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.533205 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.533118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99v4z\" (UniqueName: \"kubernetes.io/projected/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-kube-api-access-99v4z\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.533670 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.533639    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-oauth-serving-cert\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.533821 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.533784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-service-ca\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.533915 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.533859    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-config\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.534069 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.534044    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-trusted-ca-bundle\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.535417 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.535397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-serving-cert\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.535497 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.535433    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-oauth-config\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.540258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.540238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99v4z\" (UniqueName: \"kubernetes.io/projected/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-kube-api-access-99v4z\") pod \"console-544bfd64c7-xrt9x\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") " pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.551707 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.551684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:24.601087 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.601060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:24.668494 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.668411    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:24.935882 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:24.935696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544bfd64c7-xrt9x"]
Sep 17 00:16:24.937916 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:16:24.937893    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81698cdc_ff3b_403e_8cb9_9f8ee6d8b5ab.slice/crio-f2123e0a82ea71fef150a8e5b44d8f4726262d5ee0f33aeb1cf7e0918f1e22d7 WatchSource:0}: Error finding container f2123e0a82ea71fef150a8e5b44d8f4726262d5ee0f33aeb1cf7e0918f1e22d7: Status 404 returned error can't find the container with id f2123e0a82ea71fef150a8e5b44d8f4726262d5ee0f33aeb1cf7e0918f1e22d7
Sep 17 00:16:25.149419 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:25.149388    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:25.201189 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:25.201124    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:25.296107 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:25.296071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544bfd64c7-xrt9x" event={"ID":"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab","Type":"ContainerStarted","Data":"ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333"}
Sep 17 00:16:25.296263 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:25.296122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544bfd64c7-xrt9x" event={"ID":"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab","Type":"ContainerStarted","Data":"f2123e0a82ea71fef150a8e5b44d8f4726262d5ee0f33aeb1cf7e0918f1e22d7"}
Sep 17 00:16:25.313566 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:25.313516    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-544bfd64c7-xrt9x" podStartSLOduration=1.313500473 podStartE2EDuration="1.313500473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:16:25.31233242 +0000 UTC m=+385.839071923" watchObservedRunningTime="2026-09-17 00:16:25.313500473 +0000 UTC m=+385.840239952"
Sep 17 00:16:34.668878 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:34.668844    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:34.669270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:34.668899    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:34.673641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:34.673618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:35.342011 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:35.341985    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:16:35.384297 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:35.384265    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6bb49f8-slwfh"]
Sep 17 00:16:35.483729 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:35.483686    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:35.532813 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:35.532777    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:35.584179 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:35.584149    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:35.699306 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:35.699220    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:40.619558 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:40.619512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:40.716227 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:40.716186    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:56.690387 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:56.690341    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:16:56.762122 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:16:56.762091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:00.406820 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.406766    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c6bb49f8-slwfh" podUID="7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" containerName="console" containerID="cri-o://55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de" gracePeriod=15
Sep 17 00:17:00.646032 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.646010    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:17:00.812009 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.811982    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx8h2\" (UniqueName: \"kubernetes.io/projected/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-kube-api-access-qx8h2\") pod \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") "
Sep 17 00:17:00.812140 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.812018    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-config\") pod \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") "
Sep 17 00:17:00.812140 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.812042    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-service-ca\") pod \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") "
Sep 17 00:17:00.812140 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.812073    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-serving-cert\") pod \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") "
Sep 17 00:17:00.812140 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.812114    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-trusted-ca-bundle\") pod \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") "
Sep 17 00:17:00.812339 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.812149    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-oauth-config\") pod \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") "
Sep 17 00:17:00.812339 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.812228    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-oauth-serving-cert\") pod \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\" (UID: \"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc\") "
Sep 17 00:17:00.812929 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.812866    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-config" (OuterVolumeSpecName: "console-config") pod "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" (UID: "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:17:00.812929 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.812896    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-service-ca" (OuterVolumeSpecName: "service-ca") pod "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" (UID: "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:17:00.812929 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.812912    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" (UID: "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:17:00.814897 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.813373    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" (UID: "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:17:00.819051 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.815239    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-kube-api-access-qx8h2" (OuterVolumeSpecName: "kube-api-access-qx8h2") pod "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" (UID: "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc"). InnerVolumeSpecName "kube-api-access-qx8h2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:17:00.819607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.819581    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" (UID: "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:17:00.819679 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.819607    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" (UID: "7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:17:00.913561 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.913540    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-oauth-serving-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:17:00.913561 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.913560    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx8h2\" (UniqueName: \"kubernetes.io/projected/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-kube-api-access-qx8h2\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:17:00.913680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.913571    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-config\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:17:00.913680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.913579    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-service-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:17:00.913680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.913586    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-serving-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:17:00.913680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.913595    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-trusted-ca-bundle\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:17:00.913680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:00.913604    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc-console-oauth-config\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:17:01.441188 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:01.441158    2565 generic.go:356] "Generic (PLEG): container finished" podID="7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" containerID="55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de" exitCode=0
Sep 17 00:17:01.441543 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:01.441206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6bb49f8-slwfh" event={"ID":"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc","Type":"ContainerDied","Data":"55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de"}
Sep 17 00:17:01.441543 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:01.441218    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c6bb49f8-slwfh"
Sep 17 00:17:01.441543 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:01.441247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c6bb49f8-slwfh" event={"ID":"7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc","Type":"ContainerDied","Data":"79e0707586b90bf923ab711037fcb6f1560c63b019e6724d474ca500d841f82e"}
Sep 17 00:17:01.441543 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:01.441272    2565 scope.go:117] "RemoveContainer" containerID="55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de"
Sep 17 00:17:01.450397 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:01.450377    2565 scope.go:117] "RemoveContainer" containerID="55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de"
Sep 17 00:17:01.450701 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:17:01.450680    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de\": container with ID starting with 55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de not found: ID does not exist" containerID="55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de"
Sep 17 00:17:01.450750 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:01.450710    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de"} err="failed to get container status \"55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de\": rpc error: code = NotFound desc = could not find container \"55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de\": container with ID starting with 55db2f9e1ec78284d471725e93c8f8fddbdd23f9995c23d4d68b8f6d922c69de not found: ID does not exist"
Sep 17 00:17:01.461617 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:01.461590    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c6bb49f8-slwfh"]
Sep 17 00:17:01.465182 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:01.465157    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c6bb49f8-slwfh"]
Sep 17 00:17:01.926138 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:01.926111    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" path="/var/lib/kubelet/pods/7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc/volumes"
Sep 17 00:17:07.179744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:07.179709    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:07.972180 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:07.972139    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:09.140863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.140827    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk"]
Sep 17 00:17:09.141322 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.141288    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" containerName="console"
Sep 17 00:17:09.141322 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.141307    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" containerName="console"
Sep 17 00:17:09.141442 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.141393    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dde79e3-f4cd-4af1-a9fb-1fbcdd5072dc" containerName="console"
Sep 17 00:17:09.143552 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.143526    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk"
Sep 17 00:17:09.146346 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.146314    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 17 00:17:09.146494 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.146376    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:17:09.146494 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.146387    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-st26z\""
Sep 17 00:17:09.155645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.155620    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk"]
Sep 17 00:17:09.270841 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.270820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abc315e2-cbc2-4ac6-bbcb-1128969897e1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gsfk\" (UID: \"abc315e2-cbc2-4ac6-bbcb-1128969897e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk"
Sep 17 00:17:09.270982 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.270948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmplf\" (UniqueName: \"kubernetes.io/projected/abc315e2-cbc2-4ac6-bbcb-1128969897e1-kube-api-access-zmplf\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gsfk\" (UID: \"abc315e2-cbc2-4ac6-bbcb-1128969897e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk"
Sep 17 00:17:09.372039 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.372010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abc315e2-cbc2-4ac6-bbcb-1128969897e1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gsfk\" (UID: \"abc315e2-cbc2-4ac6-bbcb-1128969897e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk"
Sep 17 00:17:09.372138 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.372067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmplf\" (UniqueName: \"kubernetes.io/projected/abc315e2-cbc2-4ac6-bbcb-1128969897e1-kube-api-access-zmplf\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gsfk\" (UID: \"abc315e2-cbc2-4ac6-bbcb-1128969897e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk"
Sep 17 00:17:09.372450 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.372429    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abc315e2-cbc2-4ac6-bbcb-1128969897e1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gsfk\" (UID: \"abc315e2-cbc2-4ac6-bbcb-1128969897e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk"
Sep 17 00:17:09.380270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.380245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmplf\" (UniqueName: \"kubernetes.io/projected/abc315e2-cbc2-4ac6-bbcb-1128969897e1-kube-api-access-zmplf\") pod \"cert-manager-operator-controller-manager-55c444bf86-5gsfk\" (UID: \"abc315e2-cbc2-4ac6-bbcb-1128969897e1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk"
Sep 17 00:17:09.454158 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.454094    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk"
Sep 17 00:17:09.738636 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.738609    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk"]
Sep 17 00:17:09.741610 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:17:09.741584    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc315e2_cbc2_4ac6_bbcb_1128969897e1.slice/crio-fb242432f7c2321980434f02de7ef1737f96eb0327c72d0fd2624f1afa5163a7 WatchSource:0}: Error finding container fb242432f7c2321980434f02de7ef1737f96eb0327c72d0fd2624f1afa5163a7: Status 404 returned error can't find the container with id fb242432f7c2321980434f02de7ef1737f96eb0327c72d0fd2624f1afa5163a7
Sep 17 00:17:09.744692 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:09.744670    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:17:10.481861 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:10.481822    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk" event={"ID":"abc315e2-cbc2-4ac6-bbcb-1128969897e1","Type":"ContainerStarted","Data":"fb242432f7c2321980434f02de7ef1737f96eb0327c72d0fd2624f1afa5163a7"}
Sep 17 00:17:10.820172 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:10.820141    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:10.920974 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:10.920933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:13.259702 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.259661    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:13.360821 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.360767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:13.369275 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.369251    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p2r49"]
Sep 17 00:17:13.371336 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.371319    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49"
Sep 17 00:17:13.373933 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.373904    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 17 00:17:13.373933 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.373926    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 17 00:17:13.374065 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.373977    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cgwns\""
Sep 17 00:17:13.385974 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.385952    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p2r49"]
Sep 17 00:17:13.498391 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.498364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk" event={"ID":"abc315e2-cbc2-4ac6-bbcb-1128969897e1","Type":"ContainerStarted","Data":"a50350e835a032c8cc8380e5d609a361696ad36e671c4d1bb859a190fd977d85"}
Sep 17 00:17:13.506541 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.506519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92a28647-4c17-42af-95aa-f4b675795405-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p2r49\" (UID: \"92a28647-4c17-42af-95aa-f4b675795405\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49"
Sep 17 00:17:13.506615 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.506548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwqxk\" (UniqueName: \"kubernetes.io/projected/92a28647-4c17-42af-95aa-f4b675795405-kube-api-access-wwqxk\") pod \"cert-manager-webhook-6486ffd997-p2r49\" (UID: \"92a28647-4c17-42af-95aa-f4b675795405\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49"
Sep 17 00:17:13.515940 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.515850    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5gsfk" podStartSLOduration=1.531329862 podStartE2EDuration="4.515825108s" totalImagesPullingTime="2.984495246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:17:13.514932413 +0000 UTC m=+434.041671890" watchObservedRunningTime="2026-09-17 00:17:13.515825108 +0000 UTC m=+434.042564580"
Sep 17 00:17:13.606904 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.606881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92a28647-4c17-42af-95aa-f4b675795405-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p2r49\" (UID: \"92a28647-4c17-42af-95aa-f4b675795405\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49"
Sep 17 00:17:13.606988 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.606912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwqxk\" (UniqueName: \"kubernetes.io/projected/92a28647-4c17-42af-95aa-f4b675795405-kube-api-access-wwqxk\") pod \"cert-manager-webhook-6486ffd997-p2r49\" (UID: \"92a28647-4c17-42af-95aa-f4b675795405\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49"
Sep 17 00:17:13.614504 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.614479    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92a28647-4c17-42af-95aa-f4b675795405-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-p2r49\" (UID: \"92a28647-4c17-42af-95aa-f4b675795405\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49"
Sep 17 00:17:13.614632 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.614616    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwqxk\" (UniqueName: \"kubernetes.io/projected/92a28647-4c17-42af-95aa-f4b675795405-kube-api-access-wwqxk\") pod \"cert-manager-webhook-6486ffd997-p2r49\" (UID: \"92a28647-4c17-42af-95aa-f4b675795405\") " pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49"
Sep 17 00:17:13.696524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.696502    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49"
Sep 17 00:17:13.965255 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.965225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:13.980500 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:13.980475    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-p2r49"]
Sep 17 00:17:13.983579 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:17:13.983545    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92a28647_4c17_42af_95aa_f4b675795405.slice/crio-e0ff0fa63fa20c00a80b7adabf249a0ebdff333795f72e3d3adbf7993e0efe8c WatchSource:0}: Error finding container e0ff0fa63fa20c00a80b7adabf249a0ebdff333795f72e3d3adbf7993e0efe8c: Status 404 returned error can't find the container with id e0ff0fa63fa20c00a80b7adabf249a0ebdff333795f72e3d3adbf7993e0efe8c
Sep 17 00:17:14.057362 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:14.057336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:14.503124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:14.503100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49" event={"ID":"92a28647-4c17-42af-95aa-f4b675795405","Type":"ContainerStarted","Data":"e0ff0fa63fa20c00a80b7adabf249a0ebdff333795f72e3d3adbf7993e0efe8c"}
Sep 17 00:17:15.455947 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:15.455912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:15.651330 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:15.651288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:17.381466 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:17.381429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:17.481613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:17.481592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:17.522673 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:17.522645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49" event={"ID":"92a28647-4c17-42af-95aa-f4b675795405","Type":"ContainerStarted","Data":"b2811e61f4ed377250c35953408ccaad76a2feb529f958d8e0561e6f55c8e8b9"}
Sep 17 00:17:17.522783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:17.522772    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49"
Sep 17 00:17:17.538393 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:17.538276    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49" podStartSLOduration=1.5790093729999999 podStartE2EDuration="4.538258793s" totalImagesPullingTime="2.95924942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:17:17.538085616 +0000 UTC m=+438.064825094" watchObservedRunningTime="2026-09-17 00:17:17.538258793 +0000 UTC m=+438.064998285"
Sep 17 00:17:21.808139 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:21.808092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:21.911899 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:21.911864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:23.530471 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:23.530438    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-p2r49"
Sep 17 00:17:23.854381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:23.854345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:24.863060 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:24.863017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:24.962069 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:24.962034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:26.559611 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:26.559570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:32.020036 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:32.019987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:32.119833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:32.119782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:32.776094 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:32.776051    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:34.241860 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:34.241823    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:46.641762 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:46.641724    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:46.726491 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:46.726460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:47.244060 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.244033    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:47.486519 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.486492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:47.593396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.593373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:47.624088 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.624064    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"]
Sep 17 00:17:47.628695 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.628678    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.631391 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.631361    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 00:17:47.631391 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.631376    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 00:17:47.631653 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.631626    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 00:17:47.631653 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.631644    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mk2l7\""
Sep 17 00:17:47.631861 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.631678    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 00:17:47.648852 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.648828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2w2f\" (UniqueName: \"kubernetes.io/projected/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-kube-api-access-q2w2f\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.649197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.648867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-tmp\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.649197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.648891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.649197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.649009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-manifests\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.649197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.649042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.649512 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.649491    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"]
Sep 17 00:17:47.749559 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.749537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2w2f\" (UniqueName: \"kubernetes.io/projected/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-kube-api-access-q2w2f\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.749668 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.749579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-tmp\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.749668 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.749613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.749668 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.749653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-manifests\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.749882 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.749677    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.750121 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.750090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-manifests\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.752037 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.752012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-tmp\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.752137 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.752100    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.752196 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.752135    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.757281 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.757259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2w2f\" (UniqueName: \"kubernetes.io/projected/ebdfef02-db24-4fb2-af1e-690e0e6a1b93-kube-api-access-q2w2f\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-ptzxl\" (UID: \"ebdfef02-db24-4fb2-af1e-690e0e6a1b93\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:47.789152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.789129    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:47.852921 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.852859    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:47.922448 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.922423    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:47.939769 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:47.939748    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:48.033840 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:48.033783    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:48.124949 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:48.124877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:48.218905 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:48.218864    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"]
Sep 17 00:17:48.221260 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:17:48.221238    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebdfef02_db24_4fb2_af1e_690e0e6a1b93.slice/crio-f4c68979fec5d738f3bb84bcc9d0573b6ab81af616b6e5f793163900040044c9 WatchSource:0}: Error finding container f4c68979fec5d738f3bb84bcc9d0573b6ab81af616b6e5f793163900040044c9: Status 404 returned error can't find the container with id f4c68979fec5d738f3bb84bcc9d0573b6ab81af616b6e5f793163900040044c9
Sep 17 00:17:48.223152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:48.223125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:48.671834 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:48.671777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl" event={"ID":"ebdfef02-db24-4fb2-af1e-690e0e6a1b93","Type":"ContainerStarted","Data":"f4c68979fec5d738f3bb84bcc9d0573b6ab81af616b6e5f793163900040044c9"}
Sep 17 00:17:50.570018 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:50.569955    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:50.672095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:50.672064    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:17:51.689076 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:51.689006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl" event={"ID":"ebdfef02-db24-4fb2-af1e-690e0e6a1b93","Type":"ContainerStarted","Data":"a03d7dea4d56879df50edab49622d99c414f7eb34d77c41da2b152cc48c694de"}
Sep 17 00:17:52.694811 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:52.694776    2565 generic.go:356] "Generic (PLEG): container finished" podID="ebdfef02-db24-4fb2-af1e-690e0e6a1b93" containerID="a03d7dea4d56879df50edab49622d99c414f7eb34d77c41da2b152cc48c694de" exitCode=0
Sep 17 00:17:52.695160 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:52.694862    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl" event={"ID":"ebdfef02-db24-4fb2-af1e-690e0e6a1b93","Type":"ContainerDied","Data":"a03d7dea4d56879df50edab49622d99c414f7eb34d77c41da2b152cc48c694de"}
Sep 17 00:17:53.701431 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:53.701399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl" event={"ID":"ebdfef02-db24-4fb2-af1e-690e0e6a1b93","Type":"ContainerStarted","Data":"0b4180c729d52de6c6519a49bf7116313eb7917fc7a7f51b11db1dea42ba3843"}
Sep 17 00:17:53.701967 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:53.701473    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:17:53.724648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:17:53.724587    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl" podStartSLOduration=1.9215839190000001 podStartE2EDuration="6.724568801s" totalImagesPullingTime="3.773321579s" totalInitContainerRuntime="1.029663303s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:17:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:17:53.722261071 +0000 UTC m=+474.249000576" watchObservedRunningTime="2026-09-17 00:17:53.724568801 +0000 UTC m=+474.251308279"
Sep 17 00:18:00.028770 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:00.028738    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:00.130299 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:00.130221    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:02.316101 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:02.316058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:04.708289 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:04.708253    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-ptzxl"
Sep 17 00:18:06.861230 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:06.861193    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:06.964729 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:06.964699    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:07.058304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.058267    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"]
Sep 17 00:18:07.068975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.068946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.072553 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.072515    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 17 00:18:07.072686 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.072553    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 17 00:18:07.072793 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.072771    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"]
Sep 17 00:18:07.073506 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.073485    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-frbfh\""
Sep 17 00:18:07.073859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.073838    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 17 00:18:07.074063 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.074044    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:18:07.074330 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.074062    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 17 00:18:07.096453 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.096425    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:07.193453 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.193389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c251753-4643-41e1-9e4a-25019bea2975-metrics-cert\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.193556 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.193456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c251753-4643-41e1-9e4a-25019bea2975-manager-config\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.193556 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.193482    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c251753-4643-41e1-9e4a-25019bea2975-cert\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.193556 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.193532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cjv2\" (UniqueName: \"kubernetes.io/projected/9c251753-4643-41e1-9e4a-25019bea2975-kube-api-access-5cjv2\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.294047 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.294019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c251753-4643-41e1-9e4a-25019bea2975-metrics-cert\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.294169 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.294069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c251753-4643-41e1-9e4a-25019bea2975-manager-config\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.294169 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.294097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c251753-4643-41e1-9e4a-25019bea2975-cert\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.294169 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.294141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cjv2\" (UniqueName: \"kubernetes.io/projected/9c251753-4643-41e1-9e4a-25019bea2975-kube-api-access-5cjv2\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.294652 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.294620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9c251753-4643-41e1-9e4a-25019bea2975-manager-config\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.296416 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.296393    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9c251753-4643-41e1-9e4a-25019bea2975-cert\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.296681 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.296662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c251753-4643-41e1-9e4a-25019bea2975-metrics-cert\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.301590 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.301567    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cjv2\" (UniqueName: \"kubernetes.io/projected/9c251753-4643-41e1-9e4a-25019bea2975-kube-api-access-5cjv2\") pod \"lws-controller-manager-6685c7f5f5-ctzd5\" (UID: \"9c251753-4643-41e1-9e4a-25019bea2975\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.382696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.382670    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:07.399856 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.399832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:07.651081 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.651058    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"]
Sep 17 00:18:07.653462 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:18:07.653434    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c251753_4643_41e1_9e4a_25019bea2975.slice/crio-4238a1b944c67e3726934f61a44b5aa33549320db6b41306883ff09051e4e754 WatchSource:0}: Error finding container 4238a1b944c67e3726934f61a44b5aa33549320db6b41306883ff09051e4e754: Status 404 returned error can't find the container with id 4238a1b944c67e3726934f61a44b5aa33549320db6b41306883ff09051e4e754
Sep 17 00:18:07.764775 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:07.764735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5" event={"ID":"9c251753-4643-41e1-9e4a-25019bea2975","Type":"ContainerStarted","Data":"4238a1b944c67e3726934f61a44b5aa33549320db6b41306883ff09051e4e754"}
Sep 17 00:18:08.413871 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:08.413796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:08.481884 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:08.481845    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:09.318289 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:09.318254    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:10.781777 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:10.781740    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5" event={"ID":"9c251753-4643-41e1-9e4a-25019bea2975","Type":"ContainerStarted","Data":"8f5f0a0cdb09b3672f76a7059ff53289bf24d8d3464f57f0fffeade849accb2e"}
Sep 17 00:18:10.782251 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:10.781871    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:10.799128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:10.799076    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5" podStartSLOduration=1.363122028 podStartE2EDuration="3.799062889s" totalImagesPullingTime="2.435940861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:18:10.797939022 +0000 UTC m=+491.324678511" watchObservedRunningTime="2026-09-17 00:18:10.799062889 +0000 UTC m=+491.325802436"
Sep 17 00:18:14.225859 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.225794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:14.282563 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.282516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:14.484239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.484160    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"]
Sep 17 00:18:14.487570 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.487552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.490979 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.490956    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7w9rb\""
Sep 17 00:18:14.491092 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.490961    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 00:18:14.504915 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.504890    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"]
Sep 17 00:18:14.548532 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.548504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.548532 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.548531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.548705 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.548559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.548705 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.548615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.548705 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.548647    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a09e5de-0646-46b3-81dd-2fd08a31973c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.548705 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.548667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.548934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.548749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f6t7\" (UniqueName: \"kubernetes.io/projected/4a09e5de-0646-46b3-81dd-2fd08a31973c-kube-api-access-4f6t7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.548934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.548790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.548934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.548828    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.564313 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.564278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:14.649922 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.649896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.649934    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.649989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650096 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.650013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650145 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.650083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650145 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.650130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650259 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.650157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a09e5de-0646-46b3-81dd-2fd08a31973c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650259 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.650181    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650259 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.650243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f6t7\" (UniqueName: \"kubernetes.io/projected/4a09e5de-0646-46b3-81dd-2fd08a31973c-kube-api-access-4f6t7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650460 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.650436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650563 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.650490    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650787 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.650766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.650920 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.650896    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.651205 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.651183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a09e5de-0646-46b3-81dd-2fd08a31973c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.652610 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.652590    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.652709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.652682    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.657888 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.657862    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a09e5de-0646-46b3-81dd-2fd08a31973c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.658065 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.658047    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f6t7\" (UniqueName: \"kubernetes.io/projected/4a09e5de-0646-46b3-81dd-2fd08a31973c-kube-api-access-4f6t7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p\" (UID: \"4a09e5de-0646-46b3-81dd-2fd08a31973c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:14.687236 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.687204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:14.787301 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.787246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:14.798176 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:14.798154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:15.072368 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:15.072342    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"]
Sep 17 00:18:15.073776 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:18:15.073745    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a09e5de_0646_46b3_81dd_2fd08a31973c.slice/crio-dc30a878112fcdc4a5c35a45002f9d39a1d2a7f1c9300c0d6fb12b4c12cde7a5 WatchSource:0}: Error finding container dc30a878112fcdc4a5c35a45002f9d39a1d2a7f1c9300c0d6fb12b4c12cde7a5: Status 404 returned error can't find the container with id dc30a878112fcdc4a5c35a45002f9d39a1d2a7f1c9300c0d6fb12b4c12cde7a5
Sep 17 00:18:15.809943 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:15.809907    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p" event={"ID":"4a09e5de-0646-46b3-81dd-2fd08a31973c","Type":"ContainerStarted","Data":"dc30a878112fcdc4a5c35a45002f9d39a1d2a7f1c9300c0d6fb12b4c12cde7a5"}
Sep 17 00:18:17.910870 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:17.910832    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4rmbg"]
Sep 17 00:18:17.915761 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:17.915729    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:17.918368 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:17.918337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 17 00:18:17.918505 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:17.918344    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-r9287\""
Sep 17 00:18:17.930084 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:17.929966    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4rmbg"]
Sep 17 00:18:17.960319 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:17.960292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:17.976428 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:17.976400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-cert\") pod \"odh-model-controller-7998c67dc4-4rmbg\" (UID: \"1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:17.976544 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:17.976472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9m92\" (UniqueName: \"kubernetes.io/projected/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-kube-api-access-p9m92\") pod \"odh-model-controller-7998c67dc4-4rmbg\" (UID: \"1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:18.058778 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.058683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:18.077897 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.077862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-cert\") pod \"odh-model-controller-7998c67dc4-4rmbg\" (UID: \"1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:18.078067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.077936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9m92\" (UniqueName: \"kubernetes.io/projected/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-kube-api-access-p9m92\") pod \"odh-model-controller-7998c67dc4-4rmbg\" (UID: \"1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:18.078067 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:18:18.078030    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 17 00:18:18.078182 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:18:18.078118    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-cert podName:1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c nodeName:}" failed. No retries permitted until 2026-09-17 00:18:18.578095347 +0000 UTC m=+499.104834809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-cert") pod "odh-model-controller-7998c67dc4-4rmbg" (UID: "1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c") : secret "odh-model-controller-webhook-cert" not found
Sep 17 00:18:18.086190 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.086160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9m92\" (UniqueName: \"kubernetes.io/projected/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-kube-api-access-p9m92\") pod \"odh-model-controller-7998c67dc4-4rmbg\" (UID: \"1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:18.158916 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.158870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:18.500104 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.500058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:18.507110 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.507034    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-g7lgr"]
Sep 17 00:18:18.514558 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.514533    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr"
Sep 17 00:18:18.521503 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.518847    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-d2sb7\""
Sep 17 00:18:18.521503 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.519003    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 17 00:18:18.525038 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.524957    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-g7lgr"]
Sep 17 00:18:18.583037 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.583010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-cert\") pod \"odh-model-controller-7998c67dc4-4rmbg\" (UID: \"1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:18.583037 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.583043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bgld\" (UniqueName: \"kubernetes.io/projected/ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09-kube-api-access-6bgld\") pod \"model-serving-api-54d89bd5fc-g7lgr\" (UID: \"ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09\") " pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr"
Sep 17 00:18:18.583239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.583083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09-tls-certs\") pod \"model-serving-api-54d89bd5fc-g7lgr\" (UID: \"ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09\") " pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr"
Sep 17 00:18:18.583239 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:18:18.583180    2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 17 00:18:18.583344 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:18:18.583243    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-cert podName:1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c nodeName:}" failed. No retries permitted until 2026-09-17 00:18:19.583224118 +0000 UTC m=+500.109963577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-cert") pod "odh-model-controller-7998c67dc4-4rmbg" (UID: "1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c") : secret "odh-model-controller-webhook-cert" not found
Sep 17 00:18:18.621906 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.621831    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:18.671745 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.671708    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:18.683857 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.683825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bgld\" (UniqueName: \"kubernetes.io/projected/ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09-kube-api-access-6bgld\") pod \"model-serving-api-54d89bd5fc-g7lgr\" (UID: \"ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09\") " pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr"
Sep 17 00:18:18.683999 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.683894    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09-tls-certs\") pod \"model-serving-api-54d89bd5fc-g7lgr\" (UID: \"ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09\") " pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr"
Sep 17 00:18:18.686587 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.686565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09-tls-certs\") pod \"model-serving-api-54d89bd5fc-g7lgr\" (UID: \"ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09\") " pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr"
Sep 17 00:18:18.691549 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.691525    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bgld\" (UniqueName: \"kubernetes.io/projected/ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09-kube-api-access-6bgld\") pod \"model-serving-api-54d89bd5fc-g7lgr\" (UID: \"ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09\") " pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr"
Sep 17 00:18:18.831208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:18.831175    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr"
Sep 17 00:18:19.299258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:19.299218    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:18:19.299521 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:19.299312    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:18:19.299521 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:19.299346    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:18:19.502229 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:19.502190    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-g7lgr"]
Sep 17 00:18:19.590874 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:19.590841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-cert\") pod \"odh-model-controller-7998c67dc4-4rmbg\" (UID: \"1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:19.593252 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:19.593227    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c-cert\") pod \"odh-model-controller-7998c67dc4-4rmbg\" (UID: \"1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c\") " pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:19.734562 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:19.734520    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:19.835773 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:19.835728    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p" event={"ID":"4a09e5de-0646-46b3-81dd-2fd08a31973c","Type":"ContainerStarted","Data":"5891e800f14a4f7b4740d9312793fbe3ce73bb4fdfb9ded3ca55004d3c206547"}
Sep 17 00:18:19.837354 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:19.837329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr" event={"ID":"ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09","Type":"ContainerStarted","Data":"76f04b7b8446092db0a23fada1f3efceac24a95534a2757d5df6f556a575ca36"}
Sep 17 00:18:19.855073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:19.855027    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p" podStartSLOduration=1.6319619319999998 podStartE2EDuration="5.855012081s" totalImagesPullingTime="4.223050149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:18:19.853625417 +0000 UTC m=+500.380364926" watchObservedRunningTime="2026-09-17 00:18:19.855012081 +0000 UTC m=+500.381751558"
Sep 17 00:18:20.006125 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:20.005972    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4rmbg"]
Sep 17 00:18:20.009042 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:18:20.009013    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7a5ca1_c396_4c76_a635_2bb3e7a2cf0c.slice/crio-7c0fa26c9961c692c5267a3c67088882862aa86c8c240b86d27387a61142ed08 WatchSource:0}: Error finding container 7c0fa26c9961c692c5267a3c67088882862aa86c8c240b86d27387a61142ed08: Status 404 returned error can't find the container with id 7c0fa26c9961c692c5267a3c67088882862aa86c8c240b86d27387a61142ed08
Sep 17 00:18:20.799362 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:20.799328    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:20.806069 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:20.806044    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:20.845182 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:20.845138    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg" event={"ID":"1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c","Type":"ContainerStarted","Data":"7c0fa26c9961c692c5267a3c67088882862aa86c8c240b86d27387a61142ed08"}
Sep 17 00:18:20.845489 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:20.845468    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:20.846637 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:20.846616    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p"
Sep 17 00:18:21.789172 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:21.789144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-ctzd5"
Sep 17 00:18:23.864737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:23.864698    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr" event={"ID":"ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09","Type":"ContainerStarted","Data":"8c6efdb355231015c502359e2a8ee5e50005c5d98c10e92503e0d04e1f8b6e3e"}
Sep 17 00:18:23.865225 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:23.864763    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr"
Sep 17 00:18:23.866246 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:23.866221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg" event={"ID":"1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c","Type":"ContainerStarted","Data":"d8cfaec2544cd52f19a6b3430b3ace6de705404968589638bdad2aa38fa5719c"}
Sep 17 00:18:23.866371 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:23.866268    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:23.879902 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:23.879842    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr" podStartSLOduration=1.758322316 podStartE2EDuration="5.879824465s" totalImagesPullingTime="4.121502149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:18:23.879029153 +0000 UTC m=+504.405768660" watchObservedRunningTime="2026-09-17 00:18:23.879824465 +0000 UTC m=+504.406563943"
Sep 17 00:18:23.894447 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:23.894374    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg" podStartSLOduration=3.226071776 podStartE2EDuration="6.894362227s" totalImagesPullingTime="3.668290451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:18:23.89282392 +0000 UTC m=+504.419563414" watchObservedRunningTime="2026-09-17 00:18:23.894362227 +0000 UTC m=+504.421101703"
Sep 17 00:18:25.631387 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.631347    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"]
Sep 17 00:18:25.635062 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.635039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.637980 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.637955    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 00:18:25.638119 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.637955    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 00:18:25.638119 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.638072    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-88s5c\""
Sep 17 00:18:25.638119 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.638084    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 00:18:25.646743 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.646721    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"]
Sep 17 00:18:25.754162 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.754126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09135dbd-49be-474c-92cc-41d951f71081-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.754313 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.754171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp7z9\" (UniqueName: \"kubernetes.io/projected/09135dbd-49be-474c-92cc-41d951f71081-kube-api-access-fp7z9\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.754313 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.754286    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/09135dbd-49be-474c-92cc-41d951f71081-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.754426 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.754326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/09135dbd-49be-474c-92cc-41d951f71081-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.754426 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.754353    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09135dbd-49be-474c-92cc-41d951f71081-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.754426 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.754390    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/09135dbd-49be-474c-92cc-41d951f71081-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.754426 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.754414    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/09135dbd-49be-474c-92cc-41d951f71081-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.855561 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.855532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/09135dbd-49be-474c-92cc-41d951f71081-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.855561 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.855565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/09135dbd-49be-474c-92cc-41d951f71081-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.855777 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.855581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09135dbd-49be-474c-92cc-41d951f71081-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.855777 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.855598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/09135dbd-49be-474c-92cc-41d951f71081-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.855777 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.855621    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/09135dbd-49be-474c-92cc-41d951f71081-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.855777 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.855692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09135dbd-49be-474c-92cc-41d951f71081-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.855777 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.855727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp7z9\" (UniqueName: \"kubernetes.io/projected/09135dbd-49be-474c-92cc-41d951f71081-kube-api-access-fp7z9\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.856507 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.856480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/09135dbd-49be-474c-92cc-41d951f71081-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.858123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.858092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/09135dbd-49be-474c-92cc-41d951f71081-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.858216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.858135    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/09135dbd-49be-474c-92cc-41d951f71081-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.858369 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.858349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/09135dbd-49be-474c-92cc-41d951f71081-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.858409 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.858349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/09135dbd-49be-474c-92cc-41d951f71081-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.866492 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.866467    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp7z9\" (UniqueName: \"kubernetes.io/projected/09135dbd-49be-474c-92cc-41d951f71081-kube-api-access-fp7z9\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.873928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.873901    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09135dbd-49be-474c-92cc-41d951f71081-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-wgc58\" (UID: \"09135dbd-49be-474c-92cc-41d951f71081\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:25.944694 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:25.944635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:26.222478 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:26.222374    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"]
Sep 17 00:18:26.227342 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:18:26.227316    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09135dbd_49be_474c_92cc_41d951f71081.slice/crio-6d4b44511880e9e12c57ae32d3c1f743064d810334a7afee7a03acb1a344bdca WatchSource:0}: Error finding container 6d4b44511880e9e12c57ae32d3c1f743064d810334a7afee7a03acb1a344bdca: Status 404 returned error can't find the container with id 6d4b44511880e9e12c57ae32d3c1f743064d810334a7afee7a03acb1a344bdca
Sep 17 00:18:26.884993 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:26.884915    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58" event={"ID":"09135dbd-49be-474c-92cc-41d951f71081","Type":"ContainerStarted","Data":"6d4b44511880e9e12c57ae32d3c1f743064d810334a7afee7a03acb1a344bdca"}
Sep 17 00:18:28.227746 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:28.227713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:28.346440 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:28.346409    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:28.655116 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:28.655069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:28.955044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:28.955012    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:18:28.955124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:28.955079    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:18:29.137324 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:29.137285    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:29.543201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:29.543170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:29.640260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:29.640230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:29.755146 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:29.755108    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:29.909017 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:29.908941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58" event={"ID":"09135dbd-49be-474c-92cc-41d951f71081","Type":"ContainerStarted","Data":"6cd954f0c35aa35c2e169327e9934833091c6440414f38d03065c4bd1fa3adab"}
Sep 17 00:18:29.909153 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:29.909074    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:29.933776 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:29.933728    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58" podStartSLOduration=2.208518637 podStartE2EDuration="4.933711159s" totalImagesPullingTime="2.725192522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:18:29.930215 +0000 UTC m=+510.456954503" watchObservedRunningTime="2026-09-17 00:18:29.933711159 +0000 UTC m=+510.460450639"
Sep 17 00:18:30.916631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:30.916602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-wgc58"
Sep 17 00:18:34.874844 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:34.874814    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-g7lgr"
Sep 17 00:18:34.901248 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:34.901220    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4rmbg"
Sep 17 00:18:35.172833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:35.172736    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:18:50.852748 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:18:50.852716    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:04.296094 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:04.296047    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:06.242616 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:06.242576    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:06.293934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:06.293902    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:24.240520 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:24.240486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:39.181650 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:39.181611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:39.279644 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:39.279603    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:52.152762 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:52.152721    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:54.279114 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:54.279078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:55.065452 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:55.065413    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:55.676566 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:55.676524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:55.999417 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:55.999323    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:56.162309 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:56.162273    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:57.083493 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.083454    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-544d5bbb5f-7fg4d"]
Sep 17 00:19:57.086034 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.086013    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.096837 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.096783    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544d5bbb5f-7fg4d"]
Sep 17 00:19:57.143828 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.143765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:57.180123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.180084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-console-config\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.180292 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.180137    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-service-ca\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.180292 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.180163    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43cd91da-f9a8-4757-b338-cc87d0ead09a-console-serving-cert\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.180292 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.180238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43cd91da-f9a8-4757-b338-cc87d0ead09a-console-oauth-config\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.180292 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.180262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-trusted-ca-bundle\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.180292 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.180287    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-oauth-serving-cert\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.180601 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.180303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn8r8\" (UniqueName: \"kubernetes.io/projected/43cd91da-f9a8-4757-b338-cc87d0ead09a-kube-api-access-gn8r8\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.281303 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.281261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43cd91da-f9a8-4757-b338-cc87d0ead09a-console-oauth-config\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.281303 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.281307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-trusted-ca-bundle\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.281577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.281337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-oauth-serving-cert\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.281577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.281352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn8r8\" (UniqueName: \"kubernetes.io/projected/43cd91da-f9a8-4757-b338-cc87d0ead09a-kube-api-access-gn8r8\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.281577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.281371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-console-config\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.281577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.281402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-service-ca\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.281577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.281423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43cd91da-f9a8-4757-b338-cc87d0ead09a-console-serving-cert\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.282276 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.282243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-console-config\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.282392 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.282367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-oauth-serving-cert\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.282453 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.282367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-service-ca\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.282540 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.282514    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43cd91da-f9a8-4757-b338-cc87d0ead09a-trusted-ca-bundle\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.283751 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.283734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43cd91da-f9a8-4757-b338-cc87d0ead09a-console-serving-cert\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.283885 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.283866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43cd91da-f9a8-4757-b338-cc87d0ead09a-console-oauth-config\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.300684 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.300659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn8r8\" (UniqueName: \"kubernetes.io/projected/43cd91da-f9a8-4757-b338-cc87d0ead09a-kube-api-access-gn8r8\") pod \"console-544d5bbb5f-7fg4d\" (UID: \"43cd91da-f9a8-4757-b338-cc87d0ead09a\") " pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.397056 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.396963    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:19:57.675312 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:57.675279    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544d5bbb5f-7fg4d"]
Sep 17 00:19:57.677694 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:19:57.677664    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43cd91da_f9a8_4757_b338_cc87d0ead09a.slice/crio-62e924c150ac78d55d95f9be392e62c4a1cc6e41a9faa444085a99b9b5405586 WatchSource:0}: Error finding container 62e924c150ac78d55d95f9be392e62c4a1cc6e41a9faa444085a99b9b5405586: Status 404 returned error can't find the container with id 62e924c150ac78d55d95f9be392e62c4a1cc6e41a9faa444085a99b9b5405586
Sep 17 00:19:58.009826 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:58.009715    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:58.162914 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:58.162871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:58.322546 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:58.322510    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544d5bbb5f-7fg4d" event={"ID":"43cd91da-f9a8-4757-b338-cc87d0ead09a","Type":"ContainerStarted","Data":"03aaa8d70e61299d48b889d01f1e979cabbf3d568c8c71aa2d4aa666327defb5"}
Sep 17 00:19:58.322733 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:58.322590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544d5bbb5f-7fg4d" event={"ID":"43cd91da-f9a8-4757-b338-cc87d0ead09a","Type":"ContainerStarted","Data":"62e924c150ac78d55d95f9be392e62c4a1cc6e41a9faa444085a99b9b5405586"}
Sep 17 00:19:58.350163 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:58.350112    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-544d5bbb5f-7fg4d" podStartSLOduration=1.350097346 podStartE2EDuration="1.350097346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:19:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:19:58.348167384 +0000 UTC m=+598.874906887" watchObservedRunningTime="2026-09-17 00:19:58.350097346 +0000 UTC m=+598.876836823"
Sep 17 00:19:58.757610 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:58.757509    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:58.985052 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:58.985012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:59.156511 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:59.156475    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:19:59.261308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:19:59.261276    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:02.374300 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:02.374261    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:03.404603 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:03.404563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:05.351665 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:05.351628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:05.419680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:05.419648    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:05.628709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:05.628633    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:20:05.633639 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:05.633616    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:20:05.753409 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:05.753374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:05.817173 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:05.817136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:07.398103 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:07.398055    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:20:07.398103 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:07.398118    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:20:07.402714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:07.402691    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:20:08.377574 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:08.377542    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-544d5bbb5f-7fg4d"
Sep 17 00:20:08.425261 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:08.425228    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544bfd64c7-xrt9x"]
Sep 17 00:20:08.518524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:08.518483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:08.623931 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:08.623884    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:08.724544 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:08.724442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:09.355344 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:09.355307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:09.455970 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:09.455936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:10.577155 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:10.577105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:10.902249 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:10.902162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:13.774026 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:13.773986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:13.873627 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:13.873587    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:13.974590 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:13.974552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:20.258477 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:20.258444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:20.368761 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:20.368723    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:20.631561 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:20.631522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:21.270445 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:21.270403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:21.936190 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:21.936145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:25.994711 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:25.994676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:26.095720 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:26.095688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:26.594284 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:26.594250    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:26.650420 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:26.650390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:29.994567 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:29.994534    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:30.095973 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:30.095938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:33.451269 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.451223    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-544bfd64c7-xrt9x" podUID="81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" containerName="console" containerID="cri-o://ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333" gracePeriod=15
Sep 17 00:20:33.699519 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.699494    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:20:33.821827 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.821772    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-oauth-serving-cert\") pod \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") "
Sep 17 00:20:33.822013 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.821842    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-serving-cert\") pod \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") "
Sep 17 00:20:33.822013 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.821875    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-service-ca\") pod \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") "
Sep 17 00:20:33.822013 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.821895    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99v4z\" (UniqueName: \"kubernetes.io/projected/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-kube-api-access-99v4z\") pod \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") "
Sep 17 00:20:33.822013 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.821919    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-oauth-config\") pod \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") "
Sep 17 00:20:33.822013 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.821947    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-trusted-ca-bundle\") pod \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") "
Sep 17 00:20:33.822013 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.822002    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-config\") pod \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\" (UID: \"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab\") "
Sep 17 00:20:33.822310 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.822198    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" (UID: "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:20:33.822390 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.822371    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-oauth-serving-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:20:33.822449 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.822364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-service-ca" (OuterVolumeSpecName: "service-ca") pod "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" (UID: "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:20:33.822527 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.822492    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" (UID: "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:20:33.822683 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.822660    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-config" (OuterVolumeSpecName: "console-config") pod "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" (UID: "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:20:33.824186 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.824161    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-kube-api-access-99v4z" (OuterVolumeSpecName: "kube-api-access-99v4z") pod "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" (UID: "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab"). InnerVolumeSpecName "kube-api-access-99v4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:20:33.824298 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.824185    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" (UID: "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:20:33.824298 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.824280    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" (UID: "81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:20:33.923396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.923368    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-trusted-ca-bundle\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:20:33.923396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.923391    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-config\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:20:33.923396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.923401    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-serving-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:20:33.923592 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.923410    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-service-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:20:33.923592 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.923419    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99v4z\" (UniqueName: \"kubernetes.io/projected/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-kube-api-access-99v4z\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:20:33.923592 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:33.923430    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab-console-oauth-config\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:20:34.006674 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.006635    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:34.104535 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.104445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:34.204681 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.204646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:34.276151 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.276115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:34.399898 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.399788    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:34.497517 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.497486    2565 generic.go:356] "Generic (PLEG): container finished" podID="81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" containerID="ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333" exitCode=0
Sep 17 00:20:34.497917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.497543    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544bfd64c7-xrt9x"
Sep 17 00:20:34.497917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.497575    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544bfd64c7-xrt9x" event={"ID":"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab","Type":"ContainerDied","Data":"ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333"}
Sep 17 00:20:34.497917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.497666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544bfd64c7-xrt9x" event={"ID":"81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab","Type":"ContainerDied","Data":"f2123e0a82ea71fef150a8e5b44d8f4726262d5ee0f33aeb1cf7e0918f1e22d7"}
Sep 17 00:20:34.497917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.497691    2565 scope.go:117] "RemoveContainer" containerID="ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333"
Sep 17 00:20:34.506714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.506695    2565 scope.go:117] "RemoveContainer" containerID="ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333"
Sep 17 00:20:34.507128 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:20:34.507102    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333\": container with ID starting with ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333 not found: ID does not exist" containerID="ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333"
Sep 17 00:20:34.507202 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.507143    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333"} err="failed to get container status \"ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333\": rpc error: code = NotFound desc = could not find container \"ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333\": container with ID starting with ee3b1d29ae01788e931a85cadef08cb6b947c824ac3bd84f02f75a4a5c3d3333 not found: ID does not exist"
Sep 17 00:20:34.507486 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.507473    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:34.525492 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.525457    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544bfd64c7-xrt9x"]
Sep 17 00:20:34.533048 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:34.533005    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-544bfd64c7-xrt9x"]
Sep 17 00:20:35.926140 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:35.926110    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" path="/var/lib/kubelet/pods/81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab/volumes"
Sep 17 00:20:40.251433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:40.251387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:40.351229 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:40.351190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:47.964000 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:47.963963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:48.011036 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:48.010998    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:50.917757 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:50.917718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:51.130469 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:51.130432    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:20:55.324855 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:20:55.324794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:05.890610 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:05.890576    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:06.002294 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:06.002249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:06.054079 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:06.054048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:06.716297 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:06.716258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:06.807219 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:06.807178    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:24.440636 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:24.440594    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:24.540190 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:24.540129    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:24.919007 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:24.918973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:37.570485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:37.570445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:37.711436 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:37.711397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:44.049189 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:44.049151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:44.125192 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:44.125154    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:44.174930 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:44.174896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:44.404985 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:44.404893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:44.505276 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:44.505242    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:47.673668 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:47.673634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:21:47.772652 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:21:47.772619    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:19.139223 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:19.139167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:19.239116 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:19.239078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:20.721430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.721392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:20.785682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.785651    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"]
Sep 17 00:22:20.786073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.786053    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" containerName="console"
Sep 17 00:22:20.786219 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.786099    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" containerName="console"
Sep 17 00:22:20.786283 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.786251    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="81698cdc-ff3b-403e-8cb9-9f8ee6d8b5ab" containerName="console"
Sep 17 00:22:20.788974 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.788944    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:20.789423 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.789407    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.792260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.792079    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 00:22:20.792260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.792087    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 17 00:22:20.792260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.792123    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 00:22:20.792260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.792139    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 00:22:20.792260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.792192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d969b1e-68ee-4344-9730-1de23e415232-openshift-service-ca\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.792611 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.792273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdrvt\" (UniqueName: \"kubernetes.io/projected/7d969b1e-68ee-4344-9730-1de23e415232-kube-api-access-qdrvt\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.792611 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.792398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-maas-api-tls\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.792611 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.792424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-metrics-certs\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.797882 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.797856    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"]
Sep 17 00:22:20.893000 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.892956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-maas-api-tls\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.893000 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.893002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-metrics-certs\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.893311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.893035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d969b1e-68ee-4344-9730-1de23e415232-openshift-service-ca\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.893311 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:22:20.893158    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 17 00:22:20.893311 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:22:20.893242    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-metrics-certs podName:7d969b1e-68ee-4344-9730-1de23e415232 nodeName:}" failed. No retries permitted until 2026-09-17 00:22:21.393219124 +0000 UTC m=+741.919958597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-metrics-certs") pod "maas-api-7d747b4f9d-fs9ck" (UID: "7d969b1e-68ee-4344-9730-1de23e415232") : secret "maas-api-metrics-tls" not found
Sep 17 00:22:20.893488 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.893366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdrvt\" (UniqueName: \"kubernetes.io/projected/7d969b1e-68ee-4344-9730-1de23e415232-kube-api-access-qdrvt\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.894204 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.894176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d969b1e-68ee-4344-9730-1de23e415232-openshift-service-ca\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.895892 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.895868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-maas-api-tls\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.905306 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.905284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdrvt\" (UniqueName: \"kubernetes.io/projected/7d969b1e-68ee-4344-9730-1de23e415232-kube-api-access-qdrvt\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:20.934446 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:20.934410    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:21.038121 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.038025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:21.206465 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.206429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:21.305332 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.305294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:21.350617 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.350584    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"]
Sep 17 00:22:21.354060 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.354044    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"
Sep 17 00:22:21.356466 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.356437    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kljzn\""
Sep 17 00:22:21.356601 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.356473    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 17 00:22:21.363018 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.362993    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"]
Sep 17 00:22:21.399594 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.399562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a125c8de-812e-4c55-88bb-43ef7857b91e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-4wlhv\" (UID: \"a125c8de-812e-4c55-88bb-43ef7857b91e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"
Sep 17 00:22:21.399594 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.399598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds55l\" (UniqueName: \"kubernetes.io/projected/a125c8de-812e-4c55-88bb-43ef7857b91e-kube-api-access-ds55l\") pod \"payload-processing-5b54b7fbb7-4wlhv\" (UID: \"a125c8de-812e-4c55-88bb-43ef7857b91e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"
Sep 17 00:22:21.399789 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.399651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-metrics-certs\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:21.402068 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.402044    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-metrics-certs\") pod \"maas-api-7d747b4f9d-fs9ck\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") " pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:21.500426 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.500390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a125c8de-812e-4c55-88bb-43ef7857b91e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-4wlhv\" (UID: \"a125c8de-812e-4c55-88bb-43ef7857b91e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"
Sep 17 00:22:21.500426 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.500429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds55l\" (UniqueName: \"kubernetes.io/projected/a125c8de-812e-4c55-88bb-43ef7857b91e-kube-api-access-ds55l\") pod \"payload-processing-5b54b7fbb7-4wlhv\" (UID: \"a125c8de-812e-4c55-88bb-43ef7857b91e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"
Sep 17 00:22:21.501457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.501426    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a125c8de-812e-4c55-88bb-43ef7857b91e-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-4wlhv\" (UID: \"a125c8de-812e-4c55-88bb-43ef7857b91e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"
Sep 17 00:22:21.509342 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.509315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds55l\" (UniqueName: \"kubernetes.io/projected/a125c8de-812e-4c55-88bb-43ef7857b91e-kube-api-access-ds55l\") pod \"payload-processing-5b54b7fbb7-4wlhv\" (UID: \"a125c8de-812e-4c55-88bb-43ef7857b91e\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"
Sep 17 00:22:21.666290 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.666199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"
Sep 17 00:22:21.702344 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.702318    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:21.938242 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.938219    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"]
Sep 17 00:22:21.940714 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:22:21.940682    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda125c8de_812e_4c55_88bb_43ef7857b91e.slice/crio-9908a6a0e3b264e07d8a4fc60708fefd3f32602eade56ac12313ced5d47de0c8 WatchSource:0}: Error finding container 9908a6a0e3b264e07d8a4fc60708fefd3f32602eade56ac12313ced5d47de0c8: Status 404 returned error can't find the container with id 9908a6a0e3b264e07d8a4fc60708fefd3f32602eade56ac12313ced5d47de0c8
Sep 17 00:22:21.942939 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.942921    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:22:21.982228 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:21.982204    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"]
Sep 17 00:22:21.984522 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:22:21.984496    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d969b1e_68ee_4344_9730_1de23e415232.slice/crio-3aa188634306a8f00b3f4954cb679816ef715b66b8ee1fd754bcc6459523624a WatchSource:0}: Error finding container 3aa188634306a8f00b3f4954cb679816ef715b66b8ee1fd754bcc6459523624a: Status 404 returned error can't find the container with id 3aa188634306a8f00b3f4954cb679816ef715b66b8ee1fd754bcc6459523624a
Sep 17 00:22:22.003377 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:22.003349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv" event={"ID":"a125c8de-812e-4c55-88bb-43ef7857b91e","Type":"ContainerStarted","Data":"9908a6a0e3b264e07d8a4fc60708fefd3f32602eade56ac12313ced5d47de0c8"}
Sep 17 00:22:22.004587 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:22.004557    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck" event={"ID":"7d969b1e-68ee-4344-9730-1de23e415232","Type":"ContainerStarted","Data":"3aa188634306a8f00b3f4954cb679816ef715b66b8ee1fd754bcc6459523624a"}
Sep 17 00:22:25.024710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:25.024665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv" event={"ID":"a125c8de-812e-4c55-88bb-43ef7857b91e","Type":"ContainerStarted","Data":"c36ddc1fb4be0672ec6030913d7442ce4fd0dae73835ba090c5ded2ccf17f07d"}
Sep 17 00:22:25.025243 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:25.024773    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"
Sep 17 00:22:25.026334 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:25.026310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck" event={"ID":"7d969b1e-68ee-4344-9730-1de23e415232","Type":"ContainerStarted","Data":"057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36"}
Sep 17 00:22:25.026464 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:25.026361    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:25.041456 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:25.041409    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv" podStartSLOduration=1.53830596 podStartE2EDuration="4.041396429s" totalImagesPullingTime="2.503090469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:22:25.039408653 +0000 UTC m=+745.566148136" watchObservedRunningTime="2026-09-17 00:22:25.041396429 +0000 UTC m=+745.568135908"
Sep 17 00:22:25.055825 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:25.055766    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck" podStartSLOduration=2.546086322 podStartE2EDuration="5.055752012s" totalImagesPullingTime="2.50966569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:22:25.05429869 +0000 UTC m=+745.581038192" watchObservedRunningTime="2026-09-17 00:22:25.055752012 +0000 UTC m=+745.582491491"
Sep 17 00:22:31.037327 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:31.037294    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:22:32.092417 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:32.092364    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:32.187834 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:32.187766    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:36.033171 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:36.033139    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-4wlhv"
Sep 17 00:22:37.126433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:37.126396    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:22:51.109342 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:22:51.109308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:23:11.411268 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:23:11.411229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:23:24.524533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:23:24.524495    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:23:32.695527 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:23:32.695486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:23:40.027427 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:23:40.027381    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:23:52.593900 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:23:52.593858    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:05.657049 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:05.657013    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:25:05.663682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:05.663651    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:25:05.926723 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:05.926633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:15.944954 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:15.944922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:15.992972 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:15.992927    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:22.968502 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:22.968448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:23.067864 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:23.067824    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:24.202419 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:24.202378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:24.300598 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:24.300550    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:32.783638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:32.783600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:42.639626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:42.639595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:42.736729 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:42.736696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:42.856972 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:42.856938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:43.028950 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.028871    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"]
Sep 17 00:25:43.032753 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.032732    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.035387 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.035362    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-2faea3-openshift-default-dockercfg-q88pg\""
Sep 17 00:25:43.042736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.042483    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"]
Sep 17 00:25:43.059593 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.059561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:43.133696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.133633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:43.147795 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.147751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-envoy\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.147795 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.147795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-socket\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.148006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.147831    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-podinfo\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.148006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.147900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-credential-socket\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.148006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.147939    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-token\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.148006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.147970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjfwm\" (UniqueName: \"kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-kube-api-access-bjfwm\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.148157 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.148048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istiod-ca-cert\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.148157 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.148074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-data\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.148157 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.148136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-certs\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.197745 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.197712    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"]
Sep 17 00:25:43.201573 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.201551    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.204087 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.204061    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-76944c-openshift-default-dockercfg-n69r5\""
Sep 17 00:25:43.213816 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.213777    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"]
Sep 17 00:25:43.230545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.230515    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:43.249567 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.249533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istiod-ca-cert\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.249700 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.249568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-data\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.249700 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.249646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-certs\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.249830 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.249770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-envoy\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.249892 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.249826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-socket\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.249892 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.249859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-podinfo\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.249997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.249900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-credential-socket\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.249997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.249928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-token\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.249997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.249958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjfwm\" (UniqueName: \"kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-kube-api-access-bjfwm\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.250147 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.250057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-certs\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.250542 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.250318    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-data\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.250542 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.250354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istiod-ca-cert\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.250542 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.250497    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-credential-socket\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.250728 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.250618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-socket\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.252877 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.252832    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-envoy\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.253063 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.253046    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-podinfo\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.258267 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.258239    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjfwm\" (UniqueName: \"kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-kube-api-access-bjfwm\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.258348 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.258288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-token\") pod \"e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") " pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.330394 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.330356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:43.348294 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.348269    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:43.350750 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.350723    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-envoy\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.350874 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.350772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-certs\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.350874 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.350798    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-token\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.350874 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.350849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2blr\" (UniqueName: \"kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-kube-api-access-s2blr\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.351004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.350884    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff091407-6e7e-4d6b-9c42-721ab670d16f-istiod-ca-cert\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.351004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.350927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-podinfo\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.351004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.350957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-credential-socket\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.351004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.350994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-socket\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.351141 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.351023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-data\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.388507 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.388466    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:43.453631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.452305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-envoy\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.453631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.452371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-certs\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.453631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.452402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-token\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.453631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.452429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2blr\" (UniqueName: \"kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-kube-api-access-s2blr\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.453631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.452463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff091407-6e7e-4d6b-9c42-721ab670d16f-istiod-ca-cert\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.453631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.452505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-podinfo\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.453631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.452537    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-credential-socket\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.453631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.452575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-socket\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.453631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.452603    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-data\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.454577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.453823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-credential-socket\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.454577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.453975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-certs\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.454577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.454152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-socket\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.454577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.454212    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff091407-6e7e-4d6b-9c42-721ab670d16f-istiod-ca-cert\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.454577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.454420    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-data\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.456860 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.456834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-envoy\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.457222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.457202    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-podinfo\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.460678 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.460652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2blr\" (UniqueName: \"kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-kube-api-access-s2blr\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.460775 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.460754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-token\") pod \"e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") " pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.515918 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.515891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:43.633393 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.629680    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"]
Sep 17 00:25:43.634489 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.634454    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:43.634612 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.634518    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:43.634612 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.634561    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:43.784230 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.784190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:43.795420 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.795390    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"]
Sep 17 00:25:43.798310 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:25:43.798272    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff091407_6e7e_4d6b_9c42_721ab670d16f.slice/crio-00fe553c2bd185d59a0f6d78358aa8a84a4474705e5c558dca56510a1de8eab4 WatchSource:0}: Error finding container 00fe553c2bd185d59a0f6d78358aa8a84a4474705e5c558dca56510a1de8eab4: Status 404 returned error can't find the container with id 00fe553c2bd185d59a0f6d78358aa8a84a4474705e5c558dca56510a1de8eab4
Sep 17 00:25:43.801149 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.801118    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:43.801231 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.801187    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:43.801231 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.801220    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:43.988636 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.988450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" event={"ID":"ff091407-6e7e-4d6b-9c42-721ab670d16f","Type":"ContainerStarted","Data":"21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146"}
Sep 17 00:25:43.988636 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.988513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" event={"ID":"ff091407-6e7e-4d6b-9c42-721ab670d16f","Type":"ContainerStarted","Data":"00fe553c2bd185d59a0f6d78358aa8a84a4474705e5c558dca56510a1de8eab4"}
Sep 17 00:25:43.990197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.990167    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" event={"ID":"87c0feab-a237-489c-98e0-8f17ebd5c1d5","Type":"ContainerStarted","Data":"1ce2ff2caf201afc167041a037d052125a2372183847710fd1c1a8845356923d"}
Sep 17 00:25:43.990319 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:43.990211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" event={"ID":"87c0feab-a237-489c-98e0-8f17ebd5c1d5","Type":"ContainerStarted","Data":"36789457b7b5912197bd10af405832cba3f61a336c75f6d96721799b572a4839"}
Sep 17 00:25:44.007309 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:44.007249    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" podStartSLOduration=1.007228378 podStartE2EDuration="1.007228378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:44.006084532 +0000 UTC m=+944.532824035" watchObservedRunningTime="2026-09-17 00:25:44.007228378 +0000 UTC m=+944.533967859"
Sep 17 00:25:44.026761 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:44.026710    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" podStartSLOduration=1.026694676 podStartE2EDuration="1.026694676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:44.024295907 +0000 UTC m=+944.551035434" watchObservedRunningTime="2026-09-17 00:25:44.026694676 +0000 UTC m=+944.553434155"
Sep 17 00:25:44.348716 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:44.348678    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:44.354147 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:44.354120    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:44.516396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:44.516363    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:44.521539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:44.521507    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:44.996530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:44.996472    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:44.996530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:44.996538    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:44.997281 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:44.997254    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:25:44.997382 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:44.997321    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:25:45.196521 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:45.196478    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:45.343888 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:45.343852    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:45.683792 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:45.683696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:46.203887 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:46.203850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:46.302165 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:46.302126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:46.401875 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:46.401832    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:46.648677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:46.648635    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:46.748376 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:46.748338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:47.642015 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.641981    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"]
Sep 17 00:25:47.645569 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.645542    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:47.648432 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.648407    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-76944c-serving-cert\""
Sep 17 00:25:47.648708 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.648687    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2nbqn\""
Sep 17 00:25:47.656418 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.656386    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"]
Sep 17 00:25:47.680579 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.680552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:47.786062 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.786026    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:47.796469 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.796440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-metrics-certs\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:47.796619 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.796511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-maas-api-tls\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:47.796619 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.796600    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:47.796731 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.796642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s89nd\" (UniqueName: \"kubernetes.io/projected/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-kube-api-access-s89nd\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:47.897522 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.897450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-metrics-certs\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:47.897522 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.897516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-maas-api-tls\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:47.897697 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.897586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:47.897697 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.897629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s89nd\" (UniqueName: \"kubernetes.io/projected/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-kube-api-access-s89nd\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:47.897697 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:25:47.897658    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-serving-cert: secret "maas-api-e2e-inf-a-76944c-serving-cert" not found
Sep 17 00:25:47.897837 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:25:47.897735    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-maas-api-tls podName:cd241322-4e3b-49fa-bfa8-a8f5f0771e4c nodeName:}" failed. No retries permitted until 2026-09-17 00:25:48.397714478 +0000 UTC m=+948.924453945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-maas-api-tls") pod "maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj" (UID: "cd241322-4e3b-49fa-bfa8-a8f5f0771e4c") : secret "maas-api-e2e-inf-a-76944c-serving-cert" not found
Sep 17 00:25:47.898352 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.898331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:47.900127 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.900107    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-metrics-certs\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:47.907901 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:47.907876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s89nd\" (UniqueName: \"kubernetes.io/projected/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-kube-api-access-s89nd\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:48.014581 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.014544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:48.244005 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.243923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:48.352392 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.352357    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"]
Sep 17 00:25:48.356043 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.356018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:25:48.358588 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.358566    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-76944c\""
Sep 17 00:25:48.358588 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.358586    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-76944c-dockercfg-mqgdp\""
Sep 17 00:25:48.368571 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.368543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"]
Sep 17 00:25:48.394645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.394612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:48.395264 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.395243    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"]
Sep 17 00:25:48.398640 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.398616    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:25:48.401577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.401557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-maas-api-tls\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:48.404387 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.404364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-maas-api-tls\") pod \"maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:48.406637 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.406612    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"]
Sep 17 00:25:48.503211 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.503125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjxh7\" (UniqueName: \"kubernetes.io/projected/c873614d-a355-409f-8876-00a4cb561732-kube-api-access-qjxh7\") pod \"payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd\" (UID: \"c873614d-a355-409f-8876-00a4cb561732\") " pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:25:48.503211 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.503168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52\" (UID: \"4e8e67f0-6e87-4bbb-93a7-31a1d4731077\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:25:48.503402 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.503300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c873614d-a355-409f-8876-00a4cb561732-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd\" (UID: \"c873614d-a355-409f-8876-00a4cb561732\") " pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:25:48.503402 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.503358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ffw4\" (UniqueName: \"kubernetes.io/projected/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-kube-api-access-6ffw4\") pod \"payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52\" (UID: \"4e8e67f0-6e87-4bbb-93a7-31a1d4731077\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:25:48.559729 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.559695    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:48.604370 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.604337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c873614d-a355-409f-8876-00a4cb561732-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd\" (UID: \"c873614d-a355-409f-8876-00a4cb561732\") " pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:25:48.604540 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.604399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ffw4\" (UniqueName: \"kubernetes.io/projected/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-kube-api-access-6ffw4\") pod \"payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52\" (UID: \"4e8e67f0-6e87-4bbb-93a7-31a1d4731077\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:25:48.604540 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.604459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjxh7\" (UniqueName: \"kubernetes.io/projected/c873614d-a355-409f-8876-00a4cb561732-kube-api-access-qjxh7\") pod \"payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd\" (UID: \"c873614d-a355-409f-8876-00a4cb561732\") " pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:25:48.604540 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.604480    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52\" (UID: \"4e8e67f0-6e87-4bbb-93a7-31a1d4731077\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:25:48.605157 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.605136    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c873614d-a355-409f-8876-00a4cb561732-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd\" (UID: \"c873614d-a355-409f-8876-00a4cb561732\") " pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:25:48.605333 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.605244    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52\" (UID: \"4e8e67f0-6e87-4bbb-93a7-31a1d4731077\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:25:48.612631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.612606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ffw4\" (UniqueName: \"kubernetes.io/projected/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-kube-api-access-6ffw4\") pod \"payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52\" (UID: \"4e8e67f0-6e87-4bbb-93a7-31a1d4731077\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:25:48.613279 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.613179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjxh7\" (UniqueName: \"kubernetes.io/projected/c873614d-a355-409f-8876-00a4cb561732-kube-api-access-qjxh7\") pod \"payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd\" (UID: \"c873614d-a355-409f-8876-00a4cb561732\") " pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:25:48.669404 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.669375    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:25:48.723636 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.719403    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:25:48.764726 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.764610    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:48.825236 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.825156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:48.835242 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.832314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"]
Sep 17 00:25:48.841577 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:25:48.840317    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd241322_4e3b_49fa_bfa8_a8f5f0771e4c.slice/crio-39776df4b363c7fc400dee4db87045c2a73d9680f687c18d51db9f3766934d4c WatchSource:0}: Error finding container 39776df4b363c7fc400dee4db87045c2a73d9680f687c18d51db9f3766934d4c: Status 404 returned error can't find the container with id 39776df4b363c7fc400dee4db87045c2a73d9680f687c18d51db9f3766934d4c
Sep 17 00:25:48.925144 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.925082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:48.942870 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:48.942847    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"]
Sep 17 00:25:48.944536 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:25:48.944506    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8e67f0_6e87_4bbb_93a7_31a1d4731077.slice/crio-9133d35415e1a490afb6cfb904bd20516536e1983dd30bd31efeb633ff9bd813 WatchSource:0}: Error finding container 9133d35415e1a490afb6cfb904bd20516536e1983dd30bd31efeb633ff9bd813: Status 404 returned error can't find the container with id 9133d35415e1a490afb6cfb904bd20516536e1983dd30bd31efeb633ff9bd813
Sep 17 00:25:49.006375 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.006351    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"]
Sep 17 00:25:49.007881 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:25:49.007849    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc873614d_a355_409f_8876_00a4cb561732.slice/crio-c29761e60ccee3cb4b55a334312afdd76d4857ed356b1267b79d58f0b9003267 WatchSource:0}: Error finding container c29761e60ccee3cb4b55a334312afdd76d4857ed356b1267b79d58f0b9003267: Status 404 returned error can't find the container with id c29761e60ccee3cb4b55a334312afdd76d4857ed356b1267b79d58f0b9003267
Sep 17 00:25:49.017884 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.017851    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd" event={"ID":"c873614d-a355-409f-8876-00a4cb561732","Type":"ContainerStarted","Data":"c29761e60ccee3cb4b55a334312afdd76d4857ed356b1267b79d58f0b9003267"}
Sep 17 00:25:49.019611 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.019586    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52" event={"ID":"4e8e67f0-6e87-4bbb-93a7-31a1d4731077","Type":"ContainerStarted","Data":"9133d35415e1a490afb6cfb904bd20516536e1983dd30bd31efeb633ff9bd813"}
Sep 17 00:25:49.020995 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.020971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj" event={"ID":"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c","Type":"ContainerStarted","Data":"39776df4b363c7fc400dee4db87045c2a73d9680f687c18d51db9f3766934d4c"}
Sep 17 00:25:49.303960 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.303922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:49.400510 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.400484    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:49.692762 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.692671    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"]
Sep 17 00:25:49.696670 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.696645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.699595 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.699571    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-cfe049-serving-cert\""
Sep 17 00:25:49.712861 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.707209    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"]
Sep 17 00:25:49.732785 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.732745    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:49.817396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.817354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.817577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.817475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-maas-api-tls\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.817577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.817516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-metrics-certs\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.817577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.817547    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fqph\" (UniqueName: \"kubernetes.io/projected/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-kube-api-access-7fqph\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.829940 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.829909    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:49.918297 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.918263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-maas-api-tls\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.918456 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.918308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-metrics-certs\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.918456 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.918342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fqph\" (UniqueName: \"kubernetes.io/projected/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-kube-api-access-7fqph\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.918456 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.918429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.919152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.919131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.921002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.920975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-maas-api-tls\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.921183 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.921160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-metrics-certs\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.926966 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.926938    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fqph\" (UniqueName: \"kubernetes.io/projected/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-kube-api-access-7fqph\") pod \"maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:49.930942 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:49.930915    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:50.012201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.012123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:50.028947 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.028776    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd" event={"ID":"c873614d-a355-409f-8876-00a4cb561732","Type":"ContainerStarted","Data":"95856537c2563d922644e48fca879ad5850f2dbee4f0114cda3d7dd7090dc653"}
Sep 17 00:25:50.028947 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.028860    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:25:50.031824 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.030696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52" event={"ID":"4e8e67f0-6e87-4bbb-93a7-31a1d4731077","Type":"ContainerStarted","Data":"9ab45704f51e44f970db6009b856ef3a83cd6c902bf13be6ba4dafb0ab70c3e0"}
Sep 17 00:25:50.031824 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.030888    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:25:50.032819 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.032780    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj" event={"ID":"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c","Type":"ContainerStarted","Data":"013ad69eebcc3cfa8f06694464316694c8e7f86329d0665a77e2d8db5b316e8b"}
Sep 17 00:25:50.032933 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.032864    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:50.045223 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.045175    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd" podStartSLOduration=2.045153737 podStartE2EDuration="2.045153737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:50.043984156 +0000 UTC m=+950.570723635" watchObservedRunningTime="2026-09-17 00:25:50.045153737 +0000 UTC m=+950.571893220"
Sep 17 00:25:50.060380 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.060325    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj" podStartSLOduration=2.53282483 podStartE2EDuration="3.060308731s" totalImagesPullingTime="527.483901ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:50.059631029 +0000 UTC m=+950.586370531" watchObservedRunningTime="2026-09-17 00:25:50.060308731 +0000 UTC m=+950.587048208"
Sep 17 00:25:50.079797 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.079748    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52" podStartSLOduration=2.079730917 podStartE2EDuration="2.079730917s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:50.077098789 +0000 UTC m=+950.603838297" watchObservedRunningTime="2026-09-17 00:25:50.079730917 +0000 UTC m=+950.606470397"
Sep 17 00:25:50.287627 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.287602    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"]
Sep 17 00:25:50.289008 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:25:50.288977    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca894ebc_20fc_4f1b_935b_6ed8a2d1d6e1.slice/crio-79dd534a94bc486b4c87c30556a4763998a440a1c7ebb1e433b46f8a70028170 WatchSource:0}: Error finding container 79dd534a94bc486b4c87c30556a4763998a440a1c7ebb1e433b46f8a70028170: Status 404 returned error can't find the container with id 79dd534a94bc486b4c87c30556a4763998a440a1c7ebb1e433b46f8a70028170
Sep 17 00:25:50.395210 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.395160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:50.493381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.493338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:50.825781 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:50.825733    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:51.040101 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:51.040005    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt" event={"ID":"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1","Type":"ContainerStarted","Data":"aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6"}
Sep 17 00:25:51.040259 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:51.040109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt" event={"ID":"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1","Type":"ContainerStarted","Data":"79dd534a94bc486b4c87c30556a4763998a440a1c7ebb1e433b46f8a70028170"}
Sep 17 00:25:51.040507 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:51.040473    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:51.056992 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:51.056947    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt" podStartSLOduration=1.6836325840000002 podStartE2EDuration="2.05693122s" totalImagesPullingTime="373.298636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:51.055457021 +0000 UTC m=+951.582196523" watchObservedRunningTime="2026-09-17 00:25:51.05693122 +0000 UTC m=+951.583670698"
Sep 17 00:25:51.726400 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:51.726368    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:51.933907 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:51.933866    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:52.031736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:52.031642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:52.500984 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:52.500946    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:52.601666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:52.601629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:53.213768 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.213734    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"]
Sep 17 00:25:53.217658 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.217632    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.220232 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.220209    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4df62ae2-openshift-default-dockercfg-sk7wd\""
Sep 17 00:25:53.229540 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.229516    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"]
Sep 17 00:25:53.251173 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.251134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-token\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.251301 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.251188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-podinfo\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.251301 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.251257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-socket\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.251301 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.251281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-credential-socket\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.251438 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.251328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-envoy\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.251438 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.251355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istiod-ca-cert\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.251438 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.251400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-data\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.251574 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.251456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rm6n\" (UniqueName: \"kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-kube-api-access-9rm6n\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.251574 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.251496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-certs\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352076 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-socket\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352076 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-credential-socket\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-envoy\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istiod-ca-cert\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-data\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rm6n\" (UniqueName: \"kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-kube-api-access-9rm6n\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352531 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-certs\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352531 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-token\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352531 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-podinfo\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352625 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-socket\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352782 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-credential-socket\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352993 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352858    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-data\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.352993 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.352936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-certs\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.353139 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.353120    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istiod-ca-cert\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.354575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.354545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-envoy\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.354953 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.354934    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-podinfo\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.360274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.360250    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-token\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.360376 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.360358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rm6n\" (UniqueName: \"kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-kube-api-access-9rm6n\") pod \"e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") " pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.399064 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.399028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:53.500046 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.499937    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:53.530728 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.530702    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:53.811157 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.811127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"]
Sep 17 00:25:53.812661 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:25:53.812639    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d2c7a3_1b66_48ff_af1b_22b2f8926bd5.slice/crio-4b98e7d1d02914e9c628d6e73c7a0cf4ecd6bf6d5fb3f7b630eca6079e784a8e WatchSource:0}: Error finding container 4b98e7d1d02914e9c628d6e73c7a0cf4ecd6bf6d5fb3f7b630eca6079e784a8e: Status 404 returned error can't find the container with id 4b98e7d1d02914e9c628d6e73c7a0cf4ecd6bf6d5fb3f7b630eca6079e784a8e
Sep 17 00:25:53.815020 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.814988    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:53.815096 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.815057    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:53.815096 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:53.815089    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:54.058201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:54.058153    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" event={"ID":"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5","Type":"ContainerStarted","Data":"79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022"}
Sep 17 00:25:54.058404 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:54.058214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" event={"ID":"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5","Type":"ContainerStarted","Data":"4b98e7d1d02914e9c628d6e73c7a0cf4ecd6bf6d5fb3f7b630eca6079e784a8e"}
Sep 17 00:25:54.076263 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:54.076160    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" podStartSLOduration=1.076143558 podStartE2EDuration="1.076143558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:54.075566413 +0000 UTC m=+954.602305922" watchObservedRunningTime="2026-09-17 00:25:54.076143558 +0000 UTC m=+954.602883037"
Sep 17 00:25:54.531692 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:54.531610    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:54.536835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:54.536791    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:55.062823 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:55.062775    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:55.063707 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:55.063681    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:25:55.470684 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:55.470596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:55.695942 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:55.695897    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:56.045083 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:56.045053    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:25:56.516248 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:56.516144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:56.628227 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:56.628176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:56.939473 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:56.939438    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:57.052628 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:57.052595    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:25:57.166813 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:57.166759    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:57.376550 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:57.376516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:58.379336 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:58.379294    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:59.325770 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:59.325738    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:59.427557 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:59.427521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:59.532705 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:59.532673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:25:59.882470 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:25:59.882433    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:00.024745 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.024708    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"]
Sep 17 00:26:00.047975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.047948    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:00.052719 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.052693    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4df62ae2-dockercfg-9rw9l\""
Sep 17 00:26:00.053364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.053166    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4df62ae2\""
Sep 17 00:26:00.061849 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.054790    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"]
Sep 17 00:26:00.148861 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.148748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26d39ab2-389f-4b7f-b70f-8c13edb105a0-plugins-config-volume\") pod \"payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx\" (UID: \"26d39ab2-389f-4b7f-b70f-8c13edb105a0\") " pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:00.158330 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.158297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbvcm\" (UniqueName: \"kubernetes.io/projected/26d39ab2-389f-4b7f-b70f-8c13edb105a0-kube-api-access-cbvcm\") pod \"payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx\" (UID: \"26d39ab2-389f-4b7f-b70f-8c13edb105a0\") " pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:00.259959 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.259918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbvcm\" (UniqueName: \"kubernetes.io/projected/26d39ab2-389f-4b7f-b70f-8c13edb105a0-kube-api-access-cbvcm\") pod \"payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx\" (UID: \"26d39ab2-389f-4b7f-b70f-8c13edb105a0\") " pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:00.260153 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.260007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26d39ab2-389f-4b7f-b70f-8c13edb105a0-plugins-config-volume\") pod \"payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx\" (UID: \"26d39ab2-389f-4b7f-b70f-8c13edb105a0\") " pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:00.260689 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.260669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26d39ab2-389f-4b7f-b70f-8c13edb105a0-plugins-config-volume\") pod \"payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx\" (UID: \"26d39ab2-389f-4b7f-b70f-8c13edb105a0\") " pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:00.270706 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.270676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbvcm\" (UniqueName: \"kubernetes.io/projected/26d39ab2-389f-4b7f-b70f-8c13edb105a0-kube-api-access-cbvcm\") pod \"payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx\" (UID: \"26d39ab2-389f-4b7f-b70f-8c13edb105a0\") " pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:00.284370 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.284332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:00.373639 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.373599    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:00.386856 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.386790    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:00.554828 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.543322    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:00.623426 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.623335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:00.697083 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:00.697056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"]
Sep 17 00:26:00.698643 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:26:00.698609    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d39ab2_389f_4b7f_b70f_8c13edb105a0.slice/crio-e7b337c1c469155a3595a72fa3f89be87d2aa0974722778215e308cef0921c70 WatchSource:0}: Error finding container e7b337c1c469155a3595a72fa3f89be87d2aa0974722778215e308cef0921c70: Status 404 returned error can't find the container with id e7b337c1c469155a3595a72fa3f89be87d2aa0974722778215e308cef0921c70
Sep 17 00:26:01.043573 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.043541    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:26:01.044497 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.044471    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:26:01.105783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.105746    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx" event={"ID":"26d39ab2-389f-4b7f-b70f-8c13edb105a0","Type":"ContainerStarted","Data":"3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97"}
Sep 17 00:26:01.106911 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.106873    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx" event={"ID":"26d39ab2-389f-4b7f-b70f-8c13edb105a0","Type":"ContainerStarted","Data":"e7b337c1c469155a3595a72fa3f89be87d2aa0974722778215e308cef0921c70"}
Sep 17 00:26:01.107127 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.107112    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:01.120112 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.120082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:01.142824 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.139670    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx" podStartSLOduration=2.139642296 podStartE2EDuration="2.139642296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:26:01.136191304 +0000 UTC m=+961.662930783" watchObservedRunningTime="2026-09-17 00:26:01.139642296 +0000 UTC m=+961.666381777"
Sep 17 00:26:01.221834 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.221488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:01.327600 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.327502    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:01.436680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.436634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:01.538783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.538743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:01.623879 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.622742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:01.691663 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.691602    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:01.796249 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:01.795559    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:02.324425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:02.324386    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:02.425531 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:02.425490    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:02.530253 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:02.530155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:02.727977 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:02.727880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:02.827072 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:02.827029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:02.927484 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:02.927447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:03.126429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:03.126391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:04.056099 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:04.054370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:04.153064 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:04.153026    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:04.253675 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:04.253618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:04.674100 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:04.674055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:04.799208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:04.799162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:04.919326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:04.919293    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:05.013597 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.013503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:05.022427 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.022394    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"]
Sep 17 00:26:05.025289 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.025270    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:26:05.027668 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.027638    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-f492a5\""
Sep 17 00:26:05.037158 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.037138    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"]
Sep 17 00:26:05.060350 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.053259    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"]
Sep 17 00:26:05.060350 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.056157    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:26:05.060350 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.058999    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-f492a5-dockercfg-l7wwq\""
Sep 17 00:26:05.071281 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.068335    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"]
Sep 17 00:26:05.117101 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.117067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd\" (UID: \"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:26:05.117239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.117191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4257v\" (UniqueName: \"kubernetes.io/projected/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-kube-api-access-4257v\") pod \"payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd\" (UID: \"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:26:05.117239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.117227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6378f506-21c9-4589-805d-8b4f55c85c8d-plugins-config-volume\") pod \"payload-processing-e2e-autores-f492a5-65d86f588c-g44lf\" (UID: \"6378f506-21c9-4589-805d-8b4f55c85c8d\") " pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:26:05.117336 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.117247    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w5lz\" (UniqueName: \"kubernetes.io/projected/6378f506-21c9-4589-805d-8b4f55c85c8d-kube-api-access-4w5lz\") pod \"payload-processing-e2e-autores-f492a5-65d86f588c-g44lf\" (UID: \"6378f506-21c9-4589-805d-8b4f55c85c8d\") " pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:26:05.218260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.218223    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6378f506-21c9-4589-805d-8b4f55c85c8d-plugins-config-volume\") pod \"payload-processing-e2e-autores-f492a5-65d86f588c-g44lf\" (UID: \"6378f506-21c9-4589-805d-8b4f55c85c8d\") " pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:26:05.218260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.218261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5lz\" (UniqueName: \"kubernetes.io/projected/6378f506-21c9-4589-805d-8b4f55c85c8d-kube-api-access-4w5lz\") pod \"payload-processing-e2e-autores-f492a5-65d86f588c-g44lf\" (UID: \"6378f506-21c9-4589-805d-8b4f55c85c8d\") " pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:26:05.218507 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.218337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd\" (UID: \"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:26:05.218507 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.218402    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4257v\" (UniqueName: \"kubernetes.io/projected/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-kube-api-access-4257v\") pod \"payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd\" (UID: \"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:26:05.219222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.219194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6378f506-21c9-4589-805d-8b4f55c85c8d-plugins-config-volume\") pod \"payload-processing-e2e-autores-f492a5-65d86f588c-g44lf\" (UID: \"6378f506-21c9-4589-805d-8b4f55c85c8d\") " pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:26:05.219332 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.219194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd\" (UID: \"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:26:05.226200 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.226176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4257v\" (UniqueName: \"kubernetes.io/projected/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-kube-api-access-4257v\") pod \"payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd\" (UID: \"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:26:05.226704 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.226674    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w5lz\" (UniqueName: \"kubernetes.io/projected/6378f506-21c9-4589-805d-8b4f55c85c8d-kube-api-access-4w5lz\") pod \"payload-processing-e2e-autores-f492a5-65d86f588c-g44lf\" (UID: \"6378f506-21c9-4589-805d-8b4f55c85c8d\") " pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:26:05.337605 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.337521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:26:05.372242 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.372208    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:26:05.432711 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.432633    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:05.589315 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.589183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:05.610321 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.609967    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"]
Sep 17 00:26:05.659537 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:05.658527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"]
Sep 17 00:26:05.663139 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:26:05.662844    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6378f506_21c9_4589_805d_8b4f55c85c8d.slice/crio-7b6107a5ccc62dd8a43fb03ddf500484852afb44574e482422f873656a19a7f6 WatchSource:0}: Error finding container 7b6107a5ccc62dd8a43fb03ddf500484852afb44574e482422f873656a19a7f6: Status 404 returned error can't find the container with id 7b6107a5ccc62dd8a43fb03ddf500484852afb44574e482422f873656a19a7f6
Sep 17 00:26:06.142820 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.142676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd" event={"ID":"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e","Type":"ContainerStarted","Data":"7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52"}
Sep 17 00:26:06.142820 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.142747    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:26:06.142820 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.142770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd" event={"ID":"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e","Type":"ContainerStarted","Data":"ee38c2cac5e0d6f664d4de4374165d359ca801e2e1244d664b45a1de8c090a50"}
Sep 17 00:26:06.145206 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.145165    2565 generic.go:356] "Generic (PLEG): container finished" podID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerID="21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146" exitCode=0
Sep 17 00:26:06.145352 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.145238    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" event={"ID":"ff091407-6e7e-4d6b-9c42-721ab670d16f","Type":"ContainerDied","Data":"21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146"}
Sep 17 00:26:06.145861 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.145842    2565 scope.go:117] "RemoveContainer" containerID="21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146"
Sep 17 00:26:06.147254 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.147222    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:06.147355 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.147306    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:06.147355 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.147350    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:06.148002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.147977    2565 generic.go:356] "Generic (PLEG): container finished" podID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerID="1ce2ff2caf201afc167041a037d052125a2372183847710fd1c1a8845356923d" exitCode=0
Sep 17 00:26:06.148105 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.148087    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" event={"ID":"87c0feab-a237-489c-98e0-8f17ebd5c1d5","Type":"ContainerDied","Data":"1ce2ff2caf201afc167041a037d052125a2372183847710fd1c1a8845356923d"}
Sep 17 00:26:06.148519 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.148503    2565 scope.go:117] "RemoveContainer" containerID="1ce2ff2caf201afc167041a037d052125a2372183847710fd1c1a8845356923d"
Sep 17 00:26:06.149953 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.149845    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:06.149953 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.149934    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:06.150081 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.149991    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:06.151057 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.150950    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf" event={"ID":"6378f506-21c9-4589-805d-8b4f55c85c8d","Type":"ContainerStarted","Data":"ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca"}
Sep 17 00:26:06.151057 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.150993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf" event={"ID":"6378f506-21c9-4589-805d-8b4f55c85c8d","Type":"ContainerStarted","Data":"7b6107a5ccc62dd8a43fb03ddf500484852afb44574e482422f873656a19a7f6"}
Sep 17 00:26:06.151057 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.151036    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:26:06.159763 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.159713    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd" podStartSLOduration=1.159696296 podStartE2EDuration="1.159696296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:26:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:26:06.158102113 +0000 UTC m=+966.684841819" watchObservedRunningTime="2026-09-17 00:26:06.159696296 +0000 UTC m=+966.686435774"
Sep 17 00:26:06.199625 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.199583    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf" podStartSLOduration=1.199569574 podStartE2EDuration="1.199569574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:26:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:26:06.198524736 +0000 UTC m=+966.725264241" watchObservedRunningTime="2026-09-17 00:26:06.199569574 +0000 UTC m=+966.726309053"
Sep 17 00:26:06.313219 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.313152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:06.424253 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.424207    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:06.514962 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.514858    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:06.878148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.878116    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:06.969390 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:06.969331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:07.158451 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:07.158358    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" event={"ID":"ff091407-6e7e-4d6b-9c42-721ab670d16f","Type":"ContainerStarted","Data":"9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9"}
Sep 17 00:26:07.160725 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:07.160696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" event={"ID":"87c0feab-a237-489c-98e0-8f17ebd5c1d5","Type":"ContainerStarted","Data":"d1c9360f8d0c000dbbacf0d7a6731ff2a41431d159c3e2448fe57a0305b69e50"}
Sep 17 00:26:07.317074 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:07.317028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:07.349485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:07.348885    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:26:07.349485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:07.349055    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 17 00:26:07.349485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:07.349105    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 17 00:26:07.418840 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:07.418723    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:07.516709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:07.516673    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:26:07.517131 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:07.517033    2565 patch_prober.go:28] interesting pod/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 17 00:26:07.517313 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:07.517289    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 17 00:26:08.334747 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:08.334710    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:08.349767 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:08.349728    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 17 00:26:08.350069 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:08.350038    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 17 00:26:08.517399 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:08.517357    2565 patch_prober.go:28] interesting pod/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 17 00:26:08.517603 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:08.517426    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 17 00:26:08.873471 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:08.873428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:08.972835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:08.972782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:09.097159 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:09.097116    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:09.197277 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:09.197162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:09.349052 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:09.349006    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 17 00:26:09.349522 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:09.349076    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 17 00:26:09.517168 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:09.517028    2565 patch_prober.go:28] interesting pod/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 17 00:26:09.517168 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:09.517113    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 17 00:26:09.916785 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:09.916751    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:10.349449 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:10.349405    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 17 00:26:10.349979 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:10.349469    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 17 00:26:10.516677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:10.516635    2565 patch_prober.go:28] interesting pod/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 17 00:26:10.516978 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:10.516944    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 17 00:26:10.755584 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:10.755489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:11.349379 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:11.349333    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 17 00:26:11.349547 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:11.349407    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 17 00:26:11.452030 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:11.452000    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:11.517296 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:11.517260    2565 patch_prober.go:28] interesting pod/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 17 00:26:11.517568 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:11.517529    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 17 00:26:12.248594 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:12.248492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:12.349088 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:12.349043    2565 patch_prober.go:28] interesting pod/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 17 00:26:12.349282 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:12.349113    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 17 00:26:12.517821 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:12.517270    2565 patch_prober.go:28] interesting pod/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 17 00:26:12.517821 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:12.517337    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 17 00:26:12.941124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:12.941079    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:13.122887 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:13.122841    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:13.352548 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:13.352504    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:26:13.353087 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:13.353066    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:26:13.353681 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:13.353663    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:26:13.521070 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:13.521040    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:26:13.521496 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:13.521376    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:26:13.522043 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:13.522024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:26:13.652988 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:13.652887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:14.763620 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:14.763582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:14.843269 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:14.843236    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:14.912933 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:14.912898    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:15.164201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:15.164167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:15.223232 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:15.223205    2565 generic.go:356] "Generic (PLEG): container finished" podID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerID="79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022" exitCode=0
Sep 17 00:26:15.223398 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:15.223280    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" event={"ID":"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5","Type":"ContainerDied","Data":"79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022"}
Sep 17 00:26:15.223866 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:15.223847    2565 scope.go:117] "RemoveContainer" containerID="79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022"
Sep 17 00:26:15.224997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:15.224971    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:15.225084 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:15.225035    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:15.225084 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:15.225068    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:16.234169 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:16.234134    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" event={"ID":"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5","Type":"ContainerStarted","Data":"af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a"}
Sep 17 00:26:16.531261 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:16.531152    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:26:16.531475 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:16.531449    2565 patch_prober.go:28] interesting pod/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 00:26:16.531526 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:16.531506    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 00:26:17.163104 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:17.163075    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:26:17.163276 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:17.163149    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:26:17.531543 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:17.531454    2565 patch_prober.go:28] interesting pod/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 00:26:17.531543 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:17.531513    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 00:26:18.531476 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:18.531438    2565 patch_prober.go:28] interesting pod/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 00:26:18.531654 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:18.531495    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 00:26:19.531233 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:19.531196    2565 patch_prober.go:28] interesting pod/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 00:26:19.531415 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:19.531256    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 00:26:20.330655 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:20.330616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:20.531063 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:20.531028    2565 patch_prober.go:28] interesting pod/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 00:26:20.531264 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:20.531083    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 00:26:20.897330 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:20.897289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:20.997668 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:20.997609    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:21.535977 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:21.535945    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:26:21.536380 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:21.536223    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:26:21.536751 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:21.536731    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:26:22.046930 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:22.046890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:22.932172 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:22.932133    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:23.829693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:23.829654    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:24.493272 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:24.493228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:24.655359 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:24.655318    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:25.375318 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:25.375285    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:25.505274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:25.505238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:26.195975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:26.195939    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:27.065726 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:27.065695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:28.054986 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:28.054952    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:29.021332 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:29.021291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:29.857934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:29.857902    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:30.712486 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:30.712451    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:31.481823 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:31.481771    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:32.347867 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:32.347792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:36.487629 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:36.487596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:36.813874 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:36.813839    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:37.426329 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.426286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:37.449866 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.449834    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"]
Sep 17 00:26:37.450136 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.450107    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx" podUID="26d39ab2-389f-4b7f-b70f-8c13edb105a0" containerName="payload-processing" containerID="cri-o://3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97" gracePeriod=30
Sep 17 00:26:37.526517 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.526482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:37.605085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.605008    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:37.667197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.667151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:37.711039 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.711011    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:37.745153 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.745109    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"]
Sep 17 00:26:37.745420 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.745387    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy" containerID="cri-o://af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a" gracePeriod=30
Sep 17 00:26:37.747359 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.747286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:37.817071 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.817048    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26d39ab2-389f-4b7f-b70f-8c13edb105a0-plugins-config-volume\") pod \"26d39ab2-389f-4b7f-b70f-8c13edb105a0\" (UID: \"26d39ab2-389f-4b7f-b70f-8c13edb105a0\") "
Sep 17 00:26:37.817204 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.817174    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbvcm\" (UniqueName: \"kubernetes.io/projected/26d39ab2-389f-4b7f-b70f-8c13edb105a0-kube-api-access-cbvcm\") pod \"26d39ab2-389f-4b7f-b70f-8c13edb105a0\" (UID: \"26d39ab2-389f-4b7f-b70f-8c13edb105a0\") "
Sep 17 00:26:37.817409 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.817386    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26d39ab2-389f-4b7f-b70f-8c13edb105a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "26d39ab2-389f-4b7f-b70f-8c13edb105a0" (UID: "26d39ab2-389f-4b7f-b70f-8c13edb105a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:26:37.819337 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.819316    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26d39ab2-389f-4b7f-b70f-8c13edb105a0-kube-api-access-cbvcm" (OuterVolumeSpecName: "kube-api-access-cbvcm") pod "26d39ab2-389f-4b7f-b70f-8c13edb105a0" (UID: "26d39ab2-389f-4b7f-b70f-8c13edb105a0"). InnerVolumeSpecName "kube-api-access-cbvcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:26:37.918095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.918066    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbvcm\" (UniqueName: \"kubernetes.io/projected/26d39ab2-389f-4b7f-b70f-8c13edb105a0-kube-api-access-cbvcm\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:26:37.918095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:37.918091    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26d39ab2-389f-4b7f-b70f-8c13edb105a0-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:26:38.044645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.044595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:38.232402 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.232356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:38.332842 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.332753    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:38.354504 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.354473    2565 generic.go:356] "Generic (PLEG): container finished" podID="26d39ab2-389f-4b7f-b70f-8c13edb105a0" containerID="3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97" exitCode=0
Sep 17 00:26:38.354643 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.354526    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"
Sep 17 00:26:38.354643 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.354528    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx" event={"ID":"26d39ab2-389f-4b7f-b70f-8c13edb105a0","Type":"ContainerDied","Data":"3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97"}
Sep 17 00:26:38.354745 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.354655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx" event={"ID":"26d39ab2-389f-4b7f-b70f-8c13edb105a0","Type":"ContainerDied","Data":"e7b337c1c469155a3595a72fa3f89be87d2aa0974722778215e308cef0921c70"}
Sep 17 00:26:38.354745 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.354680    2565 scope.go:117] "RemoveContainer" containerID="3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97"
Sep 17 00:26:38.363643 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.363625    2565 scope.go:117] "RemoveContainer" containerID="3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97"
Sep 17 00:26:38.364003 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:26:38.363981    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97\": container with ID starting with 3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97 not found: ID does not exist" containerID="3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97"
Sep 17 00:26:38.364090 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.364010    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97"} err="failed to get container status \"3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97\": rpc error: code = NotFound desc = could not find container \"3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97\": container with ID starting with 3e6dc437e6a92357e15efb678968c6acd16165a207acd9f543322cf103501b97 not found: ID does not exist"
Sep 17 00:26:38.375474 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.375450    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"]
Sep 17 00:26:38.379178 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.379152    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4df62ae2-777f584bc5-hj8zx"]
Sep 17 00:26:38.441818 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.441772    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:38.725258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.725183    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"]
Sep 17 00:26:38.725892 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.725872    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26d39ab2-389f-4b7f-b70f-8c13edb105a0" containerName="payload-processing"
Sep 17 00:26:38.725892 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.725894    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="26d39ab2-389f-4b7f-b70f-8c13edb105a0" containerName="payload-processing"
Sep 17 00:26:38.725999 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.725964    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="26d39ab2-389f-4b7f-b70f-8c13edb105a0" containerName="payload-processing"
Sep 17 00:26:38.728846 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.728828    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.731205 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.731183    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-3932eef5-gw-openshift-default-dockercfg-2p7zt\""
Sep 17 00:26:38.733215 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.733190    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istiod-ca-cert\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.733323 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.733230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz8gk\" (UniqueName: \"kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-kube-api-access-jz8gk\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.733323 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.733262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-token\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.733323 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.733294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-socket\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.733496 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.733323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-credential-socket\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.733496 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.733386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-envoy\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.733496 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.733423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-certs\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.733645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.733528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-podinfo\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.733645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.733627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-data\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.741682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.741659    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"]
Sep 17 00:26:38.750641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.750606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:38.835274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.835231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-data\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.835459 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.835293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istiod-ca-cert\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.835459 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.835324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz8gk\" (UniqueName: \"kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-kube-api-access-jz8gk\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.835459 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.835352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-token\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.835459 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.835387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-socket\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.835459 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.835410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-credential-socket\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.835737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.835474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-envoy\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.835737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.835515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-certs\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.835737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.835592    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-podinfo\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.835737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.835668    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-data\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.835985 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.835952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-socket\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.838833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.836640    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istiod-ca-cert\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.838833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.837579    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-credential-socket\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.838833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.837642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-certs\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.842830 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.841390    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-podinfo\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.842830 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.841614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-envoy\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.848606 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.848308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz8gk\" (UniqueName: \"kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-kube-api-access-jz8gk\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.850982 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.850958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-token\") pod \"e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") " pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:38.902776 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:38.902739    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:39.002269 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:39.002173    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:39.042178 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:39.042141    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:39.316221 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:39.316194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"]
Sep 17 00:26:39.317565 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:26:39.317541    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc3fae5_59d0_49c3_bf93_1fdcf8465724.slice/crio-9a7c680c1bfd9df633330ac483216b7877021844e1a29bf9133e6d0de0534201 WatchSource:0}: Error finding container 9a7c680c1bfd9df633330ac483216b7877021844e1a29bf9133e6d0de0534201: Status 404 returned error can't find the container with id 9a7c680c1bfd9df633330ac483216b7877021844e1a29bf9133e6d0de0534201
Sep 17 00:26:39.320498 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:39.320465    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:39.320598 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:39.320530    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:39.320598 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:39.320564    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:39.361175 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:39.361145    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" event={"ID":"2cc3fae5-59d0-49c3-bf93-1fdcf8465724","Type":"ContainerStarted","Data":"9a7c680c1bfd9df633330ac483216b7877021844e1a29bf9133e6d0de0534201"}
Sep 17 00:26:39.815286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:39.815249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:39.927067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:39.927038    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26d39ab2-389f-4b7f-b70f-8c13edb105a0" path="/var/lib/kubelet/pods/26d39ab2-389f-4b7f-b70f-8c13edb105a0/volumes"
Sep 17 00:26:40.368057 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:40.368019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" event={"ID":"2cc3fae5-59d0-49c3-bf93-1fdcf8465724","Type":"ContainerStarted","Data":"3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3"}
Sep 17 00:26:40.516894 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:40.516866    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:41.042299 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:41.042267    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:41.047325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:41.047303    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:41.068480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:41.068436    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" podStartSLOduration=3.068423198 podStartE2EDuration="3.068423198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:26:40.386625796 +0000 UTC m=+1000.913365276" watchObservedRunningTime="2026-09-17 00:26:41.068423198 +0000 UTC m=+1001.595162676"
Sep 17 00:26:41.244223 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:41.244194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:41.373865 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:41.373835    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:41.374811 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:41.374783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:26:42.008703 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:42.008656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:42.128147 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:42.128103    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:42.784275 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:42.784240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:42.886564 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:42.886533    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:42.985439 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:42.985403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:43.008769 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.008719    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:26:43.074907 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.074876    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-token\") pod \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") "
Sep 17 00:26:43.074907 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.074911    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istiod-ca-cert\") pod \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") "
Sep 17 00:26:43.075095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.074952    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rm6n\" (UniqueName: \"kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-kube-api-access-9rm6n\") pod \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") "
Sep 17 00:26:43.075095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.075000    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-podinfo\") pod \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") "
Sep 17 00:26:43.075316 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.075281    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-envoy\") pod \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") "
Sep 17 00:26:43.075392 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.075370    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-credential-socket\") pod \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") "
Sep 17 00:26:43.075392 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.075369    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" (UID: "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:26:43.075502 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.075398    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-socket\") pod \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") "
Sep 17 00:26:43.075502 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.075432    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-data\") pod \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") "
Sep 17 00:26:43.075609 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.075514    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-certs\") pod \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\" (UID: \"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5\") "
Sep 17 00:26:43.076156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.075987    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:26:43.076156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.075995    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" (UID: "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:26:43.076156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.076094    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" (UID: "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:26:43.076364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.076213    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" (UID: "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:26:43.076364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.076328    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-data" (OuterVolumeSpecName: "istio-data") pod "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" (UID: "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:26:43.077303 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.077274    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-token" (OuterVolumeSpecName: "istio-token") pod "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" (UID: "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:26:43.077303 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.077279    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" (UID: "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:26:43.077429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.077302    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-kube-api-access-9rm6n" (OuterVolumeSpecName: "kube-api-access-9rm6n") pod "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" (UID: "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5"). InnerVolumeSpecName "kube-api-access-9rm6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:26:43.077429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.077345    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" (UID: "b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:26:43.177075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.177046    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:26:43.177075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.177071    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:26:43.177429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.177085    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:26:43.177429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.177098    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:26:43.177429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.177129    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:26:43.177429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.177142    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:26:43.177429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.177156    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:26:43.177429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.177169    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rm6n\" (UniqueName: \"kubernetes.io/projected/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5-kube-api-access-9rm6n\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:26:43.284894 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.284822    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:43.379184 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.379153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:43.387173 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.387132    2565 generic.go:356] "Generic (PLEG): container finished" podID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerID="af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a" exitCode=0
Sep 17 00:26:43.387314 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.387219    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"
Sep 17 00:26:43.387314 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.387240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" event={"ID":"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5","Type":"ContainerDied","Data":"af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a"}
Sep 17 00:26:43.387439 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.387333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk" event={"ID":"b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5","Type":"ContainerDied","Data":"4b98e7d1d02914e9c628d6e73c7a0cf4ecd6bf6d5fb3f7b630eca6079e784a8e"}
Sep 17 00:26:43.387439 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.387382    2565 scope.go:117] "RemoveContainer" containerID="af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a"
Sep 17 00:26:43.390441 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.390402    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"]
Sep 17 00:26:43.391082 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.390925    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy"
Sep 17 00:26:43.391232 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.391087    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy"
Sep 17 00:26:43.391232 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.391169    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy"
Sep 17 00:26:43.391232 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.391180    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy"
Sep 17 00:26:43.391412 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.391290    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy"
Sep 17 00:26:43.393981 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.393963    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:26:43.396612 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.396564    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-3932eef5\""
Sep 17 00:26:43.397770 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.397755    2565 scope.go:117] "RemoveContainer" containerID="79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022"
Sep 17 00:26:43.403831 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.403796    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"]
Sep 17 00:26:43.404360 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.404342    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" containerName="istio-proxy"
Sep 17 00:26:43.408679 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.408657    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"]
Sep 17 00:26:43.408773 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.408759    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:26:43.409210 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.409190    2565 scope.go:117] "RemoveContainer" containerID="af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a"
Sep 17 00:26:43.409532 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:26:43.409513    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a\": container with ID starting with af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a not found: ID does not exist" containerID="af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a"
Sep 17 00:26:43.409630 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.409542    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a"} err="failed to get container status \"af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a\": rpc error: code = NotFound desc = could not find container \"af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a\": container with ID starting with af190ef28fea05f1868cac15810a2112e3b4b0adfcac8a7f1bd363308e24fc4a not found: ID does not exist"
Sep 17 00:26:43.409630 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.409566    2565 scope.go:117] "RemoveContainer" containerID="79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022"
Sep 17 00:26:43.409919 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:26:43.409893    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022\": container with ID starting with 79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022 not found: ID does not exist" containerID="79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022"
Sep 17 00:26:43.409998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.409928    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022"} err="failed to get container status \"79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022\": rpc error: code = NotFound desc = could not find container \"79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022\": container with ID starting with 79e236efd4d9feb88f170eae79515a473b3dc33195ef21863a60c34ba6d2d022 not found: ID does not exist"
Sep 17 00:26:43.411559 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.411514    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-3932eef5-dockercfg-bmf56\""
Sep 17 00:26:43.419008 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.418980    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"]
Sep 17 00:26:43.433601 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.433577    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"]
Sep 17 00:26:43.439787 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.439759    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4df62ae2-openshift-default-fc695d94d-hlqnk"]
Sep 17 00:26:43.480059 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.480033    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4\" (UID: \"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f\") " pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:26:43.480178 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.480143    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzrcv\" (UniqueName: \"kubernetes.io/projected/038a3679-f022-45ae-9a7e-107f2fc41b07-kube-api-access-zzrcv\") pod \"payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn\" (UID: \"038a3679-f022-45ae-9a7e-107f2fc41b07\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:26:43.480248 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.480197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038a3679-f022-45ae-9a7e-107f2fc41b07-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn\" (UID: \"038a3679-f022-45ae-9a7e-107f2fc41b07\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:26:43.480248 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.480236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6t5t\" (UniqueName: \"kubernetes.io/projected/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-kube-api-access-s6t5t\") pod \"payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4\" (UID: \"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f\") " pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:26:43.581663 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.581627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzrcv\" (UniqueName: \"kubernetes.io/projected/038a3679-f022-45ae-9a7e-107f2fc41b07-kube-api-access-zzrcv\") pod \"payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn\" (UID: \"038a3679-f022-45ae-9a7e-107f2fc41b07\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:26:43.581883 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.581682    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038a3679-f022-45ae-9a7e-107f2fc41b07-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn\" (UID: \"038a3679-f022-45ae-9a7e-107f2fc41b07\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:26:43.581883 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.581712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6t5t\" (UniqueName: \"kubernetes.io/projected/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-kube-api-access-s6t5t\") pod \"payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4\" (UID: \"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f\") " pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:26:43.581883 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.581770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4\" (UID: \"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f\") " pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:26:43.582471 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.582447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4\" (UID: \"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f\") " pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:26:43.582548 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.582475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038a3679-f022-45ae-9a7e-107f2fc41b07-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn\" (UID: \"038a3679-f022-45ae-9a7e-107f2fc41b07\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:26:43.592094 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.592063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzrcv\" (UniqueName: \"kubernetes.io/projected/038a3679-f022-45ae-9a7e-107f2fc41b07-kube-api-access-zzrcv\") pod \"payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn\" (UID: \"038a3679-f022-45ae-9a7e-107f2fc41b07\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:26:43.592181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.592167    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6t5t\" (UniqueName: \"kubernetes.io/projected/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-kube-api-access-s6t5t\") pod \"payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4\" (UID: \"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f\") " pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:26:43.709744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.709715    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:26:43.723124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.723101    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:26:43.839820 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.839716    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:43.929020 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.928990    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5" path="/var/lib/kubelet/pods/b7d2c7a3-1b66-48ff-af1b-22b2f8926bd5/volumes"
Sep 17 00:26:43.986457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:43.986424    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"]
Sep 17 00:26:43.987895 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:26:43.987863    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038a3679_f022_45ae_9a7e_107f2fc41b07.slice/crio-c06f9e1dc938c2e557ca3233fe0db07f3ca58be23436b9d06cdabc289d034771 WatchSource:0}: Error finding container c06f9e1dc938c2e557ca3233fe0db07f3ca58be23436b9d06cdabc289d034771: Status 404 returned error can't find the container with id c06f9e1dc938c2e557ca3233fe0db07f3ca58be23436b9d06cdabc289d034771
Sep 17 00:26:44.006128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:44.006108    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"]
Sep 17 00:26:44.008754 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:26:44.008731    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda984a5f1_40e2_4cf0_8fb7_4a5e9a0eb81f.slice/crio-5c55e9b982f01ead7648291f94ad27f2422f57a900f0901217027d5eec14af20 WatchSource:0}: Error finding container 5c55e9b982f01ead7648291f94ad27f2422f57a900f0901217027d5eec14af20: Status 404 returned error can't find the container with id 5c55e9b982f01ead7648291f94ad27f2422f57a900f0901217027d5eec14af20
Sep 17 00:26:44.395517 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:44.395477    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4" event={"ID":"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f","Type":"ContainerStarted","Data":"1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833"}
Sep 17 00:26:44.396026 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:44.395536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4" event={"ID":"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f","Type":"ContainerStarted","Data":"5c55e9b982f01ead7648291f94ad27f2422f57a900f0901217027d5eec14af20"}
Sep 17 00:26:44.396026 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:44.395666    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:26:44.397219 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:44.397196    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn" event={"ID":"038a3679-f022-45ae-9a7e-107f2fc41b07","Type":"ContainerStarted","Data":"70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7"}
Sep 17 00:26:44.397357 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:44.397239    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn" event={"ID":"038a3679-f022-45ae-9a7e-107f2fc41b07","Type":"ContainerStarted","Data":"c06f9e1dc938c2e557ca3233fe0db07f3ca58be23436b9d06cdabc289d034771"}
Sep 17 00:26:44.397357 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:44.397268    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:26:44.411456 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:44.411410    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4" podStartSLOduration=1.411396067 podStartE2EDuration="1.411396067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:26:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:26:44.409878569 +0000 UTC m=+1004.936618072" watchObservedRunningTime="2026-09-17 00:26:44.411396067 +0000 UTC m=+1004.938135545"
Sep 17 00:26:44.424521 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:44.424479    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn" podStartSLOduration=1.424464824 podStartE2EDuration="1.424464824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:26:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:26:44.423600997 +0000 UTC m=+1004.950340488" watchObservedRunningTime="2026-09-17 00:26:44.424464824 +0000 UTC m=+1004.951204303"
Sep 17 00:26:44.530830 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:44.530782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:45.208908 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:45.208864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:45.861879 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:45.861827    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:46.507889 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:46.507797    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:50.194337 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:50.194303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:26:55.405604 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:55.405572    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:26:55.406131 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:26:55.405653    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:27:04.726165 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:04.726084    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:05.360118 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:05.360076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:05.527091 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:05.527055    2565 generic.go:356] "Generic (PLEG): container finished" podID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerID="3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3" exitCode=0
Sep 17 00:27:05.527256 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:05.527101    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" event={"ID":"2cc3fae5-59d0-49c3-bf93-1fdcf8465724","Type":"ContainerDied","Data":"3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3"}
Sep 17 00:27:05.527491 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:05.527474    2565 scope.go:117] "RemoveContainer" containerID="3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3"
Sep 17 00:27:05.528618 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:05.528589    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:05.528685 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:05.528654    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:05.528721 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:05.528693    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:06.233175 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:06.233131    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:06.534618 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:06.534518    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" event={"ID":"2cc3fae5-59d0-49c3-bf93-1fdcf8465724","Type":"ContainerStarted","Data":"92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999"}
Sep 17 00:27:06.857910 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:06.857869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:07.043263 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:07.043229    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:27:07.044221 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:07.044193    2565 patch_prober.go:28] interesting pod/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 00:27:07.044360 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:07.044262    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 00:27:07.627467 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:07.627426    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:08.043133 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:08.043097    2565 patch_prober.go:28] interesting pod/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 00:27:08.043329 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:08.043159    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 00:27:08.455784 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:08.455694    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:09.042766 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:09.042731    2565 patch_prober.go:28] interesting pod/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 00:27:09.043174 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:09.042837    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 00:27:09.084168 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:09.084132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:09.775978 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:09.775942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:09.827249 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:09.827215    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:09.944312 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:09.944277    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:10.043105 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:10.043073    2565 patch_prober.go:28] interesting pod/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 00:27:10.043479 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:10.043138    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 00:27:10.582080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:10.582044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:11.042415 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:11.042335    2565 patch_prober.go:28] interesting pod/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 00:27:11.042415 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:11.042392    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 00:27:11.298294 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:11.298256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:11.374724 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:11.374689    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:27:11.929393 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:11.929356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:12.047914 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.047879    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:27:12.049183 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.049157    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:27:12.577899 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.577848    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:12.598257 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.598231    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"]
Sep 17 00:27:12.598454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.598430    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4" podUID="a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f" containerName="payload-processing" containerID="cri-o://1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833" gracePeriod=30
Sep 17 00:27:12.607944 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.607921    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"]
Sep 17 00:27:12.608151 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.608123    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn" podUID="038a3679-f022-45ae-9a7e-107f2fc41b07" containerName="payload-pre-processing" containerID="cri-o://70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7" gracePeriod=30
Sep 17 00:27:12.639602 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.639558    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:12.694724 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.694695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:12.756579 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.756548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:12.819675 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.819643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:12.900027 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.899781    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"]
Sep 17 00:27:12.910156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.910113    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:12.946154 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.946124    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:27:12.948153 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.948132    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:27:12.993833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.991743    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038a3679-f022-45ae-9a7e-107f2fc41b07-plugins-config-volume\") pod \"038a3679-f022-45ae-9a7e-107f2fc41b07\" (UID: \"038a3679-f022-45ae-9a7e-107f2fc41b07\") "
Sep 17 00:27:12.993833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.991921    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6t5t\" (UniqueName: \"kubernetes.io/projected/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-kube-api-access-s6t5t\") pod \"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f\" (UID: \"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f\") "
Sep 17 00:27:12.993833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.991983    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzrcv\" (UniqueName: \"kubernetes.io/projected/038a3679-f022-45ae-9a7e-107f2fc41b07-kube-api-access-zzrcv\") pod \"038a3679-f022-45ae-9a7e-107f2fc41b07\" (UID: \"038a3679-f022-45ae-9a7e-107f2fc41b07\") "
Sep 17 00:27:12.993833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.992026    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-plugins-config-volume\") pod \"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f\" (UID: \"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f\") "
Sep 17 00:27:12.993833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.993342    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/038a3679-f022-45ae-9a7e-107f2fc41b07-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "038a3679-f022-45ae-9a7e-107f2fc41b07" (UID: "038a3679-f022-45ae-9a7e-107f2fc41b07"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:27:12.995824 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:12.994937    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f" (UID: "a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:27:13.008775 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.005963    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-kube-api-access-s6t5t" (OuterVolumeSpecName: "kube-api-access-s6t5t") pod "a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f" (UID: "a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f"). InnerVolumeSpecName "kube-api-access-s6t5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:27:13.008775 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.006213    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/038a3679-f022-45ae-9a7e-107f2fc41b07-kube-api-access-zzrcv" (OuterVolumeSpecName: "kube-api-access-zzrcv") pod "038a3679-f022-45ae-9a7e-107f2fc41b07" (UID: "038a3679-f022-45ae-9a7e-107f2fc41b07"). InnerVolumeSpecName "kube-api-access-zzrcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:27:13.093626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.093582    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:13.093626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.093618    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/038a3679-f022-45ae-9a7e-107f2fc41b07-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:13.093626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.093631    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6t5t\" (UniqueName: \"kubernetes.io/projected/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f-kube-api-access-s6t5t\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:13.093903 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.093642    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzrcv\" (UniqueName: \"kubernetes.io/projected/038a3679-f022-45ae-9a7e-107f2fc41b07-kube-api-access-zzrcv\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:13.196157 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.196062    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:13.296702 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.296656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:13.395988 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.395952    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:13.578577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.578547    2565 generic.go:356] "Generic (PLEG): container finished" podID="a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f" containerID="1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833" exitCode=0
Sep 17 00:27:13.579086 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.578644    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"
Sep 17 00:27:13.579086 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.578643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4" event={"ID":"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f","Type":"ContainerDied","Data":"1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833"}
Sep 17 00:27:13.579086 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.578711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4" event={"ID":"a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f","Type":"ContainerDied","Data":"5c55e9b982f01ead7648291f94ad27f2422f57a900f0901217027d5eec14af20"}
Sep 17 00:27:13.579086 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.578747    2565 scope.go:117] "RemoveContainer" containerID="1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833"
Sep 17 00:27:13.582042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.582012    2565 generic.go:356] "Generic (PLEG): container finished" podID="038a3679-f022-45ae-9a7e-107f2fc41b07" containerID="70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7" exitCode=0
Sep 17 00:27:13.582165 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.582062    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"
Sep 17 00:27:13.582165 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.582123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn" event={"ID":"038a3679-f022-45ae-9a7e-107f2fc41b07","Type":"ContainerDied","Data":"70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7"}
Sep 17 00:27:13.582285 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.582185    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn" event={"ID":"038a3679-f022-45ae-9a7e-107f2fc41b07","Type":"ContainerDied","Data":"c06f9e1dc938c2e557ca3233fe0db07f3ca58be23436b9d06cdabc289d034771"}
Sep 17 00:27:13.582339 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.582297    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy" containerID="cri-o://92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999" gracePeriod=30
Sep 17 00:27:13.590462 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.590382    2565 scope.go:117] "RemoveContainer" containerID="1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833"
Sep 17 00:27:13.590705 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:27:13.590686    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833\": container with ID starting with 1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833 not found: ID does not exist" containerID="1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833"
Sep 17 00:27:13.590768 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.590714    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833"} err="failed to get container status \"1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833\": rpc error: code = NotFound desc = could not find container \"1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833\": container with ID starting with 1e0e39d9dba2d3fd3ccda1798478100abf742be7d0035c229c0d814f1008e833 not found: ID does not exist"
Sep 17 00:27:13.590768 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.590733    2565 scope.go:117] "RemoveContainer" containerID="70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7"
Sep 17 00:27:13.599220 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.599069    2565 scope.go:117] "RemoveContainer" containerID="70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7"
Sep 17 00:27:13.599334 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:27:13.599315    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7\": container with ID starting with 70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7 not found: ID does not exist" containerID="70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7"
Sep 17 00:27:13.599396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.599341    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7"} err="failed to get container status \"70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7\": rpc error: code = NotFound desc = could not find container \"70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7\": container with ID starting with 70147c65381dcb272a56018725156ecfe9bb82af4b75cee4ae01b00acd095cc7 not found: ID does not exist"
Sep 17 00:27:13.624992 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.624967    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"]
Sep 17 00:27:13.628549 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.628523    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3932eef5-79bd899bcd-8chf4"]
Sep 17 00:27:13.645431 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.645409    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"]
Sep 17 00:27:13.657626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.657603    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3932eef5-78dd6998d6-79mjn"]
Sep 17 00:27:13.666517 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.666495    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"]
Sep 17 00:27:13.667149 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.667133    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="038a3679-f022-45ae-9a7e-107f2fc41b07" containerName="payload-pre-processing"
Sep 17 00:27:13.667204 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.667153    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="038a3679-f022-45ae-9a7e-107f2fc41b07" containerName="payload-pre-processing"
Sep 17 00:27:13.667204 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.667194    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f" containerName="payload-processing"
Sep 17 00:27:13.667272 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.667203    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f" containerName="payload-processing"
Sep 17 00:27:13.667305 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.667291    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="038a3679-f022-45ae-9a7e-107f2fc41b07" containerName="payload-pre-processing"
Sep 17 00:27:13.667339 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.667302    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f" containerName="payload-processing"
Sep 17 00:27:13.670290 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.670273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.672864 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.672845    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-56ff2313-openshift-default-dockercfg-nzhmm\""
Sep 17 00:27:13.678533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.678514    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"]
Sep 17 00:27:13.701885 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.701855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-data\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.702016 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.701913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-credential-socket\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.702016 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.701948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvvf2\" (UniqueName: \"kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-kube-api-access-xvvf2\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.702016 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.701979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-socket\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.702346 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.702043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-podinfo\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.702346 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.702085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-envoy\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.702346 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.702165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-certs\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.702346 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.702212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257fe248-08ef-422d-b5ed-a77f4448c1c4-istiod-ca-cert\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.702346 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.702244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-token\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.703995 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.703965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:13.761123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.761091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:13.803549 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.803506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-certs\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.803754 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.803576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257fe248-08ef-422d-b5ed-a77f4448c1c4-istiod-ca-cert\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.803754 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.803606    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-token\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.804116 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.804090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-certs\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.804354 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.804325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-data\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.804451 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.804379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-credential-socket\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.804451 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.804410    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvvf2\" (UniqueName: \"kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-kube-api-access-xvvf2\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.804451 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.804439    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-socket\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.804627 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.804513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-podinfo\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.804627 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.804563    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-envoy\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.804982 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.804953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257fe248-08ef-422d-b5ed-a77f4448c1c4-istiod-ca-cert\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.805253 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.805228    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-data\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.805690 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.805668    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-credential-socket\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.805847 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.805726    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-socket\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.807425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.807396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-envoy\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.808382 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.808347    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-podinfo\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.817121 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.817099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-token\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.819260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.819239    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvvf2\" (UniqueName: \"kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-kube-api-access-xvvf2\") pod \"e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") " pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:13.928128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.928054    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="038a3679-f022-45ae-9a7e-107f2fc41b07" path="/var/lib/kubelet/pods/038a3679-f022-45ae-9a7e-107f2fc41b07/volumes"
Sep 17 00:27:13.928510 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.928489    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f" path="/var/lib/kubelet/pods/a984a5f1-40e2-4cf0-8fb7-4a5e9a0eb81f/volumes"
Sep 17 00:27:13.951609 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.951584    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:13.983470 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:13.983445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:14.260153 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:14.260127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"]
Sep 17 00:27:14.261719 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:27:14.261691    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod257fe248_08ef_422d_b5ed_a77f4448c1c4.slice/crio-f00c1d16e1501a257bbce8a94f7d1262c01a9de333e08caab5f9fd5cba36d00f WatchSource:0}: Error finding container f00c1d16e1501a257bbce8a94f7d1262c01a9de333e08caab5f9fd5cba36d00f: Status 404 returned error can't find the container with id f00c1d16e1501a257bbce8a94f7d1262c01a9de333e08caab5f9fd5cba36d00f
Sep 17 00:27:14.263954 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:14.263919    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:14.264073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:14.263996    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:14.264073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:14.264040    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:14.371394 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:14.371361    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:14.590127 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:14.590088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" event={"ID":"257fe248-08ef-422d-b5ed-a77f4448c1c4","Type":"ContainerStarted","Data":"f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957"}
Sep 17 00:27:14.590582 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:14.590160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" event={"ID":"257fe248-08ef-422d-b5ed-a77f4448c1c4","Type":"ContainerStarted","Data":"f00c1d16e1501a257bbce8a94f7d1262c01a9de333e08caab5f9fd5cba36d00f"}
Sep 17 00:27:14.609157 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:14.609114    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" podStartSLOduration=1.609100483 podStartE2EDuration="1.609100483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:27:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:27:14.607669602 +0000 UTC m=+1035.134409106" watchObservedRunningTime="2026-09-17 00:27:14.609100483 +0000 UTC m=+1035.135839960"
Sep 17 00:27:14.983875 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:14.983752    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:15.280427 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:15.280326    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:15.917775 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:15.917730    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:15.990623 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:15.990584    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:16.015152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:16.015119    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:16.603678 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:16.603647    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:16.604720 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:16.604699    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:16.771063 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:16.771031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:17.546539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:17.546503    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:17.647954 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:17.647921    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:17.714218 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:17.714183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:18.013389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.013309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:18.170351 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.170317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:18.293072 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.293040    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"]
Sep 17 00:27:18.297240 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.297214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:18.300290 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.300263    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-56ff2313-dockercfg-l42qd\""
Sep 17 00:27:18.300538 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.300521    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-56ff2313\""
Sep 17 00:27:18.321550 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.320947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"]
Sep 17 00:27:18.353535 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.353501    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-plugins-config-volume\") pod \"payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl\" (UID: \"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3\") " pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:18.353711 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.353664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5l58\" (UniqueName: \"kubernetes.io/projected/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-kube-api-access-p5l58\") pod \"payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl\" (UID: \"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3\") " pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:18.454906 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.454878    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-plugins-config-volume\") pod \"payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl\" (UID: \"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3\") " pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:18.455058 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.454993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5l58\" (UniqueName: \"kubernetes.io/projected/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-kube-api-access-p5l58\") pod \"payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl\" (UID: \"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3\") " pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:18.455566 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.455545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-plugins-config-volume\") pod \"payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl\" (UID: \"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3\") " pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:18.462404 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.462379    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5l58\" (UniqueName: \"kubernetes.io/projected/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-kube-api-access-p5l58\") pod \"payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl\" (UID: \"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3\") " pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:18.504336 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.504308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:18.621545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.621521    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:18.843276 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.843222    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:27:18.897398 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.897372    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"]
Sep 17 00:27:18.898299 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:27:18.898276    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4259e56_e4b2_4a9c_b119_07e1d08c5ec3.slice/crio-f0952bacfcdc35e271bd6915afb408c5ed7f8f1f8457354aea84c9f2fe00500a WatchSource:0}: Error finding container f0952bacfcdc35e271bd6915afb408c5ed7f8f1f8457354aea84c9f2fe00500a: Status 404 returned error can't find the container with id f0952bacfcdc35e271bd6915afb408c5ed7f8f1f8457354aea84c9f2fe00500a
Sep 17 00:27:18.959413 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.959390    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-token\") pod \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") "
Sep 17 00:27:18.959524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.959427    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-envoy\") pod \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") "
Sep 17 00:27:18.959524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.959451    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-certs\") pod \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") "
Sep 17 00:27:18.959524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.959493    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz8gk\" (UniqueName: \"kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-kube-api-access-jz8gk\") pod \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") "
Sep 17 00:27:18.959677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.959550    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-podinfo\") pod \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") "
Sep 17 00:27:18.959677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.959585    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-socket\") pod \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") "
Sep 17 00:27:18.959677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.959609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-credential-socket\") pod \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") "
Sep 17 00:27:18.959677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.959670    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-data\") pod \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") "
Sep 17 00:27:18.959899 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.959738    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istiod-ca-cert\") pod \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\" (UID: \"2cc3fae5-59d0-49c3-bf93-1fdcf8465724\") "
Sep 17 00:27:18.959899 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.959768    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2cc3fae5-59d0-49c3-bf93-1fdcf8465724" (UID: "2cc3fae5-59d0-49c3-bf93-1fdcf8465724"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:27:18.960043 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.959983    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-data" (OuterVolumeSpecName: "istio-data") pod "2cc3fae5-59d0-49c3-bf93-1fdcf8465724" (UID: "2cc3fae5-59d0-49c3-bf93-1fdcf8465724"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:27:18.960240 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.960215    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2cc3fae5-59d0-49c3-bf93-1fdcf8465724" (UID: "2cc3fae5-59d0-49c3-bf93-1fdcf8465724"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:27:18.960356 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.960265    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:18.960356 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.960281    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:18.960356 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.960286    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2cc3fae5-59d0-49c3-bf93-1fdcf8465724" (UID: "2cc3fae5-59d0-49c3-bf93-1fdcf8465724"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:27:18.960356 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.960297    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2cc3fae5-59d0-49c3-bf93-1fdcf8465724" (UID: "2cc3fae5-59d0-49c3-bf93-1fdcf8465724"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:27:18.962152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.962127    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2cc3fae5-59d0-49c3-bf93-1fdcf8465724" (UID: "2cc3fae5-59d0-49c3-bf93-1fdcf8465724"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:27:18.962293 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.962273    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2cc3fae5-59d0-49c3-bf93-1fdcf8465724" (UID: "2cc3fae5-59d0-49c3-bf93-1fdcf8465724"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:27:18.962356 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.962290    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-token" (OuterVolumeSpecName: "istio-token") pod "2cc3fae5-59d0-49c3-bf93-1fdcf8465724" (UID: "2cc3fae5-59d0-49c3-bf93-1fdcf8465724"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:27:18.962356 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:18.962302    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-kube-api-access-jz8gk" (OuterVolumeSpecName: "kube-api-access-jz8gk") pod "2cc3fae5-59d0-49c3-bf93-1fdcf8465724" (UID: "2cc3fae5-59d0-49c3-bf93-1fdcf8465724"). InnerVolumeSpecName "kube-api-access-jz8gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:27:19.060969 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.060934    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:19.060969 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.060963    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:19.060969 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.060972    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:19.061190 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.060980    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz8gk\" (UniqueName: \"kubernetes.io/projected/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-kube-api-access-jz8gk\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:19.061190 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.060992    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:19.061190 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.061000    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:19.061190 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.061009    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2cc3fae5-59d0-49c3-bf93-1fdcf8465724-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:19.223985 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.223893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:19.624062 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.624026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl" event={"ID":"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3","Type":"ContainerStarted","Data":"2256db09b491ecfa6f6b06207b354a4877e2b81eb02e854303a2e616a58218b0"}
Sep 17 00:27:19.624493 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.624078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl" event={"ID":"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3","Type":"ContainerStarted","Data":"f0952bacfcdc35e271bd6915afb408c5ed7f8f1f8457354aea84c9f2fe00500a"}
Sep 17 00:27:19.624493 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.624142    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:19.625789 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.625765    2565 generic.go:356] "Generic (PLEG): container finished" podID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerID="92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999" exitCode=0
Sep 17 00:27:19.625920 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.625813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" event={"ID":"2cc3fae5-59d0-49c3-bf93-1fdcf8465724","Type":"ContainerDied","Data":"92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999"}
Sep 17 00:27:19.625920 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.625825    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"
Sep 17 00:27:19.625920 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.625855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc" event={"ID":"2cc3fae5-59d0-49c3-bf93-1fdcf8465724","Type":"ContainerDied","Data":"9a7c680c1bfd9df633330ac483216b7877021844e1a29bf9133e6d0de0534201"}
Sep 17 00:27:19.625920 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.625884    2565 scope.go:117] "RemoveContainer" containerID="92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999"
Sep 17 00:27:19.635576 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.635560    2565 scope.go:117] "RemoveContainer" containerID="3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3"
Sep 17 00:27:19.641377 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.641328    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl" podStartSLOduration=1.641316959 podStartE2EDuration="1.641316959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:27:19.639362756 +0000 UTC m=+1040.166102251" watchObservedRunningTime="2026-09-17 00:27:19.641316959 +0000 UTC m=+1040.168056436"
Sep 17 00:27:19.644596 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.644568    2565 scope.go:117] "RemoveContainer" containerID="92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999"
Sep 17 00:27:19.644870 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:27:19.644829    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999\": container with ID starting with 92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999 not found: ID does not exist" containerID="92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999"
Sep 17 00:27:19.644870 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.644856    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999"} err="failed to get container status \"92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999\": rpc error: code = NotFound desc = could not find container \"92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999\": container with ID starting with 92124a67c33658c1dc551cfa14c7996be2f0972b6e336ce412f6c97e5b762999 not found: ID does not exist"
Sep 17 00:27:19.645006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.644875    2565 scope.go:117] "RemoveContainer" containerID="3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3"
Sep 17 00:27:19.645116 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:27:19.645101    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3\": container with ID starting with 3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3 not found: ID does not exist" containerID="3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3"
Sep 17 00:27:19.645159 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.645120    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3"} err="failed to get container status \"3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3\": rpc error: code = NotFound desc = could not find container \"3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3\": container with ID starting with 3c7290d3cab4033384cbeeb5b81aef102cc76d49d23926e979db1491f60ab9e3 not found: ID does not exist"
Sep 17 00:27:19.653000 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.652980    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"]
Sep 17 00:27:19.656857 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.656838    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-3932eef5-gw-openshift-default-84fb977968-vv2bc"]
Sep 17 00:27:19.924032 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.923940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:19.927569 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:19.927542    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" path="/var/lib/kubelet/pods/2cc3fae5-59d0-49c3-bf93-1fdcf8465724/volumes"
Sep 17 00:27:20.799970 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:20.799934    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:23.736439 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:23.736407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:30.635256 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:30.635221    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:32.106639 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:32.106601    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:39.598126 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:39.598087    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:39.739113 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:39.739081    2565 generic.go:356] "Generic (PLEG): container finished" podID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerID="f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957" exitCode=0
Sep 17 00:27:39.739276 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:39.739151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" event={"ID":"257fe248-08ef-422d-b5ed-a77f4448c1c4","Type":"ContainerDied","Data":"f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957"}
Sep 17 00:27:39.739597 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:39.739582    2565 scope.go:117] "RemoveContainer" containerID="f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957"
Sep 17 00:27:39.740703 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:39.740678    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:39.740759 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:39.740751    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:39.740793 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:39.740780    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:40.437146 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:40.437112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:40.746033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:40.745955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" event={"ID":"257fe248-08ef-422d-b5ed-a77f4448c1c4","Type":"ContainerStarted","Data":"f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8"}
Sep 17 00:27:40.983938 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:40.983906    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:40.984125 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:40.984102    2565 patch_prober.go:28] interesting pod/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 17 00:27:40.984179 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:40.984151    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 17 00:27:41.045549 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:41.045517    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:41.814819 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:41.814772    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:41.984746 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:41.984711    2565 patch_prober.go:28] interesting pod/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 17 00:27:41.984922 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:41.984779    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 17 00:27:42.629341 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:42.629301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:42.983985 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:42.983898    2565 patch_prober.go:28] interesting pod/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 17 00:27:42.983985 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:42.983947    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 17 00:27:43.252781 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:43.252693    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:43.833531 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:43.833445    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:43.984414 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:43.984380    2565 patch_prober.go:28] interesting pod/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 17 00:27:43.984772 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:43.984431    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 17 00:27:44.044626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:44.044593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:44.773701 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:44.773660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:44.984737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:44.984700    2565 patch_prober.go:28] interesting pod/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 17 00:27:44.985211 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:44.984763    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 17 00:27:45.516672 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:45.516623    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:45.984027 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:45.983995    2565 patch_prober.go:28] interesting pod/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 17 00:27:45.984202 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:45.984046    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 17 00:27:46.243530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:46.243412    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:46.603892 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:46.603856    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:46.873978 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:46.873889    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:46.987640 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:46.987613    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:46.988622 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:46.988601    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:47.534648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.534615    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:47.560216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.560184    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"]
Sep 17 00:27:47.560407 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.560380    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl" podUID="a4259e56-e4b2-4a9c-b119-07e1d08c5ec3" containerName="payload-processing" containerID="cri-o://2256db09b491ecfa6f6b06207b354a4877e2b81eb02e854303a2e616a58218b0" gracePeriod=30
Sep 17 00:27:47.635246 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.635204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:47.708927 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.708899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:47.766119 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.766078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:47.788624 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.788561    2565 generic.go:356] "Generic (PLEG): container finished" podID="a4259e56-e4b2-4a9c-b119-07e1d08c5ec3" containerID="2256db09b491ecfa6f6b06207b354a4877e2b81eb02e854303a2e616a58218b0" exitCode=0
Sep 17 00:27:47.788750 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.788637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl" event={"ID":"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3","Type":"ContainerDied","Data":"2256db09b491ecfa6f6b06207b354a4877e2b81eb02e854303a2e616a58218b0"}
Sep 17 00:27:47.816717 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.816694    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:47.946384 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.946355    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-plugins-config-volume\") pod \"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3\" (UID: \"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3\") "
Sep 17 00:27:47.946568 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.946470    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5l58\" (UniqueName: \"kubernetes.io/projected/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-kube-api-access-p5l58\") pod \"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3\" (UID: \"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3\") "
Sep 17 00:27:47.946746 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.946721    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a4259e56-e4b2-4a9c-b119-07e1d08c5ec3" (UID: "a4259e56-e4b2-4a9c-b119-07e1d08c5ec3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:27:47.946878 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.946858    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:47.948753 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:47.948731    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-kube-api-access-p5l58" (OuterVolumeSpecName: "kube-api-access-p5l58") pod "a4259e56-e4b2-4a9c-b119-07e1d08c5ec3" (UID: "a4259e56-e4b2-4a9c-b119-07e1d08c5ec3"). InnerVolumeSpecName "kube-api-access-p5l58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:27:48.048110 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:48.048074    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5l58\" (UniqueName: \"kubernetes.io/projected/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3-kube-api-access-p5l58\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:48.153755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:48.153719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:48.795504 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:48.795476    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"
Sep 17 00:27:48.795997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:48.795522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl" event={"ID":"a4259e56-e4b2-4a9c-b119-07e1d08c5ec3","Type":"ContainerDied","Data":"f0952bacfcdc35e271bd6915afb408c5ed7f8f1f8457354aea84c9f2fe00500a"}
Sep 17 00:27:48.795997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:48.795593    2565 scope.go:117] "RemoveContainer" containerID="2256db09b491ecfa6f6b06207b354a4877e2b81eb02e854303a2e616a58218b0"
Sep 17 00:27:48.818329 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:48.818305    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"]
Sep 17 00:27:48.822034 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:48.822012    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-56ff2313-64999c5d8c-27ksl"]
Sep 17 00:27:48.947136 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:48.947106    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:49.034526 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.034489    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"]
Sep 17 00:27:49.034744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.034718    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy" containerID="cri-o://f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8" gracePeriod=30
Sep 17 00:27:49.053109 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.053034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:49.551587 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.551554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:49.656215 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.656182    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:49.829444 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.829364    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"]
Sep 17 00:27:49.829995 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.829978    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy"
Sep 17 00:27:49.830081 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.829997    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy"
Sep 17 00:27:49.830081 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.830018    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy"
Sep 17 00:27:49.830081 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.830027    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy"
Sep 17 00:27:49.830081 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.830043    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4259e56-e4b2-4a9c-b119-07e1d08c5ec3" containerName="payload-processing"
Sep 17 00:27:49.830081 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.830052    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4259e56-e4b2-4a9c-b119-07e1d08c5ec3" containerName="payload-processing"
Sep 17 00:27:49.830277 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.830147    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy"
Sep 17 00:27:49.830277 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.830157    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4259e56-e4b2-4a9c-b119-07e1d08c5ec3" containerName="payload-processing"
Sep 17 00:27:49.830277 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.830167    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cc3fae5-59d0-49c3-bf93-1fdcf8465724" containerName="istio-proxy"
Sep 17 00:27:49.833636 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.833613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:49.836022 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.836001    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-8e10e0b5-openshift-default-dockercfg-4hc2t\""
Sep 17 00:27:49.843141 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.843121    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"]
Sep 17 00:27:49.853589 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.853564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:49.945823 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.945612    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4259e56-e4b2-4a9c-b119-07e1d08c5ec3" path="/var/lib/kubelet/pods/a4259e56-e4b2-4a9c-b119-07e1d08c5ec3/volumes"
Sep 17 00:27:49.966168 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.966131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-credential-socket\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:49.966696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.966670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-token\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:49.966863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.966847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-socket\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:49.966995 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.966982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istiod-ca-cert\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:49.967103 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.967085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-data\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:49.967203 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.967188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-podinfo\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:49.967298 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.967285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58qqc\" (UniqueName: \"kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-kube-api-access-58qqc\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:49.967409 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.967397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-envoy\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:49.967587 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:49.967574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-certs\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.068982 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.068952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qqc\" (UniqueName: \"kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-kube-api-access-58qqc\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.069144 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.068997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-envoy\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.069144 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.069050    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-certs\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.069276 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.069250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-credential-socket\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.069346 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.069319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-token\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.069402 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.069388    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-socket\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.069485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.069467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istiod-ca-cert\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.069544 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.069494    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-certs\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.069544 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.069500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-data\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.069782 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.069756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-socket\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.069782 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.069774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-podinfo\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.069940 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.069875    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-credential-socket\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.070137 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.070118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-data\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.070365 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.070337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istiod-ca-cert\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.071469 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.071447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-envoy\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.072092 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.072072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-podinfo\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.076653 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.076632    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58qqc\" (UniqueName: \"kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-kube-api-access-58qqc\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.077351 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.077330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-token\") pod \"e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") " pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.146075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.146020    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:50.314730 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.314698    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:50.416957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.416927    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"]
Sep 17 00:27:50.417872 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:27:50.417843    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce49f4c_2931_4b59_8d9b_b7a1417c48b9.slice/crio-370e9eaa392f81e333688ee7fd9b5432f8edc9b0c420622ceb4aec0de05b5b74 WatchSource:0}: Error finding container 370e9eaa392f81e333688ee7fd9b5432f8edc9b0c420622ceb4aec0de05b5b74: Status 404 returned error can't find the container with id 370e9eaa392f81e333688ee7fd9b5432f8edc9b0c420622ceb4aec0de05b5b74
Sep 17 00:27:50.420154 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.420120    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:50.420241 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.420187    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:50.420241 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.420214    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:27:50.434311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.434271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:50.809782 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.809753    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" event={"ID":"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9","Type":"ContainerStarted","Data":"dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5"}
Sep 17 00:27:50.809992 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.809830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" event={"ID":"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9","Type":"ContainerStarted","Data":"370e9eaa392f81e333688ee7fd9b5432f8edc9b0c420622ceb4aec0de05b5b74"}
Sep 17 00:27:50.826881 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:50.826833    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" podStartSLOduration=1.8267947979999999 podStartE2EDuration="1.826794798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:27:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:27:50.825876696 +0000 UTC m=+1071.352616189" watchObservedRunningTime="2026-09-17 00:27:50.826794798 +0000 UTC m=+1071.353534287"
Sep 17 00:27:51.115459 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:51.115363    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:51.146274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:51.146249    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:51.151271 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:51.151251    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:51.740333 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:51.740302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:51.817274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:51.817248    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:51.820989 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:51.820961    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:27:52.148691 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:52.148656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:52.249073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:52.249041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:52.583791 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:52.583756    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:53.432981 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:53.432945    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:54.224030 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.223991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:54.294284 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.294259    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:54.307258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307192    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvvf2\" (UniqueName: \"kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-kube-api-access-xvvf2\") pod \"257fe248-08ef-422d-b5ed-a77f4448c1c4\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") "
Sep 17 00:27:54.307258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307231    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-podinfo\") pod \"257fe248-08ef-422d-b5ed-a77f4448c1c4\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") "
Sep 17 00:27:54.307455 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307272    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-credential-socket\") pod \"257fe248-08ef-422d-b5ed-a77f4448c1c4\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") "
Sep 17 00:27:54.307455 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307438    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-token\") pod \"257fe248-08ef-422d-b5ed-a77f4448c1c4\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") "
Sep 17 00:27:54.307558 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307490    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "257fe248-08ef-422d-b5ed-a77f4448c1c4" (UID: "257fe248-08ef-422d-b5ed-a77f4448c1c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:27:54.307558 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307518    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-certs\") pod \"257fe248-08ef-422d-b5ed-a77f4448c1c4\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") "
Sep 17 00:27:54.307666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307565    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-socket\") pod \"257fe248-08ef-422d-b5ed-a77f4448c1c4\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") "
Sep 17 00:27:54.307666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307618    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257fe248-08ef-422d-b5ed-a77f4448c1c4-istiod-ca-cert\") pod \"257fe248-08ef-422d-b5ed-a77f4448c1c4\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") "
Sep 17 00:27:54.307771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307665    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-envoy\") pod \"257fe248-08ef-422d-b5ed-a77f4448c1c4\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") "
Sep 17 00:27:54.307771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307703    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-data\") pod \"257fe248-08ef-422d-b5ed-a77f4448c1c4\" (UID: \"257fe248-08ef-422d-b5ed-a77f4448c1c4\") "
Sep 17 00:27:54.307771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307739    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "257fe248-08ef-422d-b5ed-a77f4448c1c4" (UID: "257fe248-08ef-422d-b5ed-a77f4448c1c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:27:54.307963 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307840    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "257fe248-08ef-422d-b5ed-a77f4448c1c4" (UID: "257fe248-08ef-422d-b5ed-a77f4448c1c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:27:54.308020 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.307961    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "257fe248-08ef-422d-b5ed-a77f4448c1c4" (UID: "257fe248-08ef-422d-b5ed-a77f4448c1c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:27:54.308020 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.308007    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/257fe248-08ef-422d-b5ed-a77f4448c1c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "257fe248-08ef-422d-b5ed-a77f4448c1c4" (UID: "257fe248-08ef-422d-b5ed-a77f4448c1c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:27:54.308175 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.308155    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:54.308308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.308180    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:54.308308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.308193    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:54.308308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.308206    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:54.308308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.308219    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/257fe248-08ef-422d-b5ed-a77f4448c1c4-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:54.309554 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.309527    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-kube-api-access-xvvf2" (OuterVolumeSpecName: "kube-api-access-xvvf2") pod "257fe248-08ef-422d-b5ed-a77f4448c1c4" (UID: "257fe248-08ef-422d-b5ed-a77f4448c1c4"). InnerVolumeSpecName "kube-api-access-xvvf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:27:54.309664 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.309548    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "257fe248-08ef-422d-b5ed-a77f4448c1c4" (UID: "257fe248-08ef-422d-b5ed-a77f4448c1c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:27:54.309664 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.309643    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "257fe248-08ef-422d-b5ed-a77f4448c1c4" (UID: "257fe248-08ef-422d-b5ed-a77f4448c1c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:27:54.309777 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.309702    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "257fe248-08ef-422d-b5ed-a77f4448c1c4" (UID: "257fe248-08ef-422d-b5ed-a77f4448c1c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:27:54.408821 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.408780    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:54.408924 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.408825    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:54.408924 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.408836    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvvf2\" (UniqueName: \"kubernetes.io/projected/257fe248-08ef-422d-b5ed-a77f4448c1c4-kube-api-access-xvvf2\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:54.408924 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.408845    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/257fe248-08ef-422d-b5ed-a77f4448c1c4-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:27:54.834229 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.834196    2565 generic.go:356] "Generic (PLEG): container finished" podID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerID="f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8" exitCode=0
Sep 17 00:27:54.834583 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.834246    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"
Sep 17 00:27:54.834583 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.834285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" event={"ID":"257fe248-08ef-422d-b5ed-a77f4448c1c4","Type":"ContainerDied","Data":"f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8"}
Sep 17 00:27:54.834583 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.834364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt" event={"ID":"257fe248-08ef-422d-b5ed-a77f4448c1c4","Type":"ContainerDied","Data":"f00c1d16e1501a257bbce8a94f7d1262c01a9de333e08caab5f9fd5cba36d00f"}
Sep 17 00:27:54.834583 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.834387    2565 scope.go:117] "RemoveContainer" containerID="f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8"
Sep 17 00:27:54.844225 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.844209    2565 scope.go:117] "RemoveContainer" containerID="f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957"
Sep 17 00:27:54.852329 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.852310    2565 scope.go:117] "RemoveContainer" containerID="f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8"
Sep 17 00:27:54.852584 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:27:54.852567    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8\": container with ID starting with f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8 not found: ID does not exist" containerID="f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8"
Sep 17 00:27:54.852629 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.852592    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8"} err="failed to get container status \"f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8\": rpc error: code = NotFound desc = could not find container \"f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8\": container with ID starting with f5cd3c8e18c2080d9dbd1c4f1b55c350305421bd4c0822f700252172b176a8b8 not found: ID does not exist"
Sep 17 00:27:54.852629 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.852609    2565 scope.go:117] "RemoveContainer" containerID="f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957"
Sep 17 00:27:54.852878 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:27:54.852858    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957\": container with ID starting with f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957 not found: ID does not exist" containerID="f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957"
Sep 17 00:27:54.852936 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.852882    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957"} err="failed to get container status \"f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957\": rpc error: code = NotFound desc = could not find container \"f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957\": container with ID starting with f501cb26efb33866e6d7ab06379b50072d9197d5bbb5182a33ed2ec5f3d6f957 not found: ID does not exist"
Sep 17 00:27:54.858281 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.858260    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"]
Sep 17 00:27:54.860485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.860449    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:54.861781 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:54.861763    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-56ff2313-openshift-default-74774c6b44-nlnrt"]
Sep 17 00:27:55.516204 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:55.516174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:55.927624 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:55.927591    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" path="/var/lib/kubelet/pods/257fe248-08ef-422d-b5ed-a77f4448c1c4/volumes"
Sep 17 00:27:56.242982 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.242899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:56.303630 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.303600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:56.423031 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.422994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:56.670484 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.670456    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:56.769749 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.769719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:27:56.776500 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.776475    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"]
Sep 17 00:27:56.776887 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.776875    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy"
Sep 17 00:27:56.776945 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.776889    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy"
Sep 17 00:27:56.776978 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.776962    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy"
Sep 17 00:27:56.780054 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.780039    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:27:56.782458 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.782436    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-8e10e0b5\""
Sep 17 00:27:56.782564 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.782502    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-8e10e0b5-dockercfg-h8jck\""
Sep 17 00:27:56.791715 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.791694    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"]
Sep 17 00:27:56.815514 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.815484    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"]
Sep 17 00:27:56.815956 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.815939    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy"
Sep 17 00:27:56.815956 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.815956    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy"
Sep 17 00:27:56.816094 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.816070    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="257fe248-08ef-422d-b5ed-a77f4448c1c4" containerName="istio-proxy"
Sep 17 00:27:56.817985 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.817967    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:27:56.828329 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.828309    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"]
Sep 17 00:27:56.833327 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.833303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd\" (UID: \"ecd868e3-c2f1-4165-9bc0-3afb3f22683d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:27:56.833423 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.833389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a323cd1e-5fe6-4178-9481-19b5af45931d-plugins-config-volume\") pod \"payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn\" (UID: \"a323cd1e-5fe6-4178-9481-19b5af45931d\") " pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:27:56.833486 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.833454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zg4j\" (UniqueName: \"kubernetes.io/projected/a323cd1e-5fe6-4178-9481-19b5af45931d-kube-api-access-2zg4j\") pod \"payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn\" (UID: \"a323cd1e-5fe6-4178-9481-19b5af45931d\") " pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:27:56.833581 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.833497    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k56f\" (UniqueName: \"kubernetes.io/projected/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-kube-api-access-6k56f\") pod \"payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd\" (UID: \"ecd868e3-c2f1-4165-9bc0-3afb3f22683d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:27:56.934665 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.934574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a323cd1e-5fe6-4178-9481-19b5af45931d-plugins-config-volume\") pod \"payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn\" (UID: \"a323cd1e-5fe6-4178-9481-19b5af45931d\") " pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:27:56.934665 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.934635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zg4j\" (UniqueName: \"kubernetes.io/projected/a323cd1e-5fe6-4178-9481-19b5af45931d-kube-api-access-2zg4j\") pod \"payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn\" (UID: \"a323cd1e-5fe6-4178-9481-19b5af45931d\") " pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:27:56.934665 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.934666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k56f\" (UniqueName: \"kubernetes.io/projected/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-kube-api-access-6k56f\") pod \"payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd\" (UID: \"ecd868e3-c2f1-4165-9bc0-3afb3f22683d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:27:56.935284 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.934717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd\" (UID: \"ecd868e3-c2f1-4165-9bc0-3afb3f22683d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:27:56.935385 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.935364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd\" (UID: \"ecd868e3-c2f1-4165-9bc0-3afb3f22683d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:27:56.935542 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.935520    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a323cd1e-5fe6-4178-9481-19b5af45931d-plugins-config-volume\") pod \"payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn\" (UID: \"a323cd1e-5fe6-4178-9481-19b5af45931d\") " pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:27:56.942477 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.942444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k56f\" (UniqueName: \"kubernetes.io/projected/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-kube-api-access-6k56f\") pod \"payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd\" (UID: \"ecd868e3-c2f1-4165-9bc0-3afb3f22683d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:27:56.942613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:56.942452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zg4j\" (UniqueName: \"kubernetes.io/projected/a323cd1e-5fe6-4178-9481-19b5af45931d-kube-api-access-2zg4j\") pod \"payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn\" (UID: \"a323cd1e-5fe6-4178-9481-19b5af45931d\") " pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:27:57.091176 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.091155    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:27:57.127555 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.127522    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:27:57.359598 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.359571    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"]
Sep 17 00:27:57.361156 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:27:57.361130    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd868e3_c2f1_4165_9bc0_3afb3f22683d.slice/crio-a23df359435d292b4ee9626692b76a4f6813b1a8b0a7ed38ad8ba76ed604509e WatchSource:0}: Error finding container a23df359435d292b4ee9626692b76a4f6813b1a8b0a7ed38ad8ba76ed604509e: Status 404 returned error can't find the container with id a23df359435d292b4ee9626692b76a4f6813b1a8b0a7ed38ad8ba76ed604509e
Sep 17 00:27:57.417693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.417567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"]
Sep 17 00:27:57.421046 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:27:57.421021    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda323cd1e_5fe6_4178_9481_19b5af45931d.slice/crio-68e433a8a57a759498ed33b7a17e70cdd479e6afb861da36bdbbaeb147e98f7f WatchSource:0}: Error finding container 68e433a8a57a759498ed33b7a17e70cdd479e6afb861da36bdbbaeb147e98f7f: Status 404 returned error can't find the container with id 68e433a8a57a759498ed33b7a17e70cdd479e6afb861da36bdbbaeb147e98f7f
Sep 17 00:27:57.853965 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.853928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd" event={"ID":"ecd868e3-c2f1-4165-9bc0-3afb3f22683d","Type":"ContainerStarted","Data":"ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7"}
Sep 17 00:27:57.854148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.853998    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:27:57.854148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.854022    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd" event={"ID":"ecd868e3-c2f1-4165-9bc0-3afb3f22683d","Type":"ContainerStarted","Data":"a23df359435d292b4ee9626692b76a4f6813b1a8b0a7ed38ad8ba76ed604509e"}
Sep 17 00:27:57.855485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.855452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn" event={"ID":"a323cd1e-5fe6-4178-9481-19b5af45931d","Type":"ContainerStarted","Data":"067cabbd733be42a4e8c429449114868022bd51f530aca50e8a42a7587c2393e"}
Sep 17 00:27:57.855623 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.855502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn" event={"ID":"a323cd1e-5fe6-4178-9481-19b5af45931d","Type":"ContainerStarted","Data":"68e433a8a57a759498ed33b7a17e70cdd479e6afb861da36bdbbaeb147e98f7f"}
Sep 17 00:27:57.855623 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.855542    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:27:57.871113 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.871071    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd" podStartSLOduration=1.871055462 podStartE2EDuration="1.871055462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:27:57.868322777 +0000 UTC m=+1078.395062255" watchObservedRunningTime="2026-09-17 00:27:57.871055462 +0000 UTC m=+1078.397794939"
Sep 17 00:27:57.885494 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:57.885454    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn" podStartSLOduration=1.885440856 podStartE2EDuration="1.885440856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:27:57.883446889 +0000 UTC m=+1078.410186376" watchObservedRunningTime="2026-09-17 00:27:57.885440856 +0000 UTC m=+1078.412180332"
Sep 17 00:27:59.391669 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:27:59.391638    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:08.863870 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:08.863841    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:28:08.864376 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:08.863905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:28:12.956611 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:12.956576    2565 generic.go:356] "Generic (PLEG): container finished" podID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerID="dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5" exitCode=0
Sep 17 00:28:12.957030 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:12.956619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" event={"ID":"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9","Type":"ContainerDied","Data":"dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5"}
Sep 17 00:28:12.957094 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:12.957070    2565 scope.go:117] "RemoveContainer" containerID="dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5"
Sep 17 00:28:12.958381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:12.958342    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:28:12.958465 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:12.958428    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:28:12.958503 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:12.958466    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:28:13.963123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:13.963088    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" event={"ID":"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9","Type":"ContainerStarted","Data":"8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c"}
Sep 17 00:28:14.146975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:14.146944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:28:14.147135 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:14.147105    2565 patch_prober.go:28] interesting pod/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 17 00:28:14.147190 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:14.147143    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 17 00:28:15.146549 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:15.146509    2565 patch_prober.go:28] interesting pod/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 17 00:28:15.146958 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:15.146581    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 17 00:28:16.146610 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:16.146577    2565 patch_prober.go:28] interesting pod/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 17 00:28:16.146977 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:16.146640    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 17 00:28:17.147294 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:17.147261    2565 patch_prober.go:28] interesting pod/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 17 00:28:17.147721 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:17.147318    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 17 00:28:18.138551 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:18.138509    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:18.146474 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:18.146447    2565 patch_prober.go:28] interesting pod/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 17 00:28:18.146594 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:18.146502    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 17 00:28:18.925009 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:18.924956    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:19.147331 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:19.147294    2565 patch_prober.go:28] interesting pod/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 17 00:28:19.147480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:19.147371    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 17 00:28:19.531199 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:19.531151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:20.143931 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:20.143896    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:20.150378 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:20.150356    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:28:20.150628 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:20.150612    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:28:20.151278 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:20.151262    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:28:20.819354 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:20.819319    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:21.544387 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:21.544348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:22.195707 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:22.195662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:22.846239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:22.846207    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:23.630874 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:23.630835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:24.266522 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:24.266484    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:25.027881 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:25.027838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:25.643709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:25.643661    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:26.270022 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:26.269984    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:27.021568 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:27.021530    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:33.915933 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:33.915888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:33.943077 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:33.943047    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"]
Sep 17 00:28:33.943304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:33.943278    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn" podUID="a323cd1e-5fe6-4178-9481-19b5af45931d" containerName="payload-processing" containerID="cri-o://067cabbd733be42a4e8c429449114868022bd51f530aca50e8a42a7587c2393e" gracePeriod=30
Sep 17 00:28:33.949004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:33.948975    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"]
Sep 17 00:28:33.949270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:33.949224    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd" podUID="ecd868e3-c2f1-4165-9bc0-3afb3f22683d" containerName="payload-pre-processing" containerID="cri-o://ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7" gracePeriod=30
Sep 17 00:28:33.980921 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:33.980865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:34.072433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.072408    2565 generic.go:356] "Generic (PLEG): container finished" podID="a323cd1e-5fe6-4178-9481-19b5af45931d" containerID="067cabbd733be42a4e8c429449114868022bd51f530aca50e8a42a7587c2393e" exitCode=0
Sep 17 00:28:34.072559 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.072468    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn" event={"ID":"a323cd1e-5fe6-4178-9481-19b5af45931d","Type":"ContainerDied","Data":"067cabbd733be42a4e8c429449114868022bd51f530aca50e8a42a7587c2393e"}
Sep 17 00:28:34.078379 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.078327    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:34.131892 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.131859    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:34.238493 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.238386    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:34.238656 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.238532    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:28:34.240895 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.240861    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"]
Sep 17 00:28:34.241123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.241093    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy" containerID="cri-o://8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c" gracePeriod=30
Sep 17 00:28:34.258223 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.258201    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:28:34.383609 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.383576    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a323cd1e-5fe6-4178-9481-19b5af45931d-plugins-config-volume\") pod \"a323cd1e-5fe6-4178-9481-19b5af45931d\" (UID: \"a323cd1e-5fe6-4178-9481-19b5af45931d\") "
Sep 17 00:28:34.383847 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.383647    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-plugins-config-volume\") pod \"ecd868e3-c2f1-4165-9bc0-3afb3f22683d\" (UID: \"ecd868e3-c2f1-4165-9bc0-3afb3f22683d\") "
Sep 17 00:28:34.383847 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.383683    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zg4j\" (UniqueName: \"kubernetes.io/projected/a323cd1e-5fe6-4178-9481-19b5af45931d-kube-api-access-2zg4j\") pod \"a323cd1e-5fe6-4178-9481-19b5af45931d\" (UID: \"a323cd1e-5fe6-4178-9481-19b5af45931d\") "
Sep 17 00:28:34.383847 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.383761    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k56f\" (UniqueName: \"kubernetes.io/projected/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-kube-api-access-6k56f\") pod \"ecd868e3-c2f1-4165-9bc0-3afb3f22683d\" (UID: \"ecd868e3-c2f1-4165-9bc0-3afb3f22683d\") "
Sep 17 00:28:34.384060 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.384029    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a323cd1e-5fe6-4178-9481-19b5af45931d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a323cd1e-5fe6-4178-9481-19b5af45931d" (UID: "a323cd1e-5fe6-4178-9481-19b5af45931d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:28:34.384167 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.384145    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ecd868e3-c2f1-4165-9bc0-3afb3f22683d" (UID: "ecd868e3-c2f1-4165-9bc0-3afb3f22683d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:28:34.384382 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.384358    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:34.384503 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.384385    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a323cd1e-5fe6-4178-9481-19b5af45931d-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:34.385852 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.385832    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-kube-api-access-6k56f" (OuterVolumeSpecName: "kube-api-access-6k56f") pod "ecd868e3-c2f1-4165-9bc0-3afb3f22683d" (UID: "ecd868e3-c2f1-4165-9bc0-3afb3f22683d"). InnerVolumeSpecName "kube-api-access-6k56f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:28:34.385938 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.385902    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a323cd1e-5fe6-4178-9481-19b5af45931d-kube-api-access-2zg4j" (OuterVolumeSpecName: "kube-api-access-2zg4j") pod "a323cd1e-5fe6-4178-9481-19b5af45931d" (UID: "a323cd1e-5fe6-4178-9481-19b5af45931d"). InnerVolumeSpecName "kube-api-access-2zg4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:28:34.485742 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.485690    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k56f\" (UniqueName: \"kubernetes.io/projected/ecd868e3-c2f1-4165-9bc0-3afb3f22683d-kube-api-access-6k56f\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:34.485742 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.485711    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zg4j\" (UniqueName: \"kubernetes.io/projected/a323cd1e-5fe6-4178-9481-19b5af45931d-kube-api-access-2zg4j\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:34.500872 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.500847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:34.901494 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.901460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:34.999075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:34.999035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:35.079167 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.079142    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"
Sep 17 00:28:35.079293 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.079171    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn" event={"ID":"a323cd1e-5fe6-4178-9481-19b5af45931d","Type":"ContainerDied","Data":"68e433a8a57a759498ed33b7a17e70cdd479e6afb861da36bdbbaeb147e98f7f"}
Sep 17 00:28:35.079293 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.079230    2565 scope.go:117] "RemoveContainer" containerID="067cabbd733be42a4e8c429449114868022bd51f530aca50e8a42a7587c2393e"
Sep 17 00:28:35.080670 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.080646    2565 generic.go:356] "Generic (PLEG): container finished" podID="ecd868e3-c2f1-4165-9bc0-3afb3f22683d" containerID="ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7" exitCode=0
Sep 17 00:28:35.080793 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.080680    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"
Sep 17 00:28:35.080793 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.080696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd" event={"ID":"ecd868e3-c2f1-4165-9bc0-3afb3f22683d","Type":"ContainerDied","Data":"ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7"}
Sep 17 00:28:35.080793 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.080737    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd" event={"ID":"ecd868e3-c2f1-4165-9bc0-3afb3f22683d","Type":"ContainerDied","Data":"a23df359435d292b4ee9626692b76a4f6813b1a8b0a7ed38ad8ba76ed604509e"}
Sep 17 00:28:35.089779 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.089752    2565 scope.go:117] "RemoveContainer" containerID="ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7"
Sep 17 00:28:35.098789 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.098773    2565 scope.go:117] "RemoveContainer" containerID="ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7"
Sep 17 00:28:35.098961 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.098936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:35.099128 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:28:35.099109    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7\": container with ID starting with ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7 not found: ID does not exist" containerID="ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7"
Sep 17 00:28:35.099181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.099136    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7"} err="failed to get container status \"ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7\": rpc error: code = NotFound desc = could not find container \"ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7\": container with ID starting with ca748bac3acdfe528a79637088083214f6e1f986f9d565c3b6045bd67b6b83a7 not found: ID does not exist"
Sep 17 00:28:35.105617 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.105596    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"]
Sep 17 00:28:35.112152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.112132    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-8e10e0b5-7bf6544d4f-qdckn"]
Sep 17 00:28:35.122940 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.122915    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"]
Sep 17 00:28:35.127180 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.127160    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-8e10e0b5-66755d8cc4-fqfcd"]
Sep 17 00:28:35.153068 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.153016    2565 patch_prober.go:28] interesting pod/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 00:28:35.153160 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.153069    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:28:35.350617 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.350589    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:35.926171 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.926140    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a323cd1e-5fe6-4178-9481-19b5af45931d" path="/var/lib/kubelet/pods/a323cd1e-5fe6-4178-9481-19b5af45931d/volumes"
Sep 17 00:28:35.926486 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:35.926473    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecd868e3-c2f1-4165-9bc0-3afb3f22683d" path="/var/lib/kubelet/pods/ecd868e3-c2f1-4165-9bc0-3afb3f22683d/volumes"
Sep 17 00:28:36.002040 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:36.002011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:36.454820 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:36.454781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:36.626710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:36.626681    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:37.335677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:37.335645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:37.985182 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:37.985153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:38.638141 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:38.638099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:39.500123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.500103    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:28:39.529036 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.528978    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-certs\") pod \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") "
Sep 17 00:28:39.529148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529040    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istiod-ca-cert\") pod \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") "
Sep 17 00:28:39.529148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529091    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58qqc\" (UniqueName: \"kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-kube-api-access-58qqc\") pod \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") "
Sep 17 00:28:39.529148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529126    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-podinfo\") pod \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") "
Sep 17 00:28:39.529308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529159    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-data\") pod \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") "
Sep 17 00:28:39.529308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529223    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-envoy\") pod \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") "
Sep 17 00:28:39.529308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529223    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" (UID: "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:28:39.529308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529263    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-token\") pod \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") "
Sep 17 00:28:39.529308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529297    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-credential-socket\") pod \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") "
Sep 17 00:28:39.529545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529331    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-socket\") pod \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\" (UID: \"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9\") "
Sep 17 00:28:39.529545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" (UID: "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:28:39.529545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529486    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" (UID: "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:28:39.529691 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529637    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" (UID: "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:28:39.529774 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529756    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:39.529852 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529780    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:39.529852 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529795    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:39.529852 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529789    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" (UID: "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:28:39.529852 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.529821    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:39.531414 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.531381    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-kube-api-access-58qqc" (OuterVolumeSpecName: "kube-api-access-58qqc") pod "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" (UID: "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9"). InnerVolumeSpecName "kube-api-access-58qqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:28:39.531414 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.531389    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" (UID: "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:28:39.531597 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.531578    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" (UID: "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:28:39.531668 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.531605    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" (UID: "3ce49f4c-2931-4b59-8d9b-b7a1417c48b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:28:39.630246 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.630223    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58qqc\" (UniqueName: \"kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-kube-api-access-58qqc\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:39.630246 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.630245    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:39.630368 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.630254    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:39.630368 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.630263    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:39.630368 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:39.630270    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:40.113175 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.113142    2565 generic.go:356] "Generic (PLEG): container finished" podID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerID="8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c" exitCode=0
Sep 17 00:28:40.113489 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.113188    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"
Sep 17 00:28:40.113489 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.113198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" event={"ID":"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9","Type":"ContainerDied","Data":"8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c"}
Sep 17 00:28:40.113489 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.113241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb" event={"ID":"3ce49f4c-2931-4b59-8d9b-b7a1417c48b9","Type":"ContainerDied","Data":"370e9eaa392f81e333688ee7fd9b5432f8edc9b0c420622ceb4aec0de05b5b74"}
Sep 17 00:28:40.113489 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.113262    2565 scope.go:117] "RemoveContainer" containerID="8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c"
Sep 17 00:28:40.122458 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.122427    2565 scope.go:117] "RemoveContainer" containerID="dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5"
Sep 17 00:28:40.129569 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.129546    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"]
Sep 17 00:28:40.130841 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.130826    2565 scope.go:117] "RemoveContainer" containerID="8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c"
Sep 17 00:28:40.131098 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:28:40.131081    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c\": container with ID starting with 8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c not found: ID does not exist" containerID="8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c"
Sep 17 00:28:40.131149 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.131105    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c"} err="failed to get container status \"8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c\": rpc error: code = NotFound desc = could not find container \"8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c\": container with ID starting with 8a20ceabfce689df3af545b5362f67d186a25c1a04e562bbdac6a8f719bbf53c not found: ID does not exist"
Sep 17 00:28:40.131149 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.131121    2565 scope.go:117] "RemoveContainer" containerID="dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5"
Sep 17 00:28:40.131360 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:28:40.131346    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5\": container with ID starting with dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5 not found: ID does not exist" containerID="dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5"
Sep 17 00:28:40.131404 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.131368    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5"} err="failed to get container status \"dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5\": rpc error: code = NotFound desc = could not find container \"dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5\": container with ID starting with dc64337232151ca37b28bde6ed683c12cd875b96414e28fd557aef15d55069b5 not found: ID does not exist"
Sep 17 00:28:40.134450 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:40.134422    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-8e10e0b5-openshift-default-8bc4554cb-mjdlb"]
Sep 17 00:28:41.926779 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:41.926743    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" path="/var/lib/kubelet/pods/3ce49f4c-2931-4b59-8d9b-b7a1417c48b9/volumes"
Sep 17 00:28:42.107027 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:42.106990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:42.219744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:42.219665    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:42.306638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:42.306606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:42.408544 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:42.408512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:42.788493 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:42.788453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:44.820356 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:44.820308    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:45.375874 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.375842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:45.397346 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.397299    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"]
Sep 17 00:28:45.397608 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.397575    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf" podUID="6378f506-21c9-4589-805d-8b4f55c85c8d" containerName="payload-processing" containerID="cri-o://ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca" gracePeriod=30
Sep 17 00:28:45.403661 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.403592    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"]
Sep 17 00:28:45.403850 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.403823    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd" podUID="1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e" containerName="payload-pre-processing" containerID="cri-o://7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52" gracePeriod=30
Sep 17 00:28:45.435333 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.435208    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:45.493829 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.493432    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:45.551333 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.551286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:45.607102 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.607019    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:45.687589 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.687565    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:28:45.691091 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.691071    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:28:45.782780 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.782754    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4257v\" (UniqueName: \"kubernetes.io/projected/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-kube-api-access-4257v\") pod \"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e\" (UID: \"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e\") "
Sep 17 00:28:45.782932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.782834    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6378f506-21c9-4589-805d-8b4f55c85c8d-plugins-config-volume\") pod \"6378f506-21c9-4589-805d-8b4f55c85c8d\" (UID: \"6378f506-21c9-4589-805d-8b4f55c85c8d\") "
Sep 17 00:28:45.782932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.782907    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w5lz\" (UniqueName: \"kubernetes.io/projected/6378f506-21c9-4589-805d-8b4f55c85c8d-kube-api-access-4w5lz\") pod \"6378f506-21c9-4589-805d-8b4f55c85c8d\" (UID: \"6378f506-21c9-4589-805d-8b4f55c85c8d\") "
Sep 17 00:28:45.782932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.782927    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-plugins-config-volume\") pod \"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e\" (UID: \"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e\") "
Sep 17 00:28:45.783286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.783251    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6378f506-21c9-4589-805d-8b4f55c85c8d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6378f506-21c9-4589-805d-8b4f55c85c8d" (UID: "6378f506-21c9-4589-805d-8b4f55c85c8d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:28:45.783286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.783270    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e" (UID: "1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:28:45.784938 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.784917    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6378f506-21c9-4589-805d-8b4f55c85c8d-kube-api-access-4w5lz" (OuterVolumeSpecName: "kube-api-access-4w5lz") pod "6378f506-21c9-4589-805d-8b4f55c85c8d" (UID: "6378f506-21c9-4589-805d-8b4f55c85c8d"). InnerVolumeSpecName "kube-api-access-4w5lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:28:45.785077 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.785057    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-kube-api-access-4257v" (OuterVolumeSpecName: "kube-api-access-4257v") pod "1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e" (UID: "1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e"). InnerVolumeSpecName "kube-api-access-4257v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:28:45.883607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.883584    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6378f506-21c9-4589-805d-8b4f55c85c8d-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:45.883607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.883604    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w5lz\" (UniqueName: \"kubernetes.io/projected/6378f506-21c9-4589-805d-8b4f55c85c8d-kube-api-access-4w5lz\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:45.883949 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.883614    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:45.883949 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.883623    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4257v\" (UniqueName: \"kubernetes.io/projected/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e-kube-api-access-4257v\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:28:45.909846 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:45.909787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:46.010570 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.010540    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:46.146379 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.146348    2565 generic.go:356] "Generic (PLEG): container finished" podID="6378f506-21c9-4589-805d-8b4f55c85c8d" containerID="ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca" exitCode=0
Sep 17 00:28:46.146539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.146396    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"
Sep 17 00:28:46.146539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.146432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf" event={"ID":"6378f506-21c9-4589-805d-8b4f55c85c8d","Type":"ContainerDied","Data":"ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca"}
Sep 17 00:28:46.146539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.146491    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf" event={"ID":"6378f506-21c9-4589-805d-8b4f55c85c8d","Type":"ContainerDied","Data":"7b6107a5ccc62dd8a43fb03ddf500484852afb44574e482422f873656a19a7f6"}
Sep 17 00:28:46.146539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.146522    2565 scope.go:117] "RemoveContainer" containerID="ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca"
Sep 17 00:28:46.147888 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.147863    2565 generic.go:356] "Generic (PLEG): container finished" podID="1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e" containerID="7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52" exitCode=0
Sep 17 00:28:46.147988 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.147903    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"
Sep 17 00:28:46.147988 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.147955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd" event={"ID":"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e","Type":"ContainerDied","Data":"7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52"}
Sep 17 00:28:46.148087 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.148005    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd" event={"ID":"1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e","Type":"ContainerDied","Data":"ee38c2cac5e0d6f664d4de4374165d359ca801e2e1244d664b45a1de8c090a50"}
Sep 17 00:28:46.154978 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.154956    2565 scope.go:117] "RemoveContainer" containerID="ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca"
Sep 17 00:28:46.155252 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:28:46.155223    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca\": container with ID starting with ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca not found: ID does not exist" containerID="ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca"
Sep 17 00:28:46.155335 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.155258    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca"} err="failed to get container status \"ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca\": rpc error: code = NotFound desc = could not find container \"ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca\": container with ID starting with ad5c1645327c91b0e4b24734271b233ed0c72567f8b023279001afa378aa65ca not found: ID does not exist"
Sep 17 00:28:46.155335 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.155275    2565 scope.go:117] "RemoveContainer" containerID="7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52"
Sep 17 00:28:46.162498 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.162483    2565 scope.go:117] "RemoveContainer" containerID="7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52"
Sep 17 00:28:46.162752 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:28:46.162726    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52\": container with ID starting with 7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52 not found: ID does not exist" containerID="7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52"
Sep 17 00:28:46.162875 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.162761    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52"} err="failed to get container status \"7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52\": rpc error: code = NotFound desc = could not find container \"7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52\": container with ID starting with 7f75cfe8de81c94c8ead97967b45cd95aa19910e7224ac20cd634cee60a8bc52 not found: ID does not exist"
Sep 17 00:28:46.166087 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.166067    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"]
Sep 17 00:28:46.169272 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.169253    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-f492a5-65d86f588c-g44lf"]
Sep 17 00:28:46.179253 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.179231    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"]
Sep 17 00:28:46.182774 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.182752    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-f492a5-f6c4bd958-m4qrd"]
Sep 17 00:28:46.620181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:46.620155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:47.362409 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:47.362374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:47.927364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:47.927326    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e" path="/var/lib/kubelet/pods/1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e/volumes"
Sep 17 00:28:47.927719 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:47.927701    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6378f506-21c9-4589-805d-8b4f55c85c8d" path="/var/lib/kubelet/pods/6378f506-21c9-4589-805d-8b4f55c85c8d/volumes"
Sep 17 00:28:48.116896 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:48.116867    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:48.762033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:48.762000    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:28:50.915263 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:28:50.915225    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:08.796651 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:08.796602    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:14.594436 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:14.594403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:14.722505 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:14.722462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:14.779941 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:14.779910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:14.860194 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:14.860118    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:14.954595 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:14.954564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:24.685145 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:24.685078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:24.932354 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:24.932303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:25.424022 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.423982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:25.702240 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702160    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"]
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702549    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e" containerName="payload-pre-processing"
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702561    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e" containerName="payload-pre-processing"
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702570    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a323cd1e-5fe6-4178-9481-19b5af45931d" containerName="payload-processing"
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702575    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a323cd1e-5fe6-4178-9481-19b5af45931d" containerName="payload-processing"
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702585    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecd868e3-c2f1-4165-9bc0-3afb3f22683d" containerName="payload-pre-processing"
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702590    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecd868e3-c2f1-4165-9bc0-3afb3f22683d" containerName="payload-pre-processing"
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702596    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy"
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702603    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy"
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702620    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6378f506-21c9-4589-805d-8b4f55c85c8d" containerName="payload-processing"
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702626    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6378f506-21c9-4589-805d-8b4f55c85c8d" containerName="payload-processing"
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702634    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy"
Sep 17 00:29:25.702662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702638    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy"
Sep 17 00:29:25.703286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702693    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1329cb5c-dbc0-4ff6-a6f0-1488f1659b8e" containerName="payload-pre-processing"
Sep 17 00:29:25.703286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702700    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a323cd1e-5fe6-4178-9481-19b5af45931d" containerName="payload-processing"
Sep 17 00:29:25.703286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702706    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6378f506-21c9-4589-805d-8b4f55c85c8d" containerName="payload-processing"
Sep 17 00:29:25.703286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702710    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy"
Sep 17 00:29:25.703286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702717    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ce49f4c-2931-4b59-8d9b-b7a1417c48b9" containerName="istio-proxy"
Sep 17 00:29:25.703286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.702725    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecd868e3-c2f1-4165-9bc0-3afb3f22683d" containerName="payload-pre-processing"
Sep 17 00:29:25.705526 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.705494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.708062 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.708040    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-abe86c-openshift-default-dockercfg-n7h98\""
Sep 17 00:29:25.716391 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.716366    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"]
Sep 17 00:29:25.723055 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.723021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:25.805515 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.805474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-credential-socket\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.805718 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.805530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-podinfo\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.805718 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.805607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzjzg\" (UniqueName: \"kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-kube-api-access-kzjzg\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.805718 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.805639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2da62b4-d21e-46e8-82c6-044af8d741fb-istiod-ca-cert\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.805897 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.805739    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-envoy\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.805897 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.805827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-socket\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.805897 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.805859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-token\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.805897 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.805891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-certs\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.806096 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.805915    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-data\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.907363 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.907334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-credential-socket\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.907525 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.907368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-podinfo\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.907525 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.907396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzjzg\" (UniqueName: \"kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-kube-api-access-kzjzg\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.907525 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.907425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2da62b4-d21e-46e8-82c6-044af8d741fb-istiod-ca-cert\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.907525 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.907468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-envoy\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.907525 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.907513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-socket\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.907885 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.907543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-token\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.907885 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.907576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-certs\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.907885 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.907597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-data\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.907885 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.907769    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-credential-socket\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.908085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.907972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-data\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.908163 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.908139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-socket\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.908220 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.908152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-certs\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.908274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.908230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2da62b4-d21e-46e8-82c6-044af8d741fb-istiod-ca-cert\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.909774 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.909742    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-envoy\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.909951 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.909934    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-podinfo\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.915221 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.915199    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-token\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.915373 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.915352    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzjzg\" (UniqueName: \"kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-kube-api-access-kzjzg\") pod \"e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") " pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:25.982709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:25.982616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:26.018661 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:26.018640    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:26.295645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:26.295616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"]
Sep 17 00:29:26.296786 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:29:26.296759    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2da62b4_d21e_46e8_82c6_044af8d741fb.slice/crio-70d9ebe9b48f851a56e444a037cc34a859522d66f2fedd51001391e2c65b5b02 WatchSource:0}: Error finding container 70d9ebe9b48f851a56e444a037cc34a859522d66f2fedd51001391e2c65b5b02: Status 404 returned error can't find the container with id 70d9ebe9b48f851a56e444a037cc34a859522d66f2fedd51001391e2c65b5b02
Sep 17 00:29:26.299197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:26.299157    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:29:26.299287 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:26.299252    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:29:26.299327 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:26.299299    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:29:26.358709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:26.358685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" event={"ID":"d2da62b4-d21e-46e8-82c6-044af8d741fb","Type":"ContainerStarted","Data":"dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89"}
Sep 17 00:29:26.358783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:26.358736    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" event={"ID":"d2da62b4-d21e-46e8-82c6-044af8d741fb","Type":"ContainerStarted","Data":"70d9ebe9b48f851a56e444a037cc34a859522d66f2fedd51001391e2c65b5b02"}
Sep 17 00:29:26.378217 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:26.378174    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" podStartSLOduration=1.3781584279999999 podStartE2EDuration="1.378158428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:29:26.375949714 +0000 UTC m=+1166.902689218" watchObservedRunningTime="2026-09-17 00:29:26.378158428 +0000 UTC m=+1166.904897904"
Sep 17 00:29:27.019477 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:27.019438    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:27.024102 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:27.024074    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:27.364494 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:27.364471    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:27.365386 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:27.365367    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:27.641846 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:27.641753    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:28.266454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:28.266425    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:28.420386 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:28.420359    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:28.519165 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:28.519078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:29.031883 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:29.031796    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:29.815336 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:29.815298    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:30.562475 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:30.562434    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:30.877621 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:30.877535    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:31.293330 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.293292    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"]
Sep 17 00:29:31.296040 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.296017    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.298497 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.298478    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-abe86c-serving-cert\""
Sep 17 00:29:31.307024 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.307002    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"]
Sep 17 00:29:31.323252 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.323226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:31.424607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.424561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:31.460235 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.460206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-maas-api-tls\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.460377 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.460297    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e48d7aee-afbc-417c-88fe-c3ce82a350c8-openshift-service-ca\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.460377 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.460322    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qslh5\" (UniqueName: \"kubernetes.io/projected/e48d7aee-afbc-417c-88fe-c3ce82a350c8-kube-api-access-qslh5\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.460501 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.460429    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-metrics-certs\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.561665 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.561591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-maas-api-tls\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.561665 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.561641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e48d7aee-afbc-417c-88fe-c3ce82a350c8-openshift-service-ca\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.561665 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.561660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qslh5\" (UniqueName: \"kubernetes.io/projected/e48d7aee-afbc-417c-88fe-c3ce82a350c8-kube-api-access-qslh5\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.561909 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.561720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-metrics-certs\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.561909 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:29:31.561740    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-serving-cert: secret "maas-api-e2e-explicit-abe86c-serving-cert" not found
Sep 17 00:29:31.561909 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:29:31.561813    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-maas-api-tls podName:e48d7aee-afbc-417c-88fe-c3ce82a350c8 nodeName:}" failed. No retries permitted until 2026-09-17 00:29:32.06178689 +0000 UTC m=+1172.588526366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-maas-api-tls") pod "maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn" (UID: "e48d7aee-afbc-417c-88fe-c3ce82a350c8") : secret "maas-api-e2e-explicit-abe86c-serving-cert" not found
Sep 17 00:29:31.562357 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.562340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e48d7aee-afbc-417c-88fe-c3ce82a350c8-openshift-service-ca\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.564201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.564180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-metrics-certs\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.577457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.577436    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qslh5\" (UniqueName: \"kubernetes.io/projected/e48d7aee-afbc-417c-88fe-c3ce82a350c8-kube-api-access-qslh5\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:31.669950 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.669923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:31.827560 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.827482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:31.919515 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.919486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:31.926488 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.926465    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"]
Sep 17 00:29:31.929964 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.929914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:29:31.932447 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.932428    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-abe86c\""
Sep 17 00:29:31.932536 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.932510    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-abe86c-dockercfg-mb2qc\""
Sep 17 00:29:31.939236 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.939209    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"]
Sep 17 00:29:31.942010 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.941987    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"]
Sep 17 00:29:31.944793 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.944778    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:29:31.959670 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:31.959646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"]
Sep 17 00:29:32.065834 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.065786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5098c5f-fea9-4a17-8e6b-9b798a990d64-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj\" (UID: \"b5098c5f-fea9-4a17-8e6b-9b798a990d64\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:29:32.066002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.065856    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl27l\" (UniqueName: \"kubernetes.io/projected/b5098c5f-fea9-4a17-8e6b-9b798a990d64-kube-api-access-pl27l\") pod \"payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj\" (UID: \"b5098c5f-fea9-4a17-8e6b-9b798a990d64\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:29:32.066002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.065891    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/775b915a-a1cc-41b7-a563-6a86b50d7ae1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x\" (UID: \"775b915a-a1cc-41b7-a563-6a86b50d7ae1\") " pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:29:32.066002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.065951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhcmn\" (UniqueName: \"kubernetes.io/projected/775b915a-a1cc-41b7-a563-6a86b50d7ae1-kube-api-access-lhcmn\") pod \"payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x\" (UID: \"775b915a-a1cc-41b7-a563-6a86b50d7ae1\") " pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:29:32.066114 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.066019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-maas-api-tls\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:32.068532 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.068506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-maas-api-tls\") pod \"maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:32.166989 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.166930    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhcmn\" (UniqueName: \"kubernetes.io/projected/775b915a-a1cc-41b7-a563-6a86b50d7ae1-kube-api-access-lhcmn\") pod \"payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x\" (UID: \"775b915a-a1cc-41b7-a563-6a86b50d7ae1\") " pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:29:32.167107 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.167000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5098c5f-fea9-4a17-8e6b-9b798a990d64-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj\" (UID: \"b5098c5f-fea9-4a17-8e6b-9b798a990d64\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:29:32.167107 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.167037    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl27l\" (UniqueName: \"kubernetes.io/projected/b5098c5f-fea9-4a17-8e6b-9b798a990d64-kube-api-access-pl27l\") pod \"payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj\" (UID: \"b5098c5f-fea9-4a17-8e6b-9b798a990d64\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:29:32.167107 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.167059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/775b915a-a1cc-41b7-a563-6a86b50d7ae1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x\" (UID: \"775b915a-a1cc-41b7-a563-6a86b50d7ae1\") " pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:29:32.167923 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.167901    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/775b915a-a1cc-41b7-a563-6a86b50d7ae1-plugins-config-volume\") pod \"payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x\" (UID: \"775b915a-a1cc-41b7-a563-6a86b50d7ae1\") " pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:29:32.167923 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.167916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5098c5f-fea9-4a17-8e6b-9b798a990d64-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj\" (UID: \"b5098c5f-fea9-4a17-8e6b-9b798a990d64\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:29:32.174512 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.174488    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhcmn\" (UniqueName: \"kubernetes.io/projected/775b915a-a1cc-41b7-a563-6a86b50d7ae1-kube-api-access-lhcmn\") pod \"payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x\" (UID: \"775b915a-a1cc-41b7-a563-6a86b50d7ae1\") " pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:29:32.174749 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.174731    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl27l\" (UniqueName: \"kubernetes.io/projected/b5098c5f-fea9-4a17-8e6b-9b798a990d64-kube-api-access-pl27l\") pod \"payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj\" (UID: \"b5098c5f-fea9-4a17-8e6b-9b798a990d64\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:29:32.210370 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.210350    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:32.241693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.241664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:29:32.254422 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.254392    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:29:32.488266 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.488244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"]
Sep 17 00:29:32.490615 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:29:32.490588    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode48d7aee_afbc_417c_88fe_c3ce82a350c8.slice/crio-27f22a61e4d2fea8a7db7b222a8c6650dfdda2e1dc4143c07efb9ecc3c4c6693 WatchSource:0}: Error finding container 27f22a61e4d2fea8a7db7b222a8c6650dfdda2e1dc4143c07efb9ecc3c4c6693: Status 404 returned error can't find the container with id 27f22a61e4d2fea8a7db7b222a8c6650dfdda2e1dc4143c07efb9ecc3c4c6693
Sep 17 00:29:32.492002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.491983    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:29:32.530796 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.530776    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"]
Sep 17 00:29:32.532490 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:29:32.532467    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5098c5f_fea9_4a17_8e6b_9b798a990d64.slice/crio-cb7784e2c46a333003c5a97bab96c0eebcd986580d21977659cf9b58191ff695 WatchSource:0}: Error finding container cb7784e2c46a333003c5a97bab96c0eebcd986580d21977659cf9b58191ff695: Status 404 returned error can't find the container with id cb7784e2c46a333003c5a97bab96c0eebcd986580d21977659cf9b58191ff695
Sep 17 00:29:32.562302 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:32.562281    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"]
Sep 17 00:29:32.563759 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:29:32.563733    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775b915a_a1cc_41b7_a563_6a86b50d7ae1.slice/crio-470e94ef8cefffc3b58feb01f439de4a044a42233f45c1bda7f215ff2a2b9033 WatchSource:0}: Error finding container 470e94ef8cefffc3b58feb01f439de4a044a42233f45c1bda7f215ff2a2b9033: Status 404 returned error can't find the container with id 470e94ef8cefffc3b58feb01f439de4a044a42233f45c1bda7f215ff2a2b9033
Sep 17 00:29:33.397877 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.397837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x" event={"ID":"775b915a-a1cc-41b7-a563-6a86b50d7ae1","Type":"ContainerStarted","Data":"5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9"}
Sep 17 00:29:33.398344 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.397906    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x" event={"ID":"775b915a-a1cc-41b7-a563-6a86b50d7ae1","Type":"ContainerStarted","Data":"470e94ef8cefffc3b58feb01f439de4a044a42233f45c1bda7f215ff2a2b9033"}
Sep 17 00:29:33.398344 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.397934    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:29:33.399363 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.399339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn" event={"ID":"e48d7aee-afbc-417c-88fe-c3ce82a350c8","Type":"ContainerStarted","Data":"33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732"}
Sep 17 00:29:33.399469 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.399383    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:33.399469 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.399403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn" event={"ID":"e48d7aee-afbc-417c-88fe-c3ce82a350c8","Type":"ContainerStarted","Data":"27f22a61e4d2fea8a7db7b222a8c6650dfdda2e1dc4143c07efb9ecc3c4c6693"}
Sep 17 00:29:33.400858 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.400832    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj" event={"ID":"b5098c5f-fea9-4a17-8e6b-9b798a990d64","Type":"ContainerStarted","Data":"6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5"}
Sep 17 00:29:33.400966 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.400882    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj" event={"ID":"b5098c5f-fea9-4a17-8e6b-9b798a990d64","Type":"ContainerStarted","Data":"cb7784e2c46a333003c5a97bab96c0eebcd986580d21977659cf9b58191ff695"}
Sep 17 00:29:33.400966 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.400945    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:29:33.415201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.415151    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x" podStartSLOduration=2.415136262 podStartE2EDuration="2.415136262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:29:33.414234072 +0000 UTC m=+1173.940973544" watchObservedRunningTime="2026-09-17 00:29:33.415136262 +0000 UTC m=+1173.941875740"
Sep 17 00:29:33.431352 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.431308    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn" podStartSLOduration=2.056383979 podStartE2EDuration="2.431295055s" totalImagesPullingTime="374.911076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:29:33.429864442 +0000 UTC m=+1173.956603939" watchObservedRunningTime="2026-09-17 00:29:33.431295055 +0000 UTC m=+1173.958034533"
Sep 17 00:29:33.446335 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:33.446294    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj" podStartSLOduration=2.446282607 podStartE2EDuration="2.446282607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:29:33.44496329 +0000 UTC m=+1173.971702795" watchObservedRunningTime="2026-09-17 00:29:33.446282607 +0000 UTC m=+1173.973022084"
Sep 17 00:29:34.190088 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:34.190052    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:36.678163 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:36.678109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:36.729155 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:36.729124    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:36.807339 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:36.807287    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:36.906047 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:36.906005    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:39.412121 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:39.412090    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:29:44.409420 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:44.409383    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:29:44.409918 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:44.409489    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:29:47.380570 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:47.380534    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:48.212520 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:48.212443    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:48.429037 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:48.428996    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:53.305758 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:53.305722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:53.394825 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:53.394778    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:53.835545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:53.835501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:54.038445 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:54.038391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:54.525271 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:54.525203    2565 generic.go:356] "Generic (PLEG): container finished" podID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerID="dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89" exitCode=0
Sep 17 00:29:54.525618 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:54.525269    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" event={"ID":"d2da62b4-d21e-46e8-82c6-044af8d741fb","Type":"ContainerDied","Data":"dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89"}
Sep 17 00:29:54.525671 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:54.525637    2565 scope.go:117] "RemoveContainer" containerID="dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89"
Sep 17 00:29:54.526743 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:54.526717    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:29:54.526812 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:54.526781    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:29:54.526853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:54.526838    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:29:54.822295 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:54.822257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:55.037585 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:55.037497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:55.123989 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:55.123950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:55.533695 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:55.533663    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" event={"ID":"d2da62b4-d21e-46e8-82c6-044af8d741fb","Type":"ContainerStarted","Data":"ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc"}
Sep 17 00:29:55.639601 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:55.639566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:55.765207 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:55.765170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:55.869368 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:55.869338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:56.006304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:56.006265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:56.019206 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:56.019175    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:56.020457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:56.020427    2565 patch_prober.go:28] interesting pod/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 17 00:29:56.020575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:56.020482    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 17 00:29:56.536887 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:56.536842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:57.020136 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:57.020094    2565 patch_prober.go:28] interesting pod/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 17 00:29:57.020344 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:57.020166    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 17 00:29:57.229715 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:57.229679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:57.365228 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:57.365194    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:29:57.455081 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:57.455045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:29:58.019765 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:58.019723    2565 patch_prober.go:28] interesting pod/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 17 00:29:58.020257 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:58.019827    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 17 00:29:59.019947 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:59.019894    2565 patch_prober.go:28] interesting pod/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 17 00:29:59.020444 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:29:59.019970    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 17 00:30:00.027449 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:00.027402    2565 patch_prober.go:28] interesting pod/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 17 00:30:00.027987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:00.027474    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 17 00:30:01.023153 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:01.023120    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:30:01.024327 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:01.024308    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:30:03.065394 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:03.065353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:03.165766 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:03.165722    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:03.730443 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:03.730391    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:05.690502 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:05.690467    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:30:05.698795 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:05.698759    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:30:09.556033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:09.555982    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:11.296226 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:11.296162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:15.274842 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:15.274786    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:15.596993 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:15.596952    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:15.711943 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:15.711910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:16.148294 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:16.148256    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:16.889669 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:16.889627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:17.537388 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:17.537355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:18.264163 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:18.264127    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:18.922916 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:18.922879    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:19.023067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.023035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:19.240267 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.240176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:19.377192 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.377149    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:19.475701 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.475666    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:19.477350 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.477329    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"]
Sep 17 00:30:19.480565 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.480550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:30:19.483031 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.483010    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-44007f60\""
Sep 17 00:30:19.483148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.483121    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-44007f60-dockercfg-zdbw4\""
Sep 17 00:30:19.491380 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.491317    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"]
Sep 17 00:30:19.509550 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.509522    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"]
Sep 17 00:30:19.512030 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.512015    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:30:19.523519 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.523491    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"]
Sep 17 00:30:19.579001 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.578962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/402704b8-4fe7-4f72-b81e-ced84d8168cc-plugins-config-volume\") pod \"payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj\" (UID: \"402704b8-4fe7-4f72-b81e-ced84d8168cc\") " pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:30:19.579361 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.579337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62965932-125f-45c9-b5b4-cdb7fab4d3fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78\" (UID: \"62965932-125f-45c9-b5b4-cdb7fab4d3fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:30:19.579546 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.579530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gk65\" (UniqueName: \"kubernetes.io/projected/62965932-125f-45c9-b5b4-cdb7fab4d3fb-kube-api-access-7gk65\") pod \"payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78\" (UID: \"62965932-125f-45c9-b5b4-cdb7fab4d3fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:30:19.580568 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.580537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhrzr\" (UniqueName: \"kubernetes.io/projected/402704b8-4fe7-4f72-b81e-ced84d8168cc-kube-api-access-vhrzr\") pod \"payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj\" (UID: \"402704b8-4fe7-4f72-b81e-ced84d8168cc\") " pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:30:19.681574 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.681536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhrzr\" (UniqueName: \"kubernetes.io/projected/402704b8-4fe7-4f72-b81e-ced84d8168cc-kube-api-access-vhrzr\") pod \"payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj\" (UID: \"402704b8-4fe7-4f72-b81e-ced84d8168cc\") " pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:30:19.681783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.681594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/402704b8-4fe7-4f72-b81e-ced84d8168cc-plugins-config-volume\") pod \"payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj\" (UID: \"402704b8-4fe7-4f72-b81e-ced84d8168cc\") " pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:30:19.681783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.681639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62965932-125f-45c9-b5b4-cdb7fab4d3fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78\" (UID: \"62965932-125f-45c9-b5b4-cdb7fab4d3fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:30:19.681783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.681670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gk65\" (UniqueName: \"kubernetes.io/projected/62965932-125f-45c9-b5b4-cdb7fab4d3fb-kube-api-access-7gk65\") pod \"payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78\" (UID: \"62965932-125f-45c9-b5b4-cdb7fab4d3fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:30:19.682379 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.682358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/402704b8-4fe7-4f72-b81e-ced84d8168cc-plugins-config-volume\") pod \"payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj\" (UID: \"402704b8-4fe7-4f72-b81e-ced84d8168cc\") " pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:30:19.682429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.682366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62965932-125f-45c9-b5b4-cdb7fab4d3fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78\" (UID: \"62965932-125f-45c9-b5b4-cdb7fab4d3fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:30:19.689222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.689192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gk65\" (UniqueName: \"kubernetes.io/projected/62965932-125f-45c9-b5b4-cdb7fab4d3fb-kube-api-access-7gk65\") pod \"payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78\" (UID: \"62965932-125f-45c9-b5b4-cdb7fab4d3fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:30:19.689353 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.689330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhrzr\" (UniqueName: \"kubernetes.io/projected/402704b8-4fe7-4f72-b81e-ced84d8168cc-kube-api-access-vhrzr\") pod \"payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj\" (UID: \"402704b8-4fe7-4f72-b81e-ced84d8168cc\") " pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:30:19.793228 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.793202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:30:19.824301 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:19.824273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:30:20.066680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:20.066654    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"]
Sep 17 00:30:20.067741 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:30:20.067715    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62965932_125f_45c9_b5b4_cdb7fab4d3fb.slice/crio-4853fb2aa6f08645f4de1901d4ca3763783ce212a24bd9f8ea2edc78f91d94b6 WatchSource:0}: Error finding container 4853fb2aa6f08645f4de1901d4ca3763783ce212a24bd9f8ea2edc78f91d94b6: Status 404 returned error can't find the container with id 4853fb2aa6f08645f4de1901d4ca3763783ce212a24bd9f8ea2edc78f91d94b6
Sep 17 00:30:20.107749 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:20.107716    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"]
Sep 17 00:30:20.108843 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:30:20.108792    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402704b8_4fe7_4f72_b81e_ced84d8168cc.slice/crio-3014e26662ab856051ba0545ad6f64712ae3e6e32aee4fe0aa6d9e412843b013 WatchSource:0}: Error finding container 3014e26662ab856051ba0545ad6f64712ae3e6e32aee4fe0aa6d9e412843b013: Status 404 returned error can't find the container with id 3014e26662ab856051ba0545ad6f64712ae3e6e32aee4fe0aa6d9e412843b013
Sep 17 00:30:20.665140 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:20.665099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78" event={"ID":"62965932-125f-45c9-b5b4-cdb7fab4d3fb","Type":"ContainerStarted","Data":"0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b"}
Sep 17 00:30:20.665584 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:20.665161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78" event={"ID":"62965932-125f-45c9-b5b4-cdb7fab4d3fb","Type":"ContainerStarted","Data":"4853fb2aa6f08645f4de1901d4ca3763783ce212a24bd9f8ea2edc78f91d94b6"}
Sep 17 00:30:20.665584 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:20.665198    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:30:20.666893 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:20.666865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj" event={"ID":"402704b8-4fe7-4f72-b81e-ced84d8168cc","Type":"ContainerStarted","Data":"07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4"}
Sep 17 00:30:20.667010 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:20.666914    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj" event={"ID":"402704b8-4fe7-4f72-b81e-ced84d8168cc","Type":"ContainerStarted","Data":"3014e26662ab856051ba0545ad6f64712ae3e6e32aee4fe0aa6d9e412843b013"}
Sep 17 00:30:20.667010 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:20.666944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:30:20.681508 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:20.681465    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78" podStartSLOduration=1.6814515060000002 podStartE2EDuration="1.681451506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:20.678929014 +0000 UTC m=+1221.205668505" watchObservedRunningTime="2026-09-17 00:30:20.681451506 +0000 UTC m=+1221.208190983"
Sep 17 00:30:20.694930 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:20.694890    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj" podStartSLOduration=1.694875532 podStartE2EDuration="1.694875532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:20.693267962 +0000 UTC m=+1221.220007461" watchObservedRunningTime="2026-09-17 00:30:20.694875532 +0000 UTC m=+1221.221615010"
Sep 17 00:30:31.674503 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:31.674469    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:30:31.674972 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:31.674550    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:30:41.137736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:41.137689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:41.817667 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:41.817632    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:42.593540 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:42.593501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:42.819871 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:42.819787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:43.340243 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:43.340209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:43.999742 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:43.999710    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:44.657202 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:44.657163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:45.348325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:45.348288    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:45.715651 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:45.715553    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:46.379093 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:46.379053    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:46.481315 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:46.481278    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:46.822116 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:46.822078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:52.575609 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:52.575525    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:52.631156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:52.631116    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:53.720619 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:53.720586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:54.495743 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:54.495705    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:55.228947 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:55.228912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:56.040612 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:56.040574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:56.675065 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:56.675031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:57.429033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:57.428996    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:30:58.051237 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:30:58.051206    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:02.137374 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:02.137327    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:02.237544 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:02.237506    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:03.531977 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.531935    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:03.567195 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.567147    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"]
Sep 17 00:31:03.568912 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.568876    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj" podUID="402704b8-4fe7-4f72-b81e-ced84d8168cc" containerName="payload-processing" containerID="cri-o://07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4" gracePeriod=30
Sep 17 00:31:03.570567 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.570541    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"]
Sep 17 00:31:03.571155 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.571127    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78" podUID="62965932-125f-45c9-b5b4-cdb7fab4d3fb" containerName="payload-pre-processing" containerID="cri-o://0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b" gracePeriod=30
Sep 17 00:31:03.607005 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.606971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:03.623640 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:31:03.623592    2565 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62965932_125f_45c9_b5b4_cdb7fab4d3fb.slice/crio-0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402704b8_4fe7_4f72_b81e_ced84d8168cc.slice/crio-07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4.scope\": RecentStats: unable to find data in memory cache]"
Sep 17 00:31:03.667790 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.667753    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:03.722707 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.722635    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:03.779845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.779792    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:03.849995 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.849966    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:31:03.878831 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.878772    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:31:03.918824 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.917406    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"
Sep 17 00:31:03.918824 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.917446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78" event={"ID":"62965932-125f-45c9-b5b4-cdb7fab4d3fb","Type":"ContainerDied","Data":"0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b"}
Sep 17 00:31:03.918824 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.917539    2565 scope.go:117] "RemoveContainer" containerID="0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b"
Sep 17 00:31:03.918824 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.917205    2565 generic.go:356] "Generic (PLEG): container finished" podID="62965932-125f-45c9-b5b4-cdb7fab4d3fb" containerID="0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b" exitCode=0
Sep 17 00:31:03.918824 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.918192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78" event={"ID":"62965932-125f-45c9-b5b4-cdb7fab4d3fb","Type":"ContainerDied","Data":"4853fb2aa6f08645f4de1901d4ca3763783ce212a24bd9f8ea2edc78f91d94b6"}
Sep 17 00:31:03.926181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.925691    2565 generic.go:356] "Generic (PLEG): container finished" podID="402704b8-4fe7-4f72-b81e-ced84d8168cc" containerID="07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4" exitCode=0
Sep 17 00:31:03.926181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.925774    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"
Sep 17 00:31:03.937714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.937686    2565 scope.go:117] "RemoveContainer" containerID="0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b"
Sep 17 00:31:03.938064 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:31:03.938034    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b\": container with ID starting with 0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b not found: ID does not exist" containerID="0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b"
Sep 17 00:31:03.938161 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.938077    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b"} err="failed to get container status \"0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b\": rpc error: code = NotFound desc = could not find container \"0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b\": container with ID starting with 0efdb23fe8977c540875bf6b2dfa65a636697e593542fc5b2bc2a5de71edb47b not found: ID does not exist"
Sep 17 00:31:03.939325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.939301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj" event={"ID":"402704b8-4fe7-4f72-b81e-ced84d8168cc","Type":"ContainerDied","Data":"07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4"}
Sep 17 00:31:03.939427 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.939352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj" event={"ID":"402704b8-4fe7-4f72-b81e-ced84d8168cc","Type":"ContainerDied","Data":"3014e26662ab856051ba0545ad6f64712ae3e6e32aee4fe0aa6d9e412843b013"}
Sep 17 00:31:03.939427 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.939373    2565 scope.go:117] "RemoveContainer" containerID="07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4"
Sep 17 00:31:03.947626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.947604    2565 scope.go:117] "RemoveContainer" containerID="07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4"
Sep 17 00:31:03.947999 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:31:03.947978    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4\": container with ID starting with 07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4 not found: ID does not exist" containerID="07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4"
Sep 17 00:31:03.948076 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:03.948010    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4"} err="failed to get container status \"07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4\": rpc error: code = NotFound desc = could not find container \"07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4\": container with ID starting with 07983b45d8629f53c7d3a87052970b2f7dceb20616875a28743ef62406f925a4 not found: ID does not exist"
Sep 17 00:31:04.000975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.000941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:04.031894 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.031860    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhrzr\" (UniqueName: \"kubernetes.io/projected/402704b8-4fe7-4f72-b81e-ced84d8168cc-kube-api-access-vhrzr\") pod \"402704b8-4fe7-4f72-b81e-ced84d8168cc\" (UID: \"402704b8-4fe7-4f72-b81e-ced84d8168cc\") "
Sep 17 00:31:04.032098 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.031918    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gk65\" (UniqueName: \"kubernetes.io/projected/62965932-125f-45c9-b5b4-cdb7fab4d3fb-kube-api-access-7gk65\") pod \"62965932-125f-45c9-b5b4-cdb7fab4d3fb\" (UID: \"62965932-125f-45c9-b5b4-cdb7fab4d3fb\") "
Sep 17 00:31:04.032098 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.031938    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/402704b8-4fe7-4f72-b81e-ced84d8168cc-plugins-config-volume\") pod \"402704b8-4fe7-4f72-b81e-ced84d8168cc\" (UID: \"402704b8-4fe7-4f72-b81e-ced84d8168cc\") "
Sep 17 00:31:04.032098 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.031959    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62965932-125f-45c9-b5b4-cdb7fab4d3fb-plugins-config-volume\") pod \"62965932-125f-45c9-b5b4-cdb7fab4d3fb\" (UID: \"62965932-125f-45c9-b5b4-cdb7fab4d3fb\") "
Sep 17 00:31:04.032370 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.032331    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/402704b8-4fe7-4f72-b81e-ced84d8168cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "402704b8-4fe7-4f72-b81e-ced84d8168cc" (UID: "402704b8-4fe7-4f72-b81e-ced84d8168cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:31:04.032454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.032342    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62965932-125f-45c9-b5b4-cdb7fab4d3fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62965932-125f-45c9-b5b4-cdb7fab4d3fb" (UID: "62965932-125f-45c9-b5b4-cdb7fab4d3fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:31:04.034227 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.034198    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/402704b8-4fe7-4f72-b81e-ced84d8168cc-kube-api-access-vhrzr" (OuterVolumeSpecName: "kube-api-access-vhrzr") pod "402704b8-4fe7-4f72-b81e-ced84d8168cc" (UID: "402704b8-4fe7-4f72-b81e-ced84d8168cc"). InnerVolumeSpecName "kube-api-access-vhrzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:31:04.034227 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.034205    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62965932-125f-45c9-b5b4-cdb7fab4d3fb-kube-api-access-7gk65" (OuterVolumeSpecName: "kube-api-access-7gk65") pod "62965932-125f-45c9-b5b4-cdb7fab4d3fb" (UID: "62965932-125f-45c9-b5b4-cdb7fab4d3fb"). InnerVolumeSpecName "kube-api-access-7gk65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:31:04.101853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.101789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:04.133169 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.133129    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhrzr\" (UniqueName: \"kubernetes.io/projected/402704b8-4fe7-4f72-b81e-ced84d8168cc-kube-api-access-vhrzr\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:04.133169 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.133161    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gk65\" (UniqueName: \"kubernetes.io/projected/62965932-125f-45c9-b5b4-cdb7fab4d3fb-kube-api-access-7gk65\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:04.133169 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.133174    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/402704b8-4fe7-4f72-b81e-ced84d8168cc-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:04.133394 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.133182    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62965932-125f-45c9-b5b4-cdb7fab4d3fb-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:04.239300 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.239271    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"]
Sep 17 00:31:04.243728 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.243703    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-44007f60-6497d5d494-mbk78"]
Sep 17 00:31:04.259422 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.259391    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"]
Sep 17 00:31:04.259605 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.259589    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-44007f60-7b4d7f7b97-gmxsj"]
Sep 17 00:31:04.726908 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:04.726869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:05.365472 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:05.365431    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:05.928274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:05.928241    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="402704b8-4fe7-4f72-b81e-ced84d8168cc" path="/var/lib/kubelet/pods/402704b8-4fe7-4f72-b81e-ced84d8168cc/volumes"
Sep 17 00:31:05.928650 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:05.928629    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62965932-125f-45c9-b5b4-cdb7fab4d3fb" path="/var/lib/kubelet/pods/62965932-125f-45c9-b5b4-cdb7fab4d3fb/volumes"
Sep 17 00:31:06.126294 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:06.126263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:06.764003 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:06.763962    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:07.396572 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:07.396536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:09.152518 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:09.152473    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:09.911637 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:09.911596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:10.208658 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:10.208538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:10.293897 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:10.293851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:10.415225 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:10.415186    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:10.740930 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:10.740894    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:10.840718 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:10.840683    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:10.963594 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:10.963552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:14.431062 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:14.431021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:15.893667 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:15.893629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:16.565710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:16.565663    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:16.812174 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:16.812132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:16.918244 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:16.918164    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:17.012673 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:17.012631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:17.213377 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:17.213281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:17.530979 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:17.530882    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:18.217880 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:18.217838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:18.997311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:18.997267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:19.624663 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:19.624622    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:20.251279 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:20.251224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:22.776255 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:22.776221    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:22.841053 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:22.841013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:23.671786 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:23.671748    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:23.985928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:23.985835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:24.149168 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:24.149130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:25.916100 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:25.916065    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:26.579880 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:26.579844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:26.685432 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:26.685394    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:27.517256 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:27.517211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:28.263034 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:28.263001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:29.048243 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.048194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:29.566954 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.566919    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"]
Sep 17 00:31:29.567178 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.567143    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn" podUID="e48d7aee-afbc-417c-88fe-c3ce82a350c8" containerName="maas-api" containerID="cri-o://33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732" gracePeriod=30
Sep 17 00:31:29.593033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.592994    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:29.628755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.628712    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"]
Sep 17 00:31:29.629110 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.629076    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x" podUID="775b915a-a1cc-41b7-a563-6a86b50d7ae1" containerName="payload-processing" containerID="cri-o://5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9" gracePeriod=30
Sep 17 00:31:29.633334 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.633304    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"]
Sep 17 00:31:29.633557 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.633528    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj" podUID="b5098c5f-fea9-4a17-8e6b-9b798a990d64" containerName="payload-pre-processing" containerID="cri-o://6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5" gracePeriod=30
Sep 17 00:31:29.667747 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.667694    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:29.724581 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.724544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:29.780006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.779968    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:29.843840 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.843718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:29.944499 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.944470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:29.948705 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.948684    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:31:29.951545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.951525    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:31:29.964682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:29.964660    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:31:30.024236 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.024194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:30.074496 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.074460    2565 generic.go:356] "Generic (PLEG): container finished" podID="775b915a-a1cc-41b7-a563-6a86b50d7ae1" containerID="5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9" exitCode=0
Sep 17 00:31:30.074912 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.074519    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"
Sep 17 00:31:30.074912 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.074536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x" event={"ID":"775b915a-a1cc-41b7-a563-6a86b50d7ae1","Type":"ContainerDied","Data":"5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9"}
Sep 17 00:31:30.074912 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.074627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x" event={"ID":"775b915a-a1cc-41b7-a563-6a86b50d7ae1","Type":"ContainerDied","Data":"470e94ef8cefffc3b58feb01f439de4a044a42233f45c1bda7f215ff2a2b9033"}
Sep 17 00:31:30.074912 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.074664    2565 scope.go:117] "RemoveContainer" containerID="5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9"
Sep 17 00:31:30.075997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.075978    2565 generic.go:356] "Generic (PLEG): container finished" podID="e48d7aee-afbc-417c-88fe-c3ce82a350c8" containerID="33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732" exitCode=0
Sep 17 00:31:30.076103 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.076036    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"
Sep 17 00:31:30.076103 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.076062    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn" event={"ID":"e48d7aee-afbc-417c-88fe-c3ce82a350c8","Type":"ContainerDied","Data":"33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732"}
Sep 17 00:31:30.076213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.076114    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn" event={"ID":"e48d7aee-afbc-417c-88fe-c3ce82a350c8","Type":"ContainerDied","Data":"27f22a61e4d2fea8a7db7b222a8c6650dfdda2e1dc4143c07efb9ecc3c4c6693"}
Sep 17 00:31:30.077282 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.077261    2565 generic.go:356] "Generic (PLEG): container finished" podID="b5098c5f-fea9-4a17-8e6b-9b798a990d64" containerID="6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5" exitCode=0
Sep 17 00:31:30.077368 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.077309    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"
Sep 17 00:31:30.077368 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.077343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj" event={"ID":"b5098c5f-fea9-4a17-8e6b-9b798a990d64","Type":"ContainerDied","Data":"6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5"}
Sep 17 00:31:30.077476 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.077382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj" event={"ID":"b5098c5f-fea9-4a17-8e6b-9b798a990d64","Type":"ContainerDied","Data":"cb7784e2c46a333003c5a97bab96c0eebcd986580d21977659cf9b58191ff695"}
Sep 17 00:31:30.083880 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.083863    2565 scope.go:117] "RemoveContainer" containerID="5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9"
Sep 17 00:31:30.084163 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:31:30.084144    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9\": container with ID starting with 5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9 not found: ID does not exist" containerID="5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9"
Sep 17 00:31:30.084222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.084170    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9"} err="failed to get container status \"5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9\": rpc error: code = NotFound desc = could not find container \"5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9\": container with ID starting with 5ec3807a8b340a19b15d86b2ac13385657902502682486361578570fd2ec82d9 not found: ID does not exist"
Sep 17 00:31:30.084222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.084188    2565 scope.go:117] "RemoveContainer" containerID="33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732"
Sep 17 00:31:30.093639 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.093615    2565 scope.go:117] "RemoveContainer" containerID="33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732"
Sep 17 00:31:30.094076 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:31:30.094017    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732\": container with ID starting with 33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732 not found: ID does not exist" containerID="33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732"
Sep 17 00:31:30.094076 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.094055    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732"} err="failed to get container status \"33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732\": rpc error: code = NotFound desc = could not find container \"33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732\": container with ID starting with 33fe086e557508eae161cd7a1cf0cdc9ce516cbe61733345e52c4c2d243dc732 not found: ID does not exist"
Sep 17 00:31:30.094250 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.094079    2565 scope.go:117] "RemoveContainer" containerID="6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5"
Sep 17 00:31:30.114381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.114343    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qslh5\" (UniqueName: \"kubernetes.io/projected/e48d7aee-afbc-417c-88fe-c3ce82a350c8-kube-api-access-qslh5\") pod \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") "
Sep 17 00:31:30.114566 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.114419    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5098c5f-fea9-4a17-8e6b-9b798a990d64-plugins-config-volume\") pod \"b5098c5f-fea9-4a17-8e6b-9b798a990d64\" (UID: \"b5098c5f-fea9-4a17-8e6b-9b798a990d64\") "
Sep 17 00:31:30.114566 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.114529    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-metrics-certs\") pod \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") "
Sep 17 00:31:30.114566 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.114556    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl27l\" (UniqueName: \"kubernetes.io/projected/b5098c5f-fea9-4a17-8e6b-9b798a990d64-kube-api-access-pl27l\") pod \"b5098c5f-fea9-4a17-8e6b-9b798a990d64\" (UID: \"b5098c5f-fea9-4a17-8e6b-9b798a990d64\") "
Sep 17 00:31:30.114724 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.114624    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-maas-api-tls\") pod \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") "
Sep 17 00:31:30.114724 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.114692    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e48d7aee-afbc-417c-88fe-c3ce82a350c8-openshift-service-ca\") pod \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\" (UID: \"e48d7aee-afbc-417c-88fe-c3ce82a350c8\") "
Sep 17 00:31:30.114724 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.114717    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhcmn\" (UniqueName: \"kubernetes.io/projected/775b915a-a1cc-41b7-a563-6a86b50d7ae1-kube-api-access-lhcmn\") pod \"775b915a-a1cc-41b7-a563-6a86b50d7ae1\" (UID: \"775b915a-a1cc-41b7-a563-6a86b50d7ae1\") "
Sep 17 00:31:30.115008 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.114771    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/775b915a-a1cc-41b7-a563-6a86b50d7ae1-plugins-config-volume\") pod \"775b915a-a1cc-41b7-a563-6a86b50d7ae1\" (UID: \"775b915a-a1cc-41b7-a563-6a86b50d7ae1\") "
Sep 17 00:31:30.115008 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.114987    2565 scope.go:117] "RemoveContainer" containerID="6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5"
Sep 17 00:31:30.115701 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.115367    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5098c5f-fea9-4a17-8e6b-9b798a990d64-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b5098c5f-fea9-4a17-8e6b-9b798a990d64" (UID: "b5098c5f-fea9-4a17-8e6b-9b798a990d64"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:31:30.115854 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.115704    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e48d7aee-afbc-417c-88fe-c3ce82a350c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e48d7aee-afbc-417c-88fe-c3ce82a350c8" (UID: "e48d7aee-afbc-417c-88fe-c3ce82a350c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:31:30.116327 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.116272    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/775b915a-a1cc-41b7-a563-6a86b50d7ae1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "775b915a-a1cc-41b7-a563-6a86b50d7ae1" (UID: "775b915a-a1cc-41b7-a563-6a86b50d7ae1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:31:30.116647 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:31:30.116624    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5\": container with ID starting with 6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5 not found: ID does not exist" containerID="6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5"
Sep 17 00:31:30.117777 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.117739    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5"} err="failed to get container status \"6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5\": rpc error: code = NotFound desc = could not find container \"6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5\": container with ID starting with 6d932875b658432aa8722b98928b295542707ad11a22d03faca63b945420abc5 not found: ID does not exist"
Sep 17 00:31:30.117922 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.116643    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e48d7aee-afbc-417c-88fe-c3ce82a350c8-openshift-service-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:30.118048 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.118031    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/775b915a-a1cc-41b7-a563-6a86b50d7ae1-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:30.118165 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.118152    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b5098c5f-fea9-4a17-8e6b-9b798a990d64-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:30.123869 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.123765    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/775b915a-a1cc-41b7-a563-6a86b50d7ae1-kube-api-access-lhcmn" (OuterVolumeSpecName: "kube-api-access-lhcmn") pod "775b915a-a1cc-41b7-a563-6a86b50d7ae1" (UID: "775b915a-a1cc-41b7-a563-6a86b50d7ae1"). InnerVolumeSpecName "kube-api-access-lhcmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:31:30.124160 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.124119    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e48d7aee-afbc-417c-88fe-c3ce82a350c8" (UID: "e48d7aee-afbc-417c-88fe-c3ce82a350c8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:31:30.124438 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.124404    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e48d7aee-afbc-417c-88fe-c3ce82a350c8" (UID: "e48d7aee-afbc-417c-88fe-c3ce82a350c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:31:30.124438 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.124420    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e48d7aee-afbc-417c-88fe-c3ce82a350c8-kube-api-access-qslh5" (OuterVolumeSpecName: "kube-api-access-qslh5") pod "e48d7aee-afbc-417c-88fe-c3ce82a350c8" (UID: "e48d7aee-afbc-417c-88fe-c3ce82a350c8"). InnerVolumeSpecName "kube-api-access-qslh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:31:30.126113 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.126080    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5098c5f-fea9-4a17-8e6b-9b798a990d64-kube-api-access-pl27l" (OuterVolumeSpecName: "kube-api-access-pl27l") pod "b5098c5f-fea9-4a17-8e6b-9b798a990d64" (UID: "b5098c5f-fea9-4a17-8e6b-9b798a990d64"). InnerVolumeSpecName "kube-api-access-pl27l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:31:30.191755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.191712    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:30.219086 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.219054    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-metrics-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:30.219086 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.219083    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl27l\" (UniqueName: \"kubernetes.io/projected/b5098c5f-fea9-4a17-8e6b-9b798a990d64-kube-api-access-pl27l\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:30.219086 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.219094    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e48d7aee-afbc-417c-88fe-c3ce82a350c8-maas-api-tls\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:30.219318 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.219103    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhcmn\" (UniqueName: \"kubernetes.io/projected/775b915a-a1cc-41b7-a563-6a86b50d7ae1-kube-api-access-lhcmn\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:30.219318 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.219112    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qslh5\" (UniqueName: \"kubernetes.io/projected/e48d7aee-afbc-417c-88fe-c3ce82a350c8-kube-api-access-qslh5\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:31:30.408158 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.408124    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"]
Sep 17 00:31:30.415907 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.415866    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-abe86c-7fc7f479bb-hs7bj"]
Sep 17 00:31:30.431358 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.430911    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"]
Sep 17 00:31:30.433452 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.433423    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-abe86c-64c65b57c7-2zh8x"]
Sep 17 00:31:30.447212 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.447183    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"]
Sep 17 00:31:30.452258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.452233    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-abe86c-fcbdc7db6-9cbvn"]
Sep 17 00:31:30.469693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.469666    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:30.565031 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.564966    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:30.572909 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.572882    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"]
Sep 17 00:31:30.573326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573309    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62965932-125f-45c9-b5b4-cdb7fab4d3fb" containerName="payload-pre-processing"
Sep 17 00:31:30.573430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573329    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="62965932-125f-45c9-b5b4-cdb7fab4d3fb" containerName="payload-pre-processing"
Sep 17 00:31:30.573430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573349    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="775b915a-a1cc-41b7-a563-6a86b50d7ae1" containerName="payload-processing"
Sep 17 00:31:30.573430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573358    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="775b915a-a1cc-41b7-a563-6a86b50d7ae1" containerName="payload-processing"
Sep 17 00:31:30.573430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573390    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402704b8-4fe7-4f72-b81e-ced84d8168cc" containerName="payload-processing"
Sep 17 00:31:30.573430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573399    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="402704b8-4fe7-4f72-b81e-ced84d8168cc" containerName="payload-processing"
Sep 17 00:31:30.573430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573416    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5098c5f-fea9-4a17-8e6b-9b798a990d64" containerName="payload-pre-processing"
Sep 17 00:31:30.573430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573424    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5098c5f-fea9-4a17-8e6b-9b798a990d64" containerName="payload-pre-processing"
Sep 17 00:31:30.573771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573478    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e48d7aee-afbc-417c-88fe-c3ce82a350c8" containerName="maas-api"
Sep 17 00:31:30.573771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573488    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e48d7aee-afbc-417c-88fe-c3ce82a350c8" containerName="maas-api"
Sep 17 00:31:30.573771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573596    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="62965932-125f-45c9-b5b4-cdb7fab4d3fb" containerName="payload-pre-processing"
Sep 17 00:31:30.573771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573609    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e48d7aee-afbc-417c-88fe-c3ce82a350c8" containerName="maas-api"
Sep 17 00:31:30.573771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573620    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="775b915a-a1cc-41b7-a563-6a86b50d7ae1" containerName="payload-processing"
Sep 17 00:31:30.573771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573629    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="402704b8-4fe7-4f72-b81e-ced84d8168cc" containerName="payload-processing"
Sep 17 00:31:30.573771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.573639    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5098c5f-fea9-4a17-8e6b-9b798a990d64" containerName="payload-pre-processing"
Sep 17 00:31:30.578482 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.578461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:31:30.581255 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.581234    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-48e479\""
Sep 17 00:31:30.581362 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.581280    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-48e479-dockercfg-75zg4\""
Sep 17 00:31:30.589093 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.589068    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"]
Sep 17 00:31:30.593430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.593408    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"]
Sep 17 00:31:30.593531 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.593507    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:31:30.606849 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.606818    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"]
Sep 17 00:31:30.724880 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.724767    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-456nv\" (UniqueName: \"kubernetes.io/projected/f060865e-634e-440d-96d2-0ca5aa87f650-kube-api-access-456nv\") pod \"payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz\" (UID: \"f060865e-634e-440d-96d2-0ca5aa87f650\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:31:30.724880 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.724869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pdgl\" (UniqueName: \"kubernetes.io/projected/da23edc7-1508-4948-8973-51099fb80c75-kube-api-access-7pdgl\") pod \"payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf\" (UID: \"da23edc7-1508-4948-8973-51099fb80c75\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:31:30.725078 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.724972    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da23edc7-1508-4948-8973-51099fb80c75-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf\" (UID: \"da23edc7-1508-4948-8973-51099fb80c75\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:31:30.725078 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.724997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f060865e-634e-440d-96d2-0ca5aa87f650-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz\" (UID: \"f060865e-634e-440d-96d2-0ca5aa87f650\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:31:30.826379 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.826334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da23edc7-1508-4948-8973-51099fb80c75-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf\" (UID: \"da23edc7-1508-4948-8973-51099fb80c75\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:31:30.826379 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.826383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f060865e-634e-440d-96d2-0ca5aa87f650-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz\" (UID: \"f060865e-634e-440d-96d2-0ca5aa87f650\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:31:30.826642 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.826452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-456nv\" (UniqueName: \"kubernetes.io/projected/f060865e-634e-440d-96d2-0ca5aa87f650-kube-api-access-456nv\") pod \"payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz\" (UID: \"f060865e-634e-440d-96d2-0ca5aa87f650\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:31:30.826642 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.826511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pdgl\" (UniqueName: \"kubernetes.io/projected/da23edc7-1508-4948-8973-51099fb80c75-kube-api-access-7pdgl\") pod \"payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf\" (UID: \"da23edc7-1508-4948-8973-51099fb80c75\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:31:30.827143 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.827124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da23edc7-1508-4948-8973-51099fb80c75-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf\" (UID: \"da23edc7-1508-4948-8973-51099fb80c75\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:31:30.827212 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.827131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f060865e-634e-440d-96d2-0ca5aa87f650-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz\" (UID: \"f060865e-634e-440d-96d2-0ca5aa87f650\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:31:30.835759 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.835725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pdgl\" (UniqueName: \"kubernetes.io/projected/da23edc7-1508-4948-8973-51099fb80c75-kube-api-access-7pdgl\") pod \"payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf\" (UID: \"da23edc7-1508-4948-8973-51099fb80c75\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:31:30.835898 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.835758    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-456nv\" (UniqueName: \"kubernetes.io/projected/f060865e-634e-440d-96d2-0ca5aa87f650-kube-api-access-456nv\") pod \"payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz\" (UID: \"f060865e-634e-440d-96d2-0ca5aa87f650\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:31:30.846613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.846581    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:30.908925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.908882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:31:30.917406 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:30.916938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:31:31.189410 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:31.189372    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"]
Sep 17 00:31:31.190586 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:31:31.190562    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda23edc7_1508_4948_8973_51099fb80c75.slice/crio-7db615a26c2130eee00a13fa26c8973251a50fa6d9d62187bbb0cf454f85719b WatchSource:0}: Error finding container 7db615a26c2130eee00a13fa26c8973251a50fa6d9d62187bbb0cf454f85719b: Status 404 returned error can't find the container with id 7db615a26c2130eee00a13fa26c8973251a50fa6d9d62187bbb0cf454f85719b
Sep 17 00:31:31.192039 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:31.192010    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"]
Sep 17 00:31:31.192940 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:31:31.192919    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf060865e_634e_440d_96d2_0ca5aa87f650.slice/crio-ade42037b08c7379edce338d90b8d8a10913f538584c38c3d76616699e587bd5 WatchSource:0}: Error finding container ade42037b08c7379edce338d90b8d8a10913f538584c38c3d76616699e587bd5: Status 404 returned error can't find the container with id ade42037b08c7379edce338d90b8d8a10913f538584c38c3d76616699e587bd5
Sep 17 00:31:31.521049 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:31.520952    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:31.928714 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:31.928674    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="775b915a-a1cc-41b7-a563-6a86b50d7ae1" path="/var/lib/kubelet/pods/775b915a-a1cc-41b7-a563-6a86b50d7ae1/volumes"
Sep 17 00:31:31.929125 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:31.929109    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5098c5f-fea9-4a17-8e6b-9b798a990d64" path="/var/lib/kubelet/pods/b5098c5f-fea9-4a17-8e6b-9b798a990d64/volumes"
Sep 17 00:31:31.929472 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:31.929460    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e48d7aee-afbc-417c-88fe-c3ce82a350c8" path="/var/lib/kubelet/pods/e48d7aee-afbc-417c-88fe-c3ce82a350c8/volumes"
Sep 17 00:31:32.034015 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:32.033977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:32.092759 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:32.092723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz" event={"ID":"f060865e-634e-440d-96d2-0ca5aa87f650","Type":"ContainerStarted","Data":"58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d"}
Sep 17 00:31:32.092955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:32.092776    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz" event={"ID":"f060865e-634e-440d-96d2-0ca5aa87f650","Type":"ContainerStarted","Data":"ade42037b08c7379edce338d90b8d8a10913f538584c38c3d76616699e587bd5"}
Sep 17 00:31:32.092955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:32.092842    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:31:32.094444 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:32.094423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf" event={"ID":"da23edc7-1508-4948-8973-51099fb80c75","Type":"ContainerStarted","Data":"f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7"}
Sep 17 00:31:32.094542 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:32.094461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf" event={"ID":"da23edc7-1508-4948-8973-51099fb80c75","Type":"ContainerStarted","Data":"7db615a26c2130eee00a13fa26c8973251a50fa6d9d62187bbb0cf454f85719b"}
Sep 17 00:31:32.094542 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:32.094500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:31:32.109252 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:32.109202    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz" podStartSLOduration=2.109186581 podStartE2EDuration="2.109186581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:31:32.107614934 +0000 UTC m=+1292.634354437" watchObservedRunningTime="2026-09-17 00:31:32.109186581 +0000 UTC m=+1292.635926059"
Sep 17 00:31:32.123827 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:32.123747    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf" podStartSLOduration=2.123731958 podStartE2EDuration="2.123731958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:31:32.121309215 +0000 UTC m=+1292.648048720" watchObservedRunningTime="2026-09-17 00:31:32.123731958 +0000 UTC m=+1292.650471494"
Sep 17 00:31:32.227632 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:32.227537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:32.858574 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:32.858539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:33.628762 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:33.628728    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:33.884586 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:33.884501    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"]
Sep 17 00:31:33.889480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:33.889455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:33.898155 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:33.898120    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2faea3\"/\"openshift-service-ca.crt\""
Sep 17 00:31:33.899293 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:33.899261    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2faea3\"/\"e2e-conflict-a-fe1bd81e-kserve-self-signed-certs\""
Sep 17 00:31:33.899460 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:33.899270    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2faea3\"/\"default-dockercfg-66bd9\""
Sep 17 00:31:33.899526 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:33.899510    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2faea3\"/\"kube-root-ca.crt\""
Sep 17 00:31:33.902931 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:33.902902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"]
Sep 17 00:31:34.061455 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.061419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tmp-dir\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.061455 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.061462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-model-cache\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.061682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.061533    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tls-certs\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.061682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.061575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh4wh\" (UniqueName: \"kubernetes.io/projected/23a6b5f8-387e-49bd-bd23-02124e82f2e4-kube-api-access-fh4wh\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.061682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.061650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-home\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.061791 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.061696    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-dshm\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.162598 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.162508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-home\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.162598 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.162564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-dshm\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.162598 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.162597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tmp-dir\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.162896 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.162616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-model-cache\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.162896 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.162652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tls-certs\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.162896 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.162669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh4wh\" (UniqueName: \"kubernetes.io/projected/23a6b5f8-387e-49bd-bd23-02124e82f2e4-kube-api-access-fh4wh\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.163056 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.162974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-home\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.163115 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.163082    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-model-cache\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.163115 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.163086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tmp-dir\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.164961 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.164940    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-dshm\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.165214 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.165193    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tls-certs\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.170118 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.170093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh4wh\" (UniqueName: \"kubernetes.io/projected/23a6b5f8-387e-49bd-bd23-02124e82f2e4-kube-api-access-fh4wh\") pod \"e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") " pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.206272 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.206234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:34.280130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.279980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:34.390958 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.390920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:34.486389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:34.486363    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"]
Sep 17 00:31:34.488259 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:31:34.488234    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23a6b5f8_387e_49bd_bd23_02124e82f2e4.slice/crio-9b914a17e14bacd1643398a15ad0b254cca22ae3381afe920da696d252f90299 WatchSource:0}: Error finding container 9b914a17e14bacd1643398a15ad0b254cca22ae3381afe920da696d252f90299: Status 404 returned error can't find the container with id 9b914a17e14bacd1643398a15ad0b254cca22ae3381afe920da696d252f90299
Sep 17 00:31:35.115422 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:35.115383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf" event={"ID":"23a6b5f8-387e-49bd-bd23-02124e82f2e4","Type":"ContainerStarted","Data":"9b914a17e14bacd1643398a15ad0b254cca22ae3381afe920da696d252f90299"}
Sep 17 00:31:35.206592 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:35.206547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:36.122159 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:36.122119    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf" event={"ID":"23a6b5f8-387e-49bd-bd23-02124e82f2e4","Type":"ContainerStarted","Data":"71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea"}
Sep 17 00:31:36.140747 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:36.140693    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf" podStartSLOduration=1.9932041520000001 podStartE2EDuration="3.140672089s" totalImagesPullingTime="1.147467937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:31:36.13799869 +0000 UTC m=+1296.664738169" watchObservedRunningTime="2026-09-17 00:31:36.140672089 +0000 UTC m=+1296.667411570"
Sep 17 00:31:43.102207 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:43.102171    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:31:43.102623 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:43.102340    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:31:43.296935 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:43.296890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:44.207128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:44.207055    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:44.207128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:44.207144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:44.220404 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:44.220376    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:45.190518 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:45.190484    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:31:52.063297 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:52.063259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:52.776022 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:52.775989    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:53.654007 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:53.653972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:54.415951 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:54.415919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:55.152326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:55.152289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:55.935024 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:55.934978    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:56.712468 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:56.712423    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:57.042348 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.042263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:57.328317 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.328280    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"]
Sep 17 00:31:57.332795 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.332765    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.335501 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.335474    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-edbd82-openshift-default-dockercfg-5svcl\""
Sep 17 00:31:57.344719 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.344693    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"]
Sep 17 00:31:57.358592 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.358563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:57.404068 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.404012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-socket\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.404068 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.404063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-data\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.404310 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.404099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-certs\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.404310 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.404125    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-credential-socket\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.404310 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.404149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8147eff5-d245-4a69-a988-51f95ac681e8-istiod-ca-cert\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.404310 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.404292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8147eff5-d245-4a69-a988-51f95ac681e8-istio-podinfo\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.404485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.404337    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-envoy\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.404485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.404413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-istio-token\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.404485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.404469    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvhds\" (UniqueName: \"kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-kube-api-access-gvhds\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.457484 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.457427    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:31:57.505342 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.505302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8147eff5-d245-4a69-a988-51f95ac681e8-istiod-ca-cert\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.505516 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.505423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8147eff5-d245-4a69-a988-51f95ac681e8-istio-podinfo\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.505516 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.505447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-envoy\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.505608 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.505513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-istio-token\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.505608 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.505553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvhds\" (UniqueName: \"kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-kube-api-access-gvhds\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.505709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.505616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-socket\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.505709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.505635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-data\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.505853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.505743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-certs\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.505919 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.505853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-credential-socket\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.505985 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.505966    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-data\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.506138 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.506114    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-certs\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.506220 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.506142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-socket\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.506220 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.506173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8147eff5-d245-4a69-a988-51f95ac681e8-istiod-ca-cert\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.506321 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.506300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-credential-socket\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.507895 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.507865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-envoy\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.508076 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.508058    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8147eff5-d245-4a69-a988-51f95ac681e8-istio-podinfo\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.513165 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.513140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvhds\" (UniqueName: \"kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-kube-api-access-gvhds\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.513270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.513249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-istio-token\") pod \"e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") " pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.645366 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.645273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:57.923431 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:31:57.923368    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8147eff5_d245_4a69_a988_51f95ac681e8.slice/crio-83c4632608ead47d90a5d9acc730d14cda1defc2e4d7b784ca280931cb89087a WatchSource:0}: Error finding container 83c4632608ead47d90a5d9acc730d14cda1defc2e4d7b784ca280931cb89087a: Status 404 returned error can't find the container with id 83c4632608ead47d90a5d9acc730d14cda1defc2e4d7b784ca280931cb89087a
Sep 17 00:31:57.926270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.926227    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:31:57.926605 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.926322    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:31:57.926605 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.926370    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:31:57.928215 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:57.928194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"]
Sep 17 00:31:58.254489 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:58.254385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" event={"ID":"8147eff5-d245-4a69-a988-51f95ac681e8","Type":"ContainerStarted","Data":"5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0"}
Sep 17 00:31:58.254489 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:58.254450    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" event={"ID":"8147eff5-d245-4a69-a988-51f95ac681e8","Type":"ContainerStarted","Data":"83c4632608ead47d90a5d9acc730d14cda1defc2e4d7b784ca280931cb89087a"}
Sep 17 00:31:58.275959 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:58.275901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" podStartSLOduration=1.275884264 podStartE2EDuration="1.275884264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:31:58.273585474 +0000 UTC m=+1318.800324970" watchObservedRunningTime="2026-09-17 00:31:58.275884264 +0000 UTC m=+1318.802623742"
Sep 17 00:31:58.645894 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:58.645846    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:58.651197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:58.651172    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:59.261315 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:59.261284    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:59.262319 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:59.262294    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:31:59.505885 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:31:59.505848    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:00.126845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:00.126784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:00.224796 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:00.224757    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:00.328258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:00.328153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:00.892553 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:00.892516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:01.181368 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:01.181257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:01.925297 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:01.925262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:02.796338 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:02.796305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:03.423934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:03.423895    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:04.034985 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.034945    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"]
Sep 17 00:32:04.040568 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.040541    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.043108 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.043082    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-edbd82-serving-cert\""
Sep 17 00:32:04.050208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.050186    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"]
Sep 17 00:32:04.060621 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.060578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:04.157868 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.157647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:04.177586 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.177553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.177768 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.177617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45qkx\" (UniqueName: \"kubernetes.io/projected/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-kube-api-access-45qkx\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.177830 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.177768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.177903 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.177883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.278620 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.278580    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.278853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.278651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.278853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.278723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45qkx\" (UniqueName: \"kubernetes.io/projected/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-kube-api-access-45qkx\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.278853 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:32:04.278829    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-serving-cert: secret "maas-api-e2e-shared-b-w2-edbd82-serving-cert" not found
Sep 17 00:32:04.278853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.278844    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.279029 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:32:04.278907    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-maas-api-tls podName:35dd59f4-f6d4-4d4c-9aae-49b68564b70a nodeName:}" failed. No retries permitted until 2026-09-17 00:32:04.778887877 +0000 UTC m=+1325.305627349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-maas-api-tls") pod "maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9" (UID: "35dd59f4-f6d4-4d4c-9aae-49b68564b70a") : secret "maas-api-e2e-shared-b-w2-edbd82-serving-cert" not found
Sep 17 00:32:04.279357 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.279337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.281357 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.281339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.287478 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.287410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45qkx\" (UniqueName: \"kubernetes.io/projected/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-kube-api-access-45qkx\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.507181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.507142    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:04.607866 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.607825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:04.713075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.713039    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:04.792654 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.792616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.795087 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.795057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:04.954010 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:04.953924    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:05.228030 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:05.227996    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"]
Sep 17 00:32:05.229500 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:32:05.229475    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35dd59f4_f6d4_4d4c_9aae_49b68564b70a.slice/crio-8a2ea1e3f2d9c779719b21fbc0d748f3f17807a5d8cbd886ef4c5dc5cc7a1188 WatchSource:0}: Error finding container 8a2ea1e3f2d9c779719b21fbc0d748f3f17807a5d8cbd886ef4c5dc5cc7a1188: Status 404 returned error can't find the container with id 8a2ea1e3f2d9c779719b21fbc0d748f3f17807a5d8cbd886ef4c5dc5cc7a1188
Sep 17 00:32:05.294902 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:05.294869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9" event={"ID":"35dd59f4-f6d4-4d4c-9aae-49b68564b70a","Type":"ContainerStarted","Data":"8a2ea1e3f2d9c779719b21fbc0d748f3f17807a5d8cbd886ef4c5dc5cc7a1188"}
Sep 17 00:32:06.302224 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:06.302191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9" event={"ID":"35dd59f4-f6d4-4d4c-9aae-49b68564b70a","Type":"ContainerStarted","Data":"62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e"}
Sep 17 00:32:06.302642 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:06.302271    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:06.319697 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:06.319653    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9" podStartSLOduration=1.757590389 podStartE2EDuration="2.319638996s" totalImagesPullingTime="562.048607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:32:06.318396235 +0000 UTC m=+1326.845135737" watchObservedRunningTime="2026-09-17 00:32:06.319638996 +0000 UTC m=+1326.846378478"
Sep 17 00:32:12.042589 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:12.042550    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:12.293097 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:12.293068    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"]
Sep 17 00:32:12.293304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:12.293281    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy" containerID="cri-o://ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc" gracePeriod=30
Sep 17 00:32:12.307995 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:12.307951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:12.314080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:12.314054    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:32:12.792151 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:12.792041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:13.081992 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.081952    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"]
Sep 17 00:32:13.085367 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.085341    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.088093 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.088067    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-090464-openshift-default-dockercfg-gp8hh\""
Sep 17 00:32:13.096388 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.096362    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"]
Sep 17 00:32:13.119951 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.119918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:13.187984 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.187948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-podinfo\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.188213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.188005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-credential-socket\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.188213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.188034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-socket\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.188213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.188062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-data\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.188213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.188085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istiod-ca-cert\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.188213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.188132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-token\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.188213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.188149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv6d8\" (UniqueName: \"kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-kube-api-access-vv6d8\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.188213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.188193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-envoy\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.188586 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.188238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-certs\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.217130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.217082    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:13.289054 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-certs\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-podinfo\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289136    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-credential-socket\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-socket\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-data\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istiod-ca-cert\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289500 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-token\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289500 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv6d8\" (UniqueName: \"kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-kube-api-access-vv6d8\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289500 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-envoy\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-certs\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-data\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-credential-socket\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.289641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.289612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-socket\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.290249 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.290223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istiod-ca-cert\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.291510 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.291492    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-envoy\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.291617 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.291603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-podinfo\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.298743 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.298716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-token\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.298882 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.298758    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv6d8\" (UniqueName: \"kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-kube-api-access-vv6d8\") pod \"e2e-noten-090464-openshift-default-6769ffc478-dv4m6\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") " pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.400063 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.399990    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:13.673043 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.673015    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"]
Sep 17 00:32:13.674477 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:32:13.674450    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7f2831_a8a8_4135_a6eb_c714e56694a2.slice/crio-5554cbe6b49a98c83e722d52ee81ae97ef8bd2f4d3853a4b53a276bcb2bee144 WatchSource:0}: Error finding container 5554cbe6b49a98c83e722d52ee81ae97ef8bd2f4d3853a4b53a276bcb2bee144: Status 404 returned error can't find the container with id 5554cbe6b49a98c83e722d52ee81ae97ef8bd2f4d3853a4b53a276bcb2bee144
Sep 17 00:32:13.676915 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.676874    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:32:13.676989 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.676947    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:32:13.676989 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:13.676975    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:32:14.347074 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:14.347033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6" event={"ID":"7f7f2831-a8a8-4135-a6eb-c714e56694a2","Type":"ContainerStarted","Data":"c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b"}
Sep 17 00:32:14.347460 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:14.347099    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6" event={"ID":"7f7f2831-a8a8-4135-a6eb-c714e56694a2","Type":"ContainerStarted","Data":"5554cbe6b49a98c83e722d52ee81ae97ef8bd2f4d3853a4b53a276bcb2bee144"}
Sep 17 00:32:14.367724 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:14.367676    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6" podStartSLOduration=1.367660922 podStartE2EDuration="1.367660922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:32:14.365434955 +0000 UTC m=+1334.892174454" watchObservedRunningTime="2026-09-17 00:32:14.367660922 +0000 UTC m=+1334.894400400"
Sep 17 00:32:14.400712 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:14.400682    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:14.406252 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:14.406228    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:14.658904 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:14.658758    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:14.757907 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:14.757849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:14.867054 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:14.867022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:15.353194 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:15.353162    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:15.354196 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:15.354175    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:32:16.026367 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:16.026327    2565 patch_prober.go:28] interesting pod/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 00:32:16.026527 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:16.026387    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:32:17.529075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.529043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:17.555432 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.555377    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:32:17.635121 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635090    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2da62b4-d21e-46e8-82c6-044af8d741fb-istiod-ca-cert\") pod \"d2da62b4-d21e-46e8-82c6-044af8d741fb\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") "
Sep 17 00:32:17.635254 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635128    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-socket\") pod \"d2da62b4-d21e-46e8-82c6-044af8d741fb\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") "
Sep 17 00:32:17.635254 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635167    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-podinfo\") pod \"d2da62b4-d21e-46e8-82c6-044af8d741fb\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") "
Sep 17 00:32:17.635254 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-credential-socket\") pod \"d2da62b4-d21e-46e8-82c6-044af8d741fb\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") "
Sep 17 00:32:17.635396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635273    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-envoy\") pod \"d2da62b4-d21e-46e8-82c6-044af8d741fb\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") "
Sep 17 00:32:17.635396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635322    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-token\") pod \"d2da62b4-d21e-46e8-82c6-044af8d741fb\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") "
Sep 17 00:32:17.635497 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635405    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzjzg\" (UniqueName: \"kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-kube-api-access-kzjzg\") pod \"d2da62b4-d21e-46e8-82c6-044af8d741fb\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") "
Sep 17 00:32:17.635497 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635426    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-certs\") pod \"d2da62b4-d21e-46e8-82c6-044af8d741fb\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") "
Sep 17 00:32:17.635497 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635463    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-data\") pod \"d2da62b4-d21e-46e8-82c6-044af8d741fb\" (UID: \"d2da62b4-d21e-46e8-82c6-044af8d741fb\") "
Sep 17 00:32:17.635649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635494    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2da62b4-d21e-46e8-82c6-044af8d741fb" (UID: "d2da62b4-d21e-46e8-82c6-044af8d741fb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:32:17.635649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635592    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2da62b4-d21e-46e8-82c6-044af8d741fb" (UID: "d2da62b4-d21e-46e8-82c6-044af8d741fb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:32:17.635649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635608    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2da62b4-d21e-46e8-82c6-044af8d741fb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2da62b4-d21e-46e8-82c6-044af8d741fb" (UID: "d2da62b4-d21e-46e8-82c6-044af8d741fb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:32:17.635844 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635792    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2da62b4-d21e-46e8-82c6-044af8d741fb" (UID: "d2da62b4-d21e-46e8-82c6-044af8d741fb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:32:17.635908 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635853    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2da62b4-d21e-46e8-82c6-044af8d741fb" (UID: "d2da62b4-d21e-46e8-82c6-044af8d741fb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:32:17.635968 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635935    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:32:17.635968 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635956    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:32:17.636075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635970    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2da62b4-d21e-46e8-82c6-044af8d741fb-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:32:17.636075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.635983    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:32:17.637664 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.637640    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2da62b4-d21e-46e8-82c6-044af8d741fb" (UID: "d2da62b4-d21e-46e8-82c6-044af8d741fb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:32:17.637762 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.637662    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2da62b4-d21e-46e8-82c6-044af8d741fb" (UID: "d2da62b4-d21e-46e8-82c6-044af8d741fb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:32:17.637762 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.637711    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2da62b4-d21e-46e8-82c6-044af8d741fb" (UID: "d2da62b4-d21e-46e8-82c6-044af8d741fb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:32:17.637860 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.637759    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-kube-api-access-kzjzg" (OuterVolumeSpecName: "kube-api-access-kzjzg") pod "d2da62b4-d21e-46e8-82c6-044af8d741fb" (UID: "d2da62b4-d21e-46e8-82c6-044af8d741fb"). InnerVolumeSpecName "kube-api-access-kzjzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:32:17.737353 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.737321    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:32:17.737353 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.737347    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:32:17.737353 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.737357    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:32:17.737557 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.737365    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzjzg\" (UniqueName: \"kubernetes.io/projected/d2da62b4-d21e-46e8-82c6-044af8d741fb-kube-api-access-kzjzg\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:32:17.737557 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:17.737374    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2da62b4-d21e-46e8-82c6-044af8d741fb-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:32:18.371573 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.371539    2565 generic.go:356] "Generic (PLEG): container finished" podID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerID="ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc" exitCode=0
Sep 17 00:32:18.371779 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.371590    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"
Sep 17 00:32:18.371779 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.371616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" event={"ID":"d2da62b4-d21e-46e8-82c6-044af8d741fb","Type":"ContainerDied","Data":"ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc"}
Sep 17 00:32:18.371779 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.371674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q" event={"ID":"d2da62b4-d21e-46e8-82c6-044af8d741fb","Type":"ContainerDied","Data":"70d9ebe9b48f851a56e444a037cc34a859522d66f2fedd51001391e2c65b5b02"}
Sep 17 00:32:18.371779 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.371704    2565 scope.go:117] "RemoveContainer" containerID="ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc"
Sep 17 00:32:18.381065 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.381047    2565 scope.go:117] "RemoveContainer" containerID="dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89"
Sep 17 00:32:18.389691 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.389664    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"]
Sep 17 00:32:18.391168 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.391132    2565 scope.go:117] "RemoveContainer" containerID="ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc"
Sep 17 00:32:18.391688 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:32:18.391635    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc\": container with ID starting with ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc not found: ID does not exist" containerID="ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc"
Sep 17 00:32:18.391688 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.391672    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc"} err="failed to get container status \"ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc\": rpc error: code = NotFound desc = could not find container \"ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc\": container with ID starting with ee6b48ab6623bb049cfde3042114ed6c591dbc583f9511738e6e835ad18141bc not found: ID does not exist"
Sep 17 00:32:18.391870 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.391697    2565 scope.go:117] "RemoveContainer" containerID="dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89"
Sep 17 00:32:18.392046 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:32:18.392019    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89\": container with ID starting with dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89 not found: ID does not exist" containerID="dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89"
Sep 17 00:32:18.392101 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.392050    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89"} err="failed to get container status \"dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89\": rpc error: code = NotFound desc = could not find container \"dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89\": container with ID starting with dc29469302fd3c3b059a2288bc02d59d9e87f1104066fd97d3d06b37f5b4ba89 not found: ID does not exist"
Sep 17 00:32:18.394114 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:18.394093    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-abe86c-openshift-default-89dd5b576-gvq5q"]
Sep 17 00:32:19.928099 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:19.928057    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" path="/var/lib/kubelet/pods/d2da62b4-d21e-46e8-82c6-044af8d741fb/volumes"
Sep 17 00:32:26.121787 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:26.121740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:26.740487 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:26.740450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:27.414578 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:27.414483    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:28.058325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:28.058292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:28.707069 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:28.707007    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:29.450232 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:29.450190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:30.253285 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:30.253247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:30.353723 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:30.353627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:33.472088 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:33.472057    2565 generic.go:356] "Generic (PLEG): container finished" podID="8147eff5-d245-4a69-a988-51f95ac681e8" containerID="5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0" exitCode=0
Sep 17 00:32:33.472505 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:33.472131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" event={"ID":"8147eff5-d245-4a69-a988-51f95ac681e8","Type":"ContainerDied","Data":"5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0"}
Sep 17 00:32:33.472691 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:33.472672    2565 scope.go:117] "RemoveContainer" containerID="5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0"
Sep 17 00:32:33.473899 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:33.473870    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:32:33.474045 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:33.473953    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:32:33.474045 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:33.474001    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:32:34.483226 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:34.483190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" event={"ID":"8147eff5-d245-4a69-a988-51f95ac681e8","Type":"ContainerStarted","Data":"66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee"}
Sep 17 00:32:34.646141 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:34.646100    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:32:34.646450 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:34.646425    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 17 00:32:34.646501 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:34.646481    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 17 00:32:35.646285 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:35.646242    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 17 00:32:35.646760 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:35.646307    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 17 00:32:36.646071 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:36.646032    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 17 00:32:36.646245 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:36.646091    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 17 00:32:37.645705 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:37.645666    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 17 00:32:37.646130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:37.645724    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 17 00:32:38.646407 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:38.646372    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 17 00:32:38.646783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:38.646425    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 17 00:32:39.393998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.393951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:39.456277 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.456239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:39.526396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.526356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:39.649697 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.649616    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:32:39.650112 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.649918    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:32:39.650621 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.650604    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:32:39.813705 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.813672    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"]
Sep 17 00:32:39.814427 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.814400    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy"
Sep 17 00:32:39.814608 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.814588    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy"
Sep 17 00:32:39.814749 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.814739    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy"
Sep 17 00:32:39.818092 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.818071    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.821623 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.821599    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c5ae0fdd-openshift-default-dockercfg-vj7g7\""
Sep 17 00:32:39.827338 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.827313    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"]
Sep 17 00:32:39.845766 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.845721    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:39.884122 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.884086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz2v8\" (UniqueName: \"kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-kube-api-access-nz2v8\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.884272 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.884126    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-token\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.884272 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.884164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/444817f3-3be0-4320-8dd0-6f8980b63f25-istiod-ca-cert\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.884272 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.884192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-data\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.884272 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.884232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-certs\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.884272 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.884265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-podinfo\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.884464 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.884285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-credential-socket\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.884464 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.884420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-envoy\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.884540 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.884479    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-socket\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.956905 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.956656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:39.985593 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.985557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-envoy\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.985768 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.985602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-socket\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.985768 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.985638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz2v8\" (UniqueName: \"kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-kube-api-access-nz2v8\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.985768 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.985658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-token\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.985996 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.985793    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/444817f3-3be0-4320-8dd0-6f8980b63f25-istiod-ca-cert\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.985996 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.985869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-data\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.985996 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.985948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-certs\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.986156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.986028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-podinfo\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.986156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.986060    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-credential-socket\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.986156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.986102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-socket\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.986320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.986274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-data\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.986378 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.986358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-credential-socket\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.986522 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.986495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-certs\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.986648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.986631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/444817f3-3be0-4320-8dd0-6f8980b63f25-istiod-ca-cert\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.988064 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.988043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-envoy\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.988533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.988515    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-podinfo\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.993159 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.993138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-token\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:39.993311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:39.993295    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz2v8\" (UniqueName: \"kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-kube-api-access-nz2v8\") pod \"e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") " pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:40.133529 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:40.133494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:40.406651 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:40.406621    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"]
Sep 17 00:32:40.409091 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:32:40.409059    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444817f3_3be0_4320_8dd0_6f8980b63f25.slice/crio-d6bc39197806e3cfe510f0c8143d4eef517f55475f0b5e475495c8918f06f669 WatchSource:0}: Error finding container d6bc39197806e3cfe510f0c8143d4eef517f55475f0b5e475495c8918f06f669: Status 404 returned error can't find the container with id d6bc39197806e3cfe510f0c8143d4eef517f55475f0b5e475495c8918f06f669
Sep 17 00:32:40.411654 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:40.411615    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:32:40.411753 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:40.411685    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:32:40.411753 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:40.411718    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:32:40.521378 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:40.521340    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" event={"ID":"444817f3-3be0-4320-8dd0-6f8980b63f25","Type":"ContainerStarted","Data":"ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f"}
Sep 17 00:32:40.521538 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:40.521405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" event={"ID":"444817f3-3be0-4320-8dd0-6f8980b63f25","Type":"ContainerStarted","Data":"d6bc39197806e3cfe510f0c8143d4eef517f55475f0b5e475495c8918f06f669"}
Sep 17 00:32:40.543338 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:40.543289    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" podStartSLOduration=1.543272814 podStartE2EDuration="1.543272814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:32:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:32:40.542545567 +0000 UTC m=+1361.069285069" watchObservedRunningTime="2026-09-17 00:32:40.543272814 +0000 UTC m=+1361.070012291"
Sep 17 00:32:41.133927 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:41.133885    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:41.135510 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:41.135481    2565 patch_prober.go:28] interesting pod/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:32:41.135573 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:41.135527    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 17 00:32:41.818568 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:41.818531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:42.138359 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:42.138274    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:42.524978 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:42.524897    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:42.532784 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:42.532749    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:42.533606 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:42.533590    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:32:42.626385 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:42.626354    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:43.358603 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:43.358570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:44.130411 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:44.130369    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:44.766324 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:44.766282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:45.429653 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:45.429618    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:46.206202 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:46.206159    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:46.857385 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:46.857350    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:46.915257 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:46.915214    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:47.018048 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.018013    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:47.315054 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.315015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:47.418101 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.418063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:47.425869 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.425841    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"]
Sep 17 00:32:47.426324 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.426311    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy"
Sep 17 00:32:47.426370 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.426326    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy"
Sep 17 00:32:47.426431 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.426419    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2da62b4-d21e-46e8-82c6-044af8d741fb" containerName="istio-proxy"
Sep 17 00:32:47.429400 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.429379    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:32:47.432076 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.432047    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-c5ae0fdd\""
Sep 17 00:32:47.432323 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.432308    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-c5ae0fdd-dockercfg-9drk9\""
Sep 17 00:32:47.439963 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.439940    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"]
Sep 17 00:32:47.450345 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.450316    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"]
Sep 17 00:32:47.453279 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.453260    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:32:47.464352 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.464330    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"]
Sep 17 00:32:47.567606 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.567514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bxz7\" (UniqueName: \"kubernetes.io/projected/883b0498-0a18-4f4b-89e4-3b7185b2e54e-kube-api-access-6bxz7\") pod \"payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg\" (UID: \"883b0498-0a18-4f4b-89e4-3b7185b2e54e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:32:47.567606 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.567571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xk2f\" (UniqueName: \"kubernetes.io/projected/0dc81474-899a-4f42-81ad-ce7b8785dc70-kube-api-access-8xk2f\") pod \"payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5\" (UID: \"0dc81474-899a-4f42-81ad-ce7b8785dc70\") " pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:32:47.567835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.567656    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc81474-899a-4f42-81ad-ce7b8785dc70-plugins-config-volume\") pod \"payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5\" (UID: \"0dc81474-899a-4f42-81ad-ce7b8785dc70\") " pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:32:47.567835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.567704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/883b0498-0a18-4f4b-89e4-3b7185b2e54e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg\" (UID: \"883b0498-0a18-4f4b-89e4-3b7185b2e54e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:32:47.669375 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.669341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bxz7\" (UniqueName: \"kubernetes.io/projected/883b0498-0a18-4f4b-89e4-3b7185b2e54e-kube-api-access-6bxz7\") pod \"payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg\" (UID: \"883b0498-0a18-4f4b-89e4-3b7185b2e54e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:32:47.669375 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.669380    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xk2f\" (UniqueName: \"kubernetes.io/projected/0dc81474-899a-4f42-81ad-ce7b8785dc70-kube-api-access-8xk2f\") pod \"payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5\" (UID: \"0dc81474-899a-4f42-81ad-ce7b8785dc70\") " pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:32:47.669635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.669416    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc81474-899a-4f42-81ad-ce7b8785dc70-plugins-config-volume\") pod \"payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5\" (UID: \"0dc81474-899a-4f42-81ad-ce7b8785dc70\") " pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:32:47.669635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.669434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/883b0498-0a18-4f4b-89e4-3b7185b2e54e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg\" (UID: \"883b0498-0a18-4f4b-89e4-3b7185b2e54e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:32:47.670148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.670129    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/883b0498-0a18-4f4b-89e4-3b7185b2e54e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg\" (UID: \"883b0498-0a18-4f4b-89e4-3b7185b2e54e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:32:47.670191 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.670176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc81474-899a-4f42-81ad-ce7b8785dc70-plugins-config-volume\") pod \"payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5\" (UID: \"0dc81474-899a-4f42-81ad-ce7b8785dc70\") " pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:32:47.677381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.677353    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bxz7\" (UniqueName: \"kubernetes.io/projected/883b0498-0a18-4f4b-89e4-3b7185b2e54e-kube-api-access-6bxz7\") pod \"payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg\" (UID: \"883b0498-0a18-4f4b-89e4-3b7185b2e54e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:32:47.677487 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.677456    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xk2f\" (UniqueName: \"kubernetes.io/projected/0dc81474-899a-4f42-81ad-ce7b8785dc70-kube-api-access-8xk2f\") pod \"payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5\" (UID: \"0dc81474-899a-4f42-81ad-ce7b8785dc70\") " pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:32:47.742420 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.742377    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:32:47.766579 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.766553    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:32:47.811063 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:47.811029    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:48.016758 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:48.016730    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"]
Sep 17 00:32:48.018069 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:32:48.018042    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883b0498_0a18_4f4b_89e4_3b7185b2e54e.slice/crio-956efd045ee61362d69451a471c33ee92839a9b198e5cb0f982a66d3dc9763e9 WatchSource:0}: Error finding container 956efd045ee61362d69451a471c33ee92839a9b198e5cb0f982a66d3dc9763e9: Status 404 returned error can't find the container with id 956efd045ee61362d69451a471c33ee92839a9b198e5cb0f982a66d3dc9763e9
Sep 17 00:32:48.051030 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:48.051005    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"]
Sep 17 00:32:48.053939 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:32:48.053915    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc81474_899a_4f42_81ad_ce7b8785dc70.slice/crio-816fa17bc3cb7f2e967935e5b55edc5194d8fd51c9119d58a3f98da40e6fee3b WatchSource:0}: Error finding container 816fa17bc3cb7f2e967935e5b55edc5194d8fd51c9119d58a3f98da40e6fee3b: Status 404 returned error can't find the container with id 816fa17bc3cb7f2e967935e5b55edc5194d8fd51c9119d58a3f98da40e6fee3b
Sep 17 00:32:48.456364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:48.456270    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:48.574001 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:48.573958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5" event={"ID":"0dc81474-899a-4f42-81ad-ce7b8785dc70","Type":"ContainerStarted","Data":"1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70"}
Sep 17 00:32:48.574191 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:48.574033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5" event={"ID":"0dc81474-899a-4f42-81ad-ce7b8785dc70","Type":"ContainerStarted","Data":"816fa17bc3cb7f2e967935e5b55edc5194d8fd51c9119d58a3f98da40e6fee3b"}
Sep 17 00:32:48.574260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:48.574233    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:32:48.576017 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:48.575992    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg" event={"ID":"883b0498-0a18-4f4b-89e4-3b7185b2e54e","Type":"ContainerStarted","Data":"109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5"}
Sep 17 00:32:48.576152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:48.576043    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:32:48.576152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:48.576065    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg" event={"ID":"883b0498-0a18-4f4b-89e4-3b7185b2e54e","Type":"ContainerStarted","Data":"956efd045ee61362d69451a471c33ee92839a9b198e5cb0f982a66d3dc9763e9"}
Sep 17 00:32:48.590854 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:48.590798    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5" podStartSLOduration=1.5907848489999998 podStartE2EDuration="1.590784849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:32:48.589084099 +0000 UTC m=+1369.115823599" watchObservedRunningTime="2026-09-17 00:32:48.590784849 +0000 UTC m=+1369.117524326"
Sep 17 00:32:48.605256 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:48.605215    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg" podStartSLOduration=1.6052030739999998 podStartE2EDuration="1.605203074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:32:48.603633838 +0000 UTC m=+1369.130373340" watchObservedRunningTime="2026-09-17 00:32:48.605203074 +0000 UTC m=+1369.131942591"
Sep 17 00:32:51.801493 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:51.801457    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:32:59.584260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:59.584225    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:32:59.584785 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:59.584311    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:32:59.794299 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:32:59.794263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:04.126628 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:04.126582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:06.688457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:06.688422    2565 generic.go:356] "Generic (PLEG): container finished" podID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerID="ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f" exitCode=0
Sep 17 00:33:06.688885 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:06.688493    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" event={"ID":"444817f3-3be0-4320-8dd0-6f8980b63f25","Type":"ContainerDied","Data":"ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f"}
Sep 17 00:33:06.688952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:06.688937    2565 scope.go:117] "RemoveContainer" containerID="ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f"
Sep 17 00:33:06.690192 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:06.690164    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:33:06.690268 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:06.690234    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:33:06.690305 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:06.690266    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:33:07.696524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:07.696488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" event={"ID":"444817f3-3be0-4320-8dd0-6f8980b63f25","Type":"ContainerStarted","Data":"e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d"}
Sep 17 00:33:08.133856 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:08.133792    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:33:08.135248 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:08.135216    2565 patch_prober.go:28] interesting pod/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:33:08.135376 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:08.135269    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 17 00:33:08.741441 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:08.741397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:09.134794 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:09.134754    2565 patch_prober.go:28] interesting pod/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:33:09.135001 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:09.134846    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 17 00:33:09.426994 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:09.426883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:10.040179 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:10.040133    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:10.134037 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:10.133999    2565 patch_prober.go:28] interesting pod/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:33:10.134319 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:10.134288    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 17 00:33:10.840414 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:10.840370    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:11.134942 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:11.134845    2565 patch_prober.go:28] interesting pod/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:33:11.135324 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:11.134944    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 17 00:33:11.482342 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:11.482253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:12.134671 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:12.134632    2565 patch_prober.go:28] interesting pod/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:33:12.134898 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:12.134692    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 17 00:33:12.223685 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:12.223640    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:12.533302 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:12.533211    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:33:12.621164 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:12.621101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:12.917565 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:12.917519    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:13.134796 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:13.134759    2565 patch_prober.go:28] interesting pod/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:33:13.135013 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:13.134840    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 17 00:33:13.577189 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:13.577149    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:14.138307 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:14.138275    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:33:14.139226 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:14.139204    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:33:16.440879 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:16.440841    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:17.220286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:17.220243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:17.826790 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:17.826745    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:18.456500 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:18.456467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:19.156260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:19.156228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:19.818568 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:19.818532    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:20.629305 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:20.629257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:21.248265 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:21.248229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:22.019684 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:22.019650    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:22.521911 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:22.521870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:26.592454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.592332    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"]
Sep 17 00:33:26.593386 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.593030    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj" podUID="cd241322-4e3b-49fa-bfa8-a8f5f0771e4c" containerName="maas-api" containerID="cri-o://013ad69eebcc3cfa8f06694464316694c8e7f86329d0665a77e2d8db5b316e8b" gracePeriod=30
Sep 17 00:33:26.624580 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.624537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:26.645030 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.644984    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"]
Sep 17 00:33:26.645305 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.645274    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd" podUID="c873614d-a355-409f-8876-00a4cb561732" containerName="payload-processing" containerID="cri-o://95856537c2563d922644e48fca879ad5850f2dbee4f0114cda3d7dd7090dc653" gracePeriod=30
Sep 17 00:33:26.653258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.653209    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"]
Sep 17 00:33:26.654180 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.653869    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52" podUID="4e8e67f0-6e87-4bbb-93a7-31a1d4731077" containerName="payload-pre-processing" containerID="cri-o://9ab45704f51e44f970db6009b856ef3a83cd6c902bf13be6ba4dafb0ab70c3e0" gracePeriod=30
Sep 17 00:33:26.688633 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.688595    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:26.743186 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.743147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:26.803406 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.803331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:26.815318 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.815273    2565 generic.go:356] "Generic (PLEG): container finished" podID="cd241322-4e3b-49fa-bfa8-a8f5f0771e4c" containerID="013ad69eebcc3cfa8f06694464316694c8e7f86329d0665a77e2d8db5b316e8b" exitCode=0
Sep 17 00:33:26.815516 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.815357    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj" event={"ID":"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c","Type":"ContainerDied","Data":"013ad69eebcc3cfa8f06694464316694c8e7f86329d0665a77e2d8db5b316e8b"}
Sep 17 00:33:26.817653 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.817621    2565 generic.go:356] "Generic (PLEG): container finished" podID="4e8e67f0-6e87-4bbb-93a7-31a1d4731077" containerID="9ab45704f51e44f970db6009b856ef3a83cd6c902bf13be6ba4dafb0ab70c3e0" exitCode=0
Sep 17 00:33:26.817835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.817751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52" event={"ID":"4e8e67f0-6e87-4bbb-93a7-31a1d4731077","Type":"ContainerDied","Data":"9ab45704f51e44f970db6009b856ef3a83cd6c902bf13be6ba4dafb0ab70c3e0"}
Sep 17 00:33:26.819749 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.819720    2565 generic.go:356] "Generic (PLEG): container finished" podID="c873614d-a355-409f-8876-00a4cb561732" containerID="95856537c2563d922644e48fca879ad5850f2dbee4f0114cda3d7dd7090dc653" exitCode=0
Sep 17 00:33:26.819898 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.819765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd" event={"ID":"c873614d-a355-409f-8876-00a4cb561732","Type":"ContainerDied","Data":"95856537c2563d922644e48fca879ad5850f2dbee4f0114cda3d7dd7090dc653"}
Sep 17 00:33:26.861308 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.861226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:26.965529 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.965499    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:33:26.988343 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:26.988315    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:33:27.010916 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.010422    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:33:27.045032 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045005    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ffw4\" (UniqueName: \"kubernetes.io/projected/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-kube-api-access-6ffw4\") pod \"4e8e67f0-6e87-4bbb-93a7-31a1d4731077\" (UID: \"4e8e67f0-6e87-4bbb-93a7-31a1d4731077\") "
Sep 17 00:33:27.045188 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-openshift-service-ca\") pod \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") "
Sep 17 00:33:27.045188 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045074    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-plugins-config-volume\") pod \"4e8e67f0-6e87-4bbb-93a7-31a1d4731077\" (UID: \"4e8e67f0-6e87-4bbb-93a7-31a1d4731077\") "
Sep 17 00:33:27.045188 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045127    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-maas-api-tls\") pod \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") "
Sep 17 00:33:27.045188 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045167    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-metrics-certs\") pod \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") "
Sep 17 00:33:27.045431 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045213    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c873614d-a355-409f-8876-00a4cb561732-plugins-config-volume\") pod \"c873614d-a355-409f-8876-00a4cb561732\" (UID: \"c873614d-a355-409f-8876-00a4cb561732\") "
Sep 17 00:33:27.045431 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045251    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s89nd\" (UniqueName: \"kubernetes.io/projected/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-kube-api-access-s89nd\") pod \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\" (UID: \"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c\") "
Sep 17 00:33:27.045431 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045293    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjxh7\" (UniqueName: \"kubernetes.io/projected/c873614d-a355-409f-8876-00a4cb561732-kube-api-access-qjxh7\") pod \"c873614d-a355-409f-8876-00a4cb561732\" (UID: \"c873614d-a355-409f-8876-00a4cb561732\") "
Sep 17 00:33:27.045615 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045440    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cd241322-4e3b-49fa-bfa8-a8f5f0771e4c" (UID: "cd241322-4e3b-49fa-bfa8-a8f5f0771e4c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:33:27.045615 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045490    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4e8e67f0-6e87-4bbb-93a7-31a1d4731077" (UID: "4e8e67f0-6e87-4bbb-93a7-31a1d4731077"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:33:27.045879 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045850    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c873614d-a355-409f-8876-00a4cb561732-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c873614d-a355-409f-8876-00a4cb561732" (UID: "c873614d-a355-409f-8876-00a4cb561732"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:33:27.046066 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.045966    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-openshift-service-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:27.046171 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.046103    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:27.047643 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.047597    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cd241322-4e3b-49fa-bfa8-a8f5f0771e4c" (UID: "cd241322-4e3b-49fa-bfa8-a8f5f0771e4c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:33:27.048148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.048128    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cd241322-4e3b-49fa-bfa8-a8f5f0771e4c" (UID: "cd241322-4e3b-49fa-bfa8-a8f5f0771e4c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:33:27.048357 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.048329    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c873614d-a355-409f-8876-00a4cb561732-kube-api-access-qjxh7" (OuterVolumeSpecName: "kube-api-access-qjxh7") pod "c873614d-a355-409f-8876-00a4cb561732" (UID: "c873614d-a355-409f-8876-00a4cb561732"). InnerVolumeSpecName "kube-api-access-qjxh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:33:27.048550 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.048529    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-kube-api-access-6ffw4" (OuterVolumeSpecName: "kube-api-access-6ffw4") pod "4e8e67f0-6e87-4bbb-93a7-31a1d4731077" (UID: "4e8e67f0-6e87-4bbb-93a7-31a1d4731077"). InnerVolumeSpecName "kube-api-access-6ffw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:33:27.048703 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.048686    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-kube-api-access-s89nd" (OuterVolumeSpecName: "kube-api-access-s89nd") pod "cd241322-4e3b-49fa-bfa8-a8f5f0771e4c" (UID: "cd241322-4e3b-49fa-bfa8-a8f5f0771e4c"). InnerVolumeSpecName "kube-api-access-s89nd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:33:27.147006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.146911    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-metrics-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:27.147006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.146945    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c873614d-a355-409f-8876-00a4cb561732-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:27.147006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.146958    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s89nd\" (UniqueName: \"kubernetes.io/projected/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-kube-api-access-s89nd\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:27.147006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.146969    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjxh7\" (UniqueName: \"kubernetes.io/projected/c873614d-a355-409f-8876-00a4cb561732-kube-api-access-qjxh7\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:27.147006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.146982    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ffw4\" (UniqueName: \"kubernetes.io/projected/4e8e67f0-6e87-4bbb-93a7-31a1d4731077-kube-api-access-6ffw4\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:27.147006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.146994    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c-maas-api-tls\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:27.157936 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.157907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:27.258506 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.258467    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:27.827073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.827040    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"
Sep 17 00:33:27.827518 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.827041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd" event={"ID":"c873614d-a355-409f-8876-00a4cb561732","Type":"ContainerDied","Data":"c29761e60ccee3cb4b55a334312afdd76d4857ed356b1267b79d58f0b9003267"}
Sep 17 00:33:27.827518 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.827177    2565 scope.go:117] "RemoveContainer" containerID="95856537c2563d922644e48fca879ad5850f2dbee4f0114cda3d7dd7090dc653"
Sep 17 00:33:27.828672 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.828568    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"
Sep 17 00:33:27.828672 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.828602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj" event={"ID":"cd241322-4e3b-49fa-bfa8-a8f5f0771e4c","Type":"ContainerDied","Data":"39776df4b363c7fc400dee4db87045c2a73d9680f687c18d51db9f3766934d4c"}
Sep 17 00:33:27.830291 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.830267    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52" event={"ID":"4e8e67f0-6e87-4bbb-93a7-31a1d4731077","Type":"ContainerDied","Data":"9133d35415e1a490afb6cfb904bd20516536e1983dd30bd31efeb633ff9bd813"}
Sep 17 00:33:27.830472 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.830302    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"
Sep 17 00:33:27.848437 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.848413    2565 scope.go:117] "RemoveContainer" containerID="013ad69eebcc3cfa8f06694464316694c8e7f86329d0665a77e2d8db5b316e8b"
Sep 17 00:33:27.858349 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.858326    2565 scope.go:117] "RemoveContainer" containerID="9ab45704f51e44f970db6009b856ef3a83cd6c902bf13be6ba4dafb0ab70c3e0"
Sep 17 00:33:27.864762 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.864706    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"]
Sep 17 00:33:27.872471 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.872448    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-76944c-b98cdb4bc-5klvd"]
Sep 17 00:33:27.882596 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.882570    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"]
Sep 17 00:33:27.886004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.885985    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-76944c-5f74c6c64c-pqdpj"]
Sep 17 00:33:27.895665 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.895643    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"]
Sep 17 00:33:27.898161 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.898123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:27.901215 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.901192    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-76944c-9547b46bb-h6t52"]
Sep 17 00:33:27.927181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.927155    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e8e67f0-6e87-4bbb-93a7-31a1d4731077" path="/var/lib/kubelet/pods/4e8e67f0-6e87-4bbb-93a7-31a1d4731077/volumes"
Sep 17 00:33:27.927533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.927520    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c873614d-a355-409f-8876-00a4cb561732" path="/var/lib/kubelet/pods/c873614d-a355-409f-8876-00a4cb561732/volumes"
Sep 17 00:33:27.928012 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:27.927990    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd241322-4e3b-49fa-bfa8-a8f5f0771e4c" path="/var/lib/kubelet/pods/cd241322-4e3b-49fa-bfa8-a8f5f0771e4c/volumes"
Sep 17 00:33:28.526168 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:28.526126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:29.285281 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:29.285238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:30.050188 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:30.050153    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:30.299156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:30.299117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:30.736868 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:30.736829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:31.536201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:31.536166    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:32.850710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:32.850673    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:32.908856 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:32.908820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:33.089744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:33.089709    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"]
Sep 17 00:33:33.090056 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:33.090022    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy" containerID="cri-o://9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9" gracePeriod=30
Sep 17 00:33:33.109517 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:33.109422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:33.641104 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:33.641067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:34.406024 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:34.405990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:34.725470 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:34.725386    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:36.054632 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:36.054600    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:36.155270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:36.155239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:36.445672 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:36.445589    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:37.218724 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:37.218686    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:37.644955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:37.644920    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"]
Sep 17 00:33:37.645211 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:37.645182    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6" podUID="7f7f2831-a8a8-4135-a6eb-c714e56694a2" containerName="istio-proxy" containerID="cri-o://c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b" gracePeriod=30
Sep 17 00:33:37.668413 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:37.668383    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:37.875389 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:37.875347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:37.975542 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:37.975450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:38.029561 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.029522    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:38.344528 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.344505    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:33:38.465974 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.465942    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-envoy\") pod \"ff091407-6e7e-4d6b-9c42-721ab670d16f\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") "
Sep 17 00:33:38.466137 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.465992    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-podinfo\") pod \"ff091407-6e7e-4d6b-9c42-721ab670d16f\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") "
Sep 17 00:33:38.466137 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466019    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-token\") pod \"ff091407-6e7e-4d6b-9c42-721ab670d16f\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") "
Sep 17 00:33:38.466137 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466102    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-socket\") pod \"ff091407-6e7e-4d6b-9c42-721ab670d16f\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") "
Sep 17 00:33:38.466137 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466124    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2blr\" (UniqueName: \"kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-kube-api-access-s2blr\") pod \"ff091407-6e7e-4d6b-9c42-721ab670d16f\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") "
Sep 17 00:33:38.466348 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466139    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-data\") pod \"ff091407-6e7e-4d6b-9c42-721ab670d16f\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") "
Sep 17 00:33:38.466348 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466186    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-certs\") pod \"ff091407-6e7e-4d6b-9c42-721ab670d16f\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") "
Sep 17 00:33:38.466348 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466237    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff091407-6e7e-4d6b-9c42-721ab670d16f-istiod-ca-cert\") pod \"ff091407-6e7e-4d6b-9c42-721ab670d16f\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") "
Sep 17 00:33:38.466348 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466297    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-credential-socket\") pod \"ff091407-6e7e-4d6b-9c42-721ab670d16f\" (UID: \"ff091407-6e7e-4d6b-9c42-721ab670d16f\") "
Sep 17 00:33:38.466570 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466427    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-data" (OuterVolumeSpecName: "istio-data") pod "ff091407-6e7e-4d6b-9c42-721ab670d16f" (UID: "ff091407-6e7e-4d6b-9c42-721ab670d16f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:38.466633 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466586    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ff091407-6e7e-4d6b-9c42-721ab670d16f" (UID: "ff091407-6e7e-4d6b-9c42-721ab670d16f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:38.466633 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466608    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ff091407-6e7e-4d6b-9c42-721ab670d16f" (UID: "ff091407-6e7e-4d6b-9c42-721ab670d16f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:38.466742 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466678    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ff091407-6e7e-4d6b-9c42-721ab670d16f" (UID: "ff091407-6e7e-4d6b-9c42-721ab670d16f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:38.466837 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466773    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:38.466837 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466791    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:38.466837 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466830    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:38.467024 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466845    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:38.467024 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.466926    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff091407-6e7e-4d6b-9c42-721ab670d16f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ff091407-6e7e-4d6b-9c42-721ab670d16f" (UID: "ff091407-6e7e-4d6b-9c42-721ab670d16f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:33:38.468545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.468516    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-token" (OuterVolumeSpecName: "istio-token") pod "ff091407-6e7e-4d6b-9c42-721ab670d16f" (UID: "ff091407-6e7e-4d6b-9c42-721ab670d16f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:33:38.468639 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.468548    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-kube-api-access-s2blr" (OuterVolumeSpecName: "kube-api-access-s2blr") pod "ff091407-6e7e-4d6b-9c42-721ab670d16f" (UID: "ff091407-6e7e-4d6b-9c42-721ab670d16f"). InnerVolumeSpecName "kube-api-access-s2blr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:33:38.468725 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.468704    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ff091407-6e7e-4d6b-9c42-721ab670d16f" (UID: "ff091407-6e7e-4d6b-9c42-721ab670d16f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:38.468778 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.468719    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ff091407-6e7e-4d6b-9c42-721ab670d16f" (UID: "ff091407-6e7e-4d6b-9c42-721ab670d16f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:33:38.568338 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.568307    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2blr\" (UniqueName: \"kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-kube-api-access-s2blr\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:38.568338 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.568336    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff091407-6e7e-4d6b-9c42-721ab670d16f-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:38.568537 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.568346    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:38.568537 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.568354    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:38.568537 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.568363    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff091407-6e7e-4d6b-9c42-721ab670d16f-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:38.696342 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.696303    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:38.893964 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.893871    2565 generic.go:356] "Generic (PLEG): container finished" podID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerID="9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9" exitCode=0
Sep 17 00:33:38.893964 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.893923    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"
Sep 17 00:33:38.894167 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.893962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" event={"ID":"ff091407-6e7e-4d6b-9c42-721ab670d16f","Type":"ContainerDied","Data":"9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9"}
Sep 17 00:33:38.894167 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.894017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9" event={"ID":"ff091407-6e7e-4d6b-9c42-721ab670d16f","Type":"ContainerDied","Data":"00fe553c2bd185d59a0f6d78358aa8a84a4474705e5c558dca56510a1de8eab4"}
Sep 17 00:33:38.894167 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.894041    2565 scope.go:117] "RemoveContainer" containerID="9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9"
Sep 17 00:33:38.903776 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.903757    2565 scope.go:117] "RemoveContainer" containerID="21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146"
Sep 17 00:33:38.912639 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.912584    2565 scope.go:117] "RemoveContainer" containerID="9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9"
Sep 17 00:33:38.913254 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:33:38.913223    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9\": container with ID starting with 9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9 not found: ID does not exist" containerID="9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9"
Sep 17 00:33:38.913399 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.913268    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9"} err="failed to get container status \"9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9\": rpc error: code = NotFound desc = could not find container \"9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9\": container with ID starting with 9616651a5d1fdba30247535c4c1911f1f2794a76f9d4fb5fbbd2db68e416ede9 not found: ID does not exist"
Sep 17 00:33:38.913399 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.913295    2565 scope.go:117] "RemoveContainer" containerID="21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146"
Sep 17 00:33:38.913677 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:33:38.913652    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146\": container with ID starting with 21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146 not found: ID does not exist" containerID="21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146"
Sep 17 00:33:38.913727 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.913689    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146"} err="failed to get container status \"21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146\": rpc error: code = NotFound desc = could not find container \"21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146\": container with ID starting with 21af26eba9354a4628e9175f860c7f9b2a0069ce2d705dd06dc9a3adf5136146 not found: ID does not exist"
Sep 17 00:33:38.915480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.915458    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"]
Sep 17 00:33:38.919305 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:38.919283    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-76944c-openshift-default-74b57f9cb8-7nww9"]
Sep 17 00:33:39.927201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:39.927158    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" path="/var/lib/kubelet/pods/ff091407-6e7e-4d6b-9c42-721ab670d16f/volumes"
Sep 17 00:33:42.908031 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:42.907965    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:33:42.918462 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:42.918432    2565 generic.go:356] "Generic (PLEG): container finished" podID="7f7f2831-a8a8-4135-a6eb-c714e56694a2" containerID="c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b" exitCode=0
Sep 17 00:33:42.918591 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:42.918471    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"
Sep 17 00:33:42.918591 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:42.918494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6" event={"ID":"7f7f2831-a8a8-4135-a6eb-c714e56694a2","Type":"ContainerDied","Data":"c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b"}
Sep 17 00:33:42.918591 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:42.918576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6" event={"ID":"7f7f2831-a8a8-4135-a6eb-c714e56694a2","Type":"ContainerDied","Data":"5554cbe6b49a98c83e722d52ee81ae97ef8bd2f4d3853a4b53a276bcb2bee144"}
Sep 17 00:33:42.918694 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:42.918605    2565 scope.go:117] "RemoveContainer" containerID="c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b"
Sep 17 00:33:42.927645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:42.927617    2565 scope.go:117] "RemoveContainer" containerID="c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b"
Sep 17 00:33:42.928136 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:33:42.928050    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b\": container with ID starting with c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b not found: ID does not exist" containerID="c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b"
Sep 17 00:33:42.928136 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:42.928089    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b"} err="failed to get container status \"c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b\": rpc error: code = NotFound desc = could not find container \"c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b\": container with ID starting with c82484a6f264cdcbecb108619499c4a7c5d91f7e95d68fc6d47b918cfba7442b not found: ID does not exist"
Sep 17 00:33:43.003526 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.003489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:43.015395 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015369    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-data\") pod \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") "
Sep 17 00:33:43.015553 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015446    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-podinfo\") pod \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") "
Sep 17 00:33:43.015553 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015493    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istiod-ca-cert\") pod \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") "
Sep 17 00:33:43.015553 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015524    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-socket\") pod \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") "
Sep 17 00:33:43.015719 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015658    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f7f2831-a8a8-4135-a6eb-c714e56694a2" (UID: "7f7f2831-a8a8-4135-a6eb-c714e56694a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:43.015719 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015666    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-credential-socket\") pod \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") "
Sep 17 00:33:43.015928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015774    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f7f2831-a8a8-4135-a6eb-c714e56694a2" (UID: "7f7f2831-a8a8-4135-a6eb-c714e56694a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:43.015928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015789    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv6d8\" (UniqueName: \"kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-kube-api-access-vv6d8\") pod \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") "
Sep 17 00:33:43.015928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015839    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-token\") pod \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") "
Sep 17 00:33:43.015928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015870    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f7f2831-a8a8-4135-a6eb-c714e56694a2" (UID: "7f7f2831-a8a8-4135-a6eb-c714e56694a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:33:43.015928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015918    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-certs\") pod \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") "
Sep 17 00:33:43.016213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015939    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-envoy\") pod \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\" (UID: \"7f7f2831-a8a8-4135-a6eb-c714e56694a2\") "
Sep 17 00:33:43.016213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.015948    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f7f2831-a8a8-4135-a6eb-c714e56694a2" (UID: "7f7f2831-a8a8-4135-a6eb-c714e56694a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:43.016213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.016103    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f7f2831-a8a8-4135-a6eb-c714e56694a2" (UID: "7f7f2831-a8a8-4135-a6eb-c714e56694a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:43.016394 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.016368    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:43.016457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.016394    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:43.016457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.016409    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:43.016457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.016422    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:43.016457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.016435    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:43.017969 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.017934    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-kube-api-access-vv6d8" (OuterVolumeSpecName: "kube-api-access-vv6d8") pod "7f7f2831-a8a8-4135-a6eb-c714e56694a2" (UID: "7f7f2831-a8a8-4135-a6eb-c714e56694a2"). InnerVolumeSpecName "kube-api-access-vv6d8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:33:43.017969 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.017988    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f7f2831-a8a8-4135-a6eb-c714e56694a2" (UID: "7f7f2831-a8a8-4135-a6eb-c714e56694a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:33:43.018207 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.018061    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f7f2831-a8a8-4135-a6eb-c714e56694a2" (UID: "7f7f2831-a8a8-4135-a6eb-c714e56694a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:33:43.018267 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.018243    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f7f2831-a8a8-4135-a6eb-c714e56694a2" (UID: "7f7f2831-a8a8-4135-a6eb-c714e56694a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:43.117250 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.117216    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv6d8\" (UniqueName: \"kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-kube-api-access-vv6d8\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:43.117250 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.117249    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:43.117472 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.117264    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:43.117472 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.117275    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7f2831-a8a8-4135-a6eb-c714e56694a2-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:33:43.244100 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.244042    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"]
Sep 17 00:33:43.247771 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.247688    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-090464-openshift-default-6769ffc478-dv4m6"]
Sep 17 00:33:43.930582 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.930545    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f7f2831-a8a8-4135-a6eb-c714e56694a2" path="/var/lib/kubelet/pods/7f7f2831-a8a8-4135-a6eb-c714e56694a2/volumes"
Sep 17 00:33:43.931309 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.930795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:43.997191 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:43.997155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:44.055606 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:44.055573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:44.124729 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:44.124691    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:44.182574 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:44.182493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:44.523473 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:44.523385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:44.627868 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:44.627829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:45.326362 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:45.326327    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:45.968194 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:45.968157    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:46.602098 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:46.602056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:47.345538 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:47.345502    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:48.086836 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:48.086776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:49.383937 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.383891    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"]
Sep 17 00:33:49.384560 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384537    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e8e67f0-6e87-4bbb-93a7-31a1d4731077" containerName="payload-pre-processing"
Sep 17 00:33:49.384635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384563    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e8e67f0-6e87-4bbb-93a7-31a1d4731077" containerName="payload-pre-processing"
Sep 17 00:33:49.384635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384587    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy"
Sep 17 00:33:49.384635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384596    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy"
Sep 17 00:33:49.384635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384614    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy"
Sep 17 00:33:49.384635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384622    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy"
Sep 17 00:33:49.384635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384635    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c873614d-a355-409f-8876-00a4cb561732" containerName="payload-processing"
Sep 17 00:33:49.384975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384643    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c873614d-a355-409f-8876-00a4cb561732" containerName="payload-processing"
Sep 17 00:33:49.384975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384652    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd241322-4e3b-49fa-bfa8-a8f5f0771e4c" containerName="maas-api"
Sep 17 00:33:49.384975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384659    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd241322-4e3b-49fa-bfa8-a8f5f0771e4c" containerName="maas-api"
Sep 17 00:33:49.384975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384670    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f7f2831-a8a8-4135-a6eb-c714e56694a2" containerName="istio-proxy"
Sep 17 00:33:49.384975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384678    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f7f2831-a8a8-4135-a6eb-c714e56694a2" containerName="istio-proxy"
Sep 17 00:33:49.384975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384816    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f7f2831-a8a8-4135-a6eb-c714e56694a2" containerName="istio-proxy"
Sep 17 00:33:49.384975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384831    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c873614d-a355-409f-8876-00a4cb561732" containerName="payload-processing"
Sep 17 00:33:49.384975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384843    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy"
Sep 17 00:33:49.384975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384852    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff091407-6e7e-4d6b-9c42-721ab670d16f" containerName="istio-proxy"
Sep 17 00:33:49.384975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384861    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e8e67f0-6e87-4bbb-93a7-31a1d4731077" containerName="payload-pre-processing"
Sep 17 00:33:49.384975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.384869    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd241322-4e3b-49fa-bfa8-a8f5f0771e4c" containerName="maas-api"
Sep 17 00:33:49.388246 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.388225    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.394395 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.394368    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-cfe049\"/\"kube-root-ca.crt\""
Sep 17 00:33:49.394512 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.394371    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-cfe049\"/\"distinct-2-w0-cfe049-kserve-self-signed-certs\""
Sep 17 00:33:49.394512 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.394418    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-cfe049\"/\"default-dockercfg-zhhbp\""
Sep 17 00:33:49.394512 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.394475    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-cfe049\"/\"openshift-service-ca.crt\""
Sep 17 00:33:49.400770 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.400749    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"]
Sep 17 00:33:49.422123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.422091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:49.476754 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.476719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-home\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.476907 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.476849    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-model-cache\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.476907 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.476899    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sprs9\" (UniqueName: \"kubernetes.io/projected/acbe6c6b-25de-4f83-97ab-c06709aebefd-kube-api-access-sprs9\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.476995 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.476922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-tmp-dir\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.477034 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.477014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-dshm\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.477069 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.477050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acbe6c6b-25de-4f83-97ab-c06709aebefd-tls-certs\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.582216 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.582165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-home\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.582386 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.582298    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-model-cache\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.582386 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.582333    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sprs9\" (UniqueName: \"kubernetes.io/projected/acbe6c6b-25de-4f83-97ab-c06709aebefd-kube-api-access-sprs9\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.582386 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.582365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-tmp-dir\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.582621 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.582447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-dshm\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.582621 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.582485    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acbe6c6b-25de-4f83-97ab-c06709aebefd-tls-certs\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.583457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.583423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-home\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.583576 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.583535    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-model-cache\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.584343 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.584321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-tmp-dir\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.586366 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.586320    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acbe6c6b-25de-4f83-97ab-c06709aebefd-tls-certs\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.586843 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.586819    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-dshm\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.590728 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.590704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sprs9\" (UniqueName: \"kubernetes.io/projected/acbe6c6b-25de-4f83-97ab-c06709aebefd-kube-api-access-sprs9\") pod \"distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") " pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.597060 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.597020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:49.700135 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.700053    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:49.971753 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:49.971729    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"]
Sep 17 00:33:49.974030 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:33:49.974002    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacbe6c6b_25de_4f83_97ab_c06709aebefd.slice/crio-51cd71157f09ba8d13f7d541ad4cebf8bdf7f1c26c5b6a2e117fc6b97b4dd31b WatchSource:0}: Error finding container 51cd71157f09ba8d13f7d541ad4cebf8bdf7f1c26c5b6a2e117fc6b97b4dd31b: Status 404 returned error can't find the container with id 51cd71157f09ba8d13f7d541ad4cebf8bdf7f1c26c5b6a2e117fc6b97b4dd31b
Sep 17 00:33:50.969156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:50.969108    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w" event={"ID":"acbe6c6b-25de-4f83-97ab-c06709aebefd","Type":"ContainerStarted","Data":"bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25"}
Sep 17 00:33:50.969561 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:50.969167    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w" event={"ID":"acbe6c6b-25de-4f83-97ab-c06709aebefd","Type":"ContainerStarted","Data":"51cd71157f09ba8d13f7d541ad4cebf8bdf7f1c26c5b6a2e117fc6b97b4dd31b"}
Sep 17 00:33:50.984349 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:50.984296    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w" podStartSLOduration=1.984276265 podStartE2EDuration="1.984276265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:33:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:33:50.984078183 +0000 UTC m=+1431.510817660" watchObservedRunningTime="2026-09-17 00:33:50.984276265 +0000 UTC m=+1431.511015746"
Sep 17 00:33:52.193715 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:52.193667    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:55.270525 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:55.270486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:55.534413 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:55.534323    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:56.138563 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.138520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:56.406674 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.406590    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"]
Sep 17 00:33:56.410467 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.410443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.413011 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.412987    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-47a2db-openshift-default-dockercfg-xdjjm\""
Sep 17 00:33:56.419962 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.419937    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"]
Sep 17 00:33:56.431192 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.431157    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:56.553514 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.553480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-data\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.553693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.553519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516de6df-85ce-4073-b663-5d70c941bf22-istiod-ca-cert\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.553693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.553551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-socket\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.553693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.553622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-certs\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.553693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.553670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-kube-api-access-999p9\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.553693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.553692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-credential-socket\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.553951 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.553755    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516de6df-85ce-4073-b663-5d70c941bf22-istio-podinfo\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.553951 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.553773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-istio-token\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.553951 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.553832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-envoy\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.647781 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.647742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:56.655863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.654891    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516de6df-85ce-4073-b663-5d70c941bf22-istio-podinfo\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.655863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.654932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-istio-token\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.655863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.654974    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-envoy\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.655863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.655100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-data\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.655863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.655126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516de6df-85ce-4073-b663-5d70c941bf22-istiod-ca-cert\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.655863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.655152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-socket\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.655863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.655187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-certs\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.655863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.655224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-kube-api-access-999p9\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.655863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.655251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-credential-socket\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.655863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.655684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-credential-socket\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.656554 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.656185    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-certs\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.656554 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.656235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-socket\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.656554 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.656442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-data\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.656736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.656635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516de6df-85ce-4073-b663-5d70c941bf22-istiod-ca-cert\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.658264 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.658245    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516de6df-85ce-4073-b663-5d70c941bf22-istio-podinfo\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.658339 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.658307    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-envoy\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.663834 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.663779    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-kube-api-access-999p9\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.664075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.664057    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-istio-token\") pod \"e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") " pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:56.723787 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:56.723744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:57.002347 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:57.002319    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"]
Sep 17 00:33:57.003979 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:33:57.003950    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516de6df_85ce_4073_b663_5d70c941bf22.slice/crio-1d88a4612d0c9d450a1e3aef87e705bc40a9a6e5ca42eea7930fa3da8d2dd248 WatchSource:0}: Error finding container 1d88a4612d0c9d450a1e3aef87e705bc40a9a6e5ca42eea7930fa3da8d2dd248: Status 404 returned error can't find the container with id 1d88a4612d0c9d450a1e3aef87e705bc40a9a6e5ca42eea7930fa3da8d2dd248
Sep 17 00:33:57.006251 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:57.006217    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:33:57.006348 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:57.006283    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:33:57.006348 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:57.006314    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:33:58.008634 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:58.008597    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" event={"ID":"516de6df-85ce-4073-b663-5d70c941bf22","Type":"ContainerStarted","Data":"bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a"}
Sep 17 00:33:58.009103 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:58.008647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" event={"ID":"516de6df-85ce-4073-b663-5d70c941bf22","Type":"ContainerStarted","Data":"1d88a4612d0c9d450a1e3aef87e705bc40a9a6e5ca42eea7930fa3da8d2dd248"}
Sep 17 00:33:58.029192 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:58.029144    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" podStartSLOduration=2.029127918 podStartE2EDuration="2.029127918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:33:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:33:58.026253397 +0000 UTC m=+1438.552992886" watchObservedRunningTime="2026-09-17 00:33:58.029127918 +0000 UTC m=+1438.555867395"
Sep 17 00:33:58.724364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:58.724323    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:58.735435 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:58.735404    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:59.014849 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:59.014728    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:59.015832 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:59.015782    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:33:59.323023 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:59.322983    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:33:59.700458 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:59.700375    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:59.700596 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:59.700449    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:33:59.713015 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:33:59.712988    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:34:00.031975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:00.031897    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:34:00.118665 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:00.118634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:00.212118 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:00.212085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:01.032512 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:01.032482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:01.857539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:01.857508    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:02.523907 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:02.523867    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:03.315892 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:03.315857    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:03.923322 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:03.923262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:04.025970 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:04.025931    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:04.368447 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:04.368408    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:04.474750 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:04.474718    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:04.542540 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:04.542501    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:19.582178 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:19.582131    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:24.734907 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:24.734854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:25.761690 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:25.761647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:26.417350 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:26.417314    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:27.232309 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:27.232271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:27.863710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:27.863674    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:28.600446 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:28.600407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:29.016780 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:29.016690    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 17 00:34:29.016780 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:29.016752    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 17 00:34:29.179791 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:29.179759    2565 generic.go:356] "Generic (PLEG): container finished" podID="516de6df-85ce-4073-b663-5d70c941bf22" containerID="bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a" exitCode=0
Sep 17 00:34:29.179974 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:29.179836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" event={"ID":"516de6df-85ce-4073-b663-5d70c941bf22","Type":"ContainerDied","Data":"bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a"}
Sep 17 00:34:29.180259 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:29.180244    2565 scope.go:117] "RemoveContainer" containerID="bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a"
Sep 17 00:34:29.181458 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:29.181428    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:34:29.181557 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:29.181496    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:34:29.181557 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:29.181528    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:34:29.402490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:29.402453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:30.041364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:30.041331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:30.140724 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:30.140675    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:30.187562 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:30.187529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" event={"ID":"516de6df-85ce-4073-b663-5d70c941bf22","Type":"ContainerStarted","Data":"2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0"}
Sep 17 00:34:30.524304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:30.524266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:30.724682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:30.724602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:34:30.724946 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:30.724734    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 17 00:34:30.724946 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:30.724780    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 17 00:34:30.851092 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:30.851057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:31.707516 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:31.707473    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:31.724544 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:31.724501    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 17 00:34:31.724746 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:31.724573    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 17 00:34:32.725345 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:32.725292    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 17 00:34:32.725882 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:32.725367    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 17 00:34:33.230870 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:33.230829    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:33.724692 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:33.724643    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 17 00:34:33.724941 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:33.724760    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 17 00:34:34.021660 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:34.021568    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:34.121753 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:34.121717    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:34.725095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:34.725046    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 17 00:34:34.725309 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:34.725120    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 17 00:34:34.930086 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:34.930045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:35.724441 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:35.724404    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 17 00:34:35.725106 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:35.725073    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 17 00:34:35.756292 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:35.756263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:36.405498 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:36.405464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:36.728510 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:36.728430    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:34:36.728887 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:36.728782    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:34:36.729570 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:36.729549    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:34:37.132989 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:37.132961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:37.750320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:37.750284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:38.353145 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.353110    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"]
Sep 17 00:34:38.357754 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.357734    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.360121 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.360096    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-07f9f2-serving-cert\""
Sep 17 00:34:38.368316 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.368087    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"]
Sep 17 00:34:38.383994 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.383953    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:38.415891 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.415852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6dmz\" (UniqueName: \"kubernetes.io/projected/20fcbd75-554c-465e-b7ab-069ae464f10d-kube-api-access-b6dmz\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.415891 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.415896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.416104 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.415977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.416104 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.416038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20fcbd75-554c-465e-b7ab-069ae464f10d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.438140 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.438101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:38.517497 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.517454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20fcbd75-554c-465e-b7ab-069ae464f10d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.517759 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.517565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6dmz\" (UniqueName: \"kubernetes.io/projected/20fcbd75-554c-465e-b7ab-069ae464f10d-kube-api-access-b6dmz\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.517759 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.517596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.517759 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.517648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.517968 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:34:38.517761    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-serving-cert: secret "maas-api-e2e-shared-b-w3-07f9f2-serving-cert" not found
Sep 17 00:34:38.517968 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:34:38.517850    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-maas-api-tls podName:20fcbd75-554c-465e-b7ab-069ae464f10d nodeName:}" failed. No retries permitted until 2026-09-17 00:34:39.01783468 +0000 UTC m=+1479.544574135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-maas-api-tls") pod "maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6" (UID: "20fcbd75-554c-465e-b7ab-069ae464f10d") : secret "maas-api-e2e-shared-b-w3-07f9f2-serving-cert" not found
Sep 17 00:34:38.518271 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.518251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20fcbd75-554c-465e-b7ab-069ae464f10d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.520110 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.520091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.528268 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.528230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6dmz\" (UniqueName: \"kubernetes.io/projected/20fcbd75-554c-465e-b7ab-069ae464f10d-kube-api-access-b6dmz\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:38.584995 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.584961    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:38.930650 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:38.930611    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:39.024020 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.023980    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:39.026324 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.026297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:39.029890 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.029854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:39.036902 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.036877    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"]
Sep 17 00:34:39.040554 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.040535    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:34:39.046794 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.046754    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-07f9f2-dockercfg-jf4sl\""
Sep 17 00:34:39.046983 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.046963    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-07f9f2\""
Sep 17 00:34:39.054061 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.054038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"]
Sep 17 00:34:39.124797 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.124760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bf052ac-9621-4060-a512-5a89023fb9e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q\" (UID: \"1bf052ac-9621-4060-a512-5a89023fb9e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:34:39.125000 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.124905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqnsp\" (UniqueName: \"kubernetes.io/projected/1bf052ac-9621-4060-a512-5a89023fb9e7-kube-api-access-qqnsp\") pod \"payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q\" (UID: \"1bf052ac-9621-4060-a512-5a89023fb9e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:34:39.226354 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.226260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqnsp\" (UniqueName: \"kubernetes.io/projected/1bf052ac-9621-4060-a512-5a89023fb9e7-kube-api-access-qqnsp\") pod \"payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q\" (UID: \"1bf052ac-9621-4060-a512-5a89023fb9e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:34:39.226530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.226387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bf052ac-9621-4060-a512-5a89023fb9e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q\" (UID: \"1bf052ac-9621-4060-a512-5a89023fb9e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:34:39.227093 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.227069    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bf052ac-9621-4060-a512-5a89023fb9e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q\" (UID: \"1bf052ac-9621-4060-a512-5a89023fb9e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:34:39.234027 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.234001    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqnsp\" (UniqueName: \"kubernetes.io/projected/1bf052ac-9621-4060-a512-5a89023fb9e7-kube-api-access-qqnsp\") pod \"payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q\" (UID: \"1bf052ac-9621-4060-a512-5a89023fb9e7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:34:39.272023 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.271990    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:39.351309 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.351278    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:34:39.547604 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.547576    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"]
Sep 17 00:34:39.549094 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:34:39.549065    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20fcbd75_554c_465e_b7ab_069ae464f10d.slice/crio-0846f2065cf14f0ed26bd59da2ad91712cddb30ec7405daad2726f88192d8fc0 WatchSource:0}: Error finding container 0846f2065cf14f0ed26bd59da2ad91712cddb30ec7405daad2726f88192d8fc0: Status 404 returned error can't find the container with id 0846f2065cf14f0ed26bd59da2ad91712cddb30ec7405daad2726f88192d8fc0
Sep 17 00:34:39.550650 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.550629    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:34:39.627598 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:39.627575    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"]
Sep 17 00:34:39.629504 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:34:39.629472    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf052ac_9621_4060_a512_5a89023fb9e7.slice/crio-0c29970244991c7e6480b1a142f2e7c18a2d49031295e9f38467854c4e9698c5 WatchSource:0}: Error finding container 0c29970244991c7e6480b1a142f2e7c18a2d49031295e9f38467854c4e9698c5: Status 404 returned error can't find the container with id 0c29970244991c7e6480b1a142f2e7c18a2d49031295e9f38467854c4e9698c5
Sep 17 00:34:40.256152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:40.256043    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q" event={"ID":"1bf052ac-9621-4060-a512-5a89023fb9e7","Type":"ContainerStarted","Data":"0a0bb86bcd915f6c885d1fc9beefcbc3ecabd7ea0915c8de17c4b96352da662b"}
Sep 17 00:34:40.256152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:40.256113    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:34:40.256152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:40.256136    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q" event={"ID":"1bf052ac-9621-4060-a512-5a89023fb9e7","Type":"ContainerStarted","Data":"0c29970244991c7e6480b1a142f2e7c18a2d49031295e9f38467854c4e9698c5"}
Sep 17 00:34:40.257513 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:40.257483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6" event={"ID":"20fcbd75-554c-465e-b7ab-069ae464f10d","Type":"ContainerStarted","Data":"145e46eb0f40e227c0146c324845aa964b4e90f1feeaa784b8af527419f86fef"}
Sep 17 00:34:40.257632 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:40.257538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6" event={"ID":"20fcbd75-554c-465e-b7ab-069ae464f10d","Type":"ContainerStarted","Data":"0846f2065cf14f0ed26bd59da2ad91712cddb30ec7405daad2726f88192d8fc0"}
Sep 17 00:34:40.257632 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:40.257568    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:40.274539 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:40.274489    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q" podStartSLOduration=1.2744696979999999 podStartE2EDuration="1.274469698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:40.271614344 +0000 UTC m=+1480.798353833" watchObservedRunningTime="2026-09-17 00:34:40.274469698 +0000 UTC m=+1480.801209177"
Sep 17 00:34:40.289047 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:40.288996    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6" podStartSLOduration=1.918733882 podStartE2EDuration="2.288978201s" totalImagesPullingTime="370.244319ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:40.286886976 +0000 UTC m=+1480.813626466" watchObservedRunningTime="2026-09-17 00:34:40.288978201 +0000 UTC m=+1480.815717680"
Sep 17 00:34:46.270302 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:46.270272    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:34:51.266299 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:51.266260    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:34:53.934018 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:53.933975    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:34:57.693773 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:57.693734    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"]
Sep 17 00:34:57.710797 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:34:57.710764    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:01.326996 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:01.326959    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:02.124059 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:02.124028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:02.755437 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:02.755398    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:03.522511 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:03.522469    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:04.038518 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:04.038479    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:04.139223 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:04.139182    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:04.242553 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:04.242519    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:04.871391 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:04.871345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:05.536635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:05.536599    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:05.724949 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:05.724917    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:35:05.734172 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:05.734146    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:35:06.212647 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:06.212606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:12.713962 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:12.713898    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf" podUID="23a6b5f8-387e-49bd-bd23-02124e82f2e4" containerName="main" containerID="cri-o://71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea" gracePeriod=45
Sep 17 00:35:12.971447 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:12.971390    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:35:13.080031 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.079997    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-dshm\") pod \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") "
Sep 17 00:35:13.080212 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.080038    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fh4wh\" (UniqueName: \"kubernetes.io/projected/23a6b5f8-387e-49bd-bd23-02124e82f2e4-kube-api-access-fh4wh\") pod \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") "
Sep 17 00:35:13.080212 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.080115    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tmp-dir\") pod \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") "
Sep 17 00:35:13.080212 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.080161    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-home\") pod \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") "
Sep 17 00:35:13.080212 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.080206    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-model-cache\") pod \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") "
Sep 17 00:35:13.080459 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.080258    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tls-certs\") pod \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\" (UID: \"23a6b5f8-387e-49bd-bd23-02124e82f2e4\") "
Sep 17 00:35:13.080518 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.080450    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "23a6b5f8-387e-49bd-bd23-02124e82f2e4" (UID: "23a6b5f8-387e-49bd-bd23-02124e82f2e4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:35:13.080518 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.080473    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-home" (OuterVolumeSpecName: "home") pod "23a6b5f8-387e-49bd-bd23-02124e82f2e4" (UID: "23a6b5f8-387e-49bd-bd23-02124e82f2e4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:35:13.080621 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.080531    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-model-cache" (OuterVolumeSpecName: "model-cache") pod "23a6b5f8-387e-49bd-bd23-02124e82f2e4" (UID: "23a6b5f8-387e-49bd-bd23-02124e82f2e4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:35:13.080710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.080689    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-home\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:35:13.080774 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.080714    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-model-cache\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:35:13.080774 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.080728    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tmp-dir\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:35:13.082398 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.082363    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-dshm" (OuterVolumeSpecName: "dshm") pod "23a6b5f8-387e-49bd-bd23-02124e82f2e4" (UID: "23a6b5f8-387e-49bd-bd23-02124e82f2e4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:35:13.082398 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.082389    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "23a6b5f8-387e-49bd-bd23-02124e82f2e4" (UID: "23a6b5f8-387e-49bd-bd23-02124e82f2e4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:35:13.082584 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.082438    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a6b5f8-387e-49bd-bd23-02124e82f2e4-kube-api-access-fh4wh" (OuterVolumeSpecName: "kube-api-access-fh4wh") pod "23a6b5f8-387e-49bd-bd23-02124e82f2e4" (UID: "23a6b5f8-387e-49bd-bd23-02124e82f2e4"). InnerVolumeSpecName "kube-api-access-fh4wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:35:13.181513 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.181479    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23a6b5f8-387e-49bd-bd23-02124e82f2e4-dshm\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:35:13.181513 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.181507    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fh4wh\" (UniqueName: \"kubernetes.io/projected/23a6b5f8-387e-49bd-bd23-02124e82f2e4-kube-api-access-fh4wh\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:35:13.181513 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.181518    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23a6b5f8-387e-49bd-bd23-02124e82f2e4-tls-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:35:13.445651 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.445619    2565 generic.go:356] "Generic (PLEG): container finished" podID="23a6b5f8-387e-49bd-bd23-02124e82f2e4" containerID="71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea" exitCode=0
Sep 17 00:35:13.445853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.445666    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"
Sep 17 00:35:13.445853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.445712    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf" event={"ID":"23a6b5f8-387e-49bd-bd23-02124e82f2e4","Type":"ContainerDied","Data":"71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea"}
Sep 17 00:35:13.445853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.445757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf" event={"ID":"23a6b5f8-387e-49bd-bd23-02124e82f2e4","Type":"ContainerDied","Data":"9b914a17e14bacd1643398a15ad0b254cca22ae3381afe920da696d252f90299"}
Sep 17 00:35:13.445853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.445780    2565 scope.go:117] "RemoveContainer" containerID="71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea"
Sep 17 00:35:13.455626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.455607    2565 scope.go:117] "RemoveContainer" containerID="71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea"
Sep 17 00:35:13.455930 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:35:13.455912    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea\": container with ID starting with 71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea not found: ID does not exist" containerID="71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea"
Sep 17 00:35:13.455988 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.455940    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea"} err="failed to get container status \"71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea\": rpc error: code = NotFound desc = could not find container \"71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea\": container with ID starting with 71b344cce1550cb98e541735cc159431e794f3f2e346115577fe1ba848ea57ea not found: ID does not exist"
Sep 17 00:35:13.466682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.466661    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"]
Sep 17 00:35:13.472444 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.472425    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/e2e-conflict-a-fe1bd81e-kserve-85c5db8c45-hkmjf"]
Sep 17 00:35:13.927441 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:13.927409    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a6b5f8-387e-49bd-bd23-02124e82f2e4" path="/var/lib/kubelet/pods/23a6b5f8-387e-49bd-bd23-02124e82f2e4/volumes"
Sep 17 00:35:14.895558 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:14.895519    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:15.987581 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:15.987541    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"]
Sep 17 00:35:15.988332 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:15.988304    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23a6b5f8-387e-49bd-bd23-02124e82f2e4" containerName="main"
Sep 17 00:35:15.988332 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:15.988330    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a6b5f8-387e-49bd-bd23-02124e82f2e4" containerName="main"
Sep 17 00:35:15.988552 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:15.988473    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="23a6b5f8-387e-49bd-bd23-02124e82f2e4" containerName="main"
Sep 17 00:35:15.993468 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:15.993447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:15.995919 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:15.995899    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-47a2db\"/\"openshift-service-ca.crt\""
Sep 17 00:35:15.997182 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:15.997150    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-47a2db\"/\"kube-root-ca.crt\""
Sep 17 00:35:15.997352 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:15.997327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-47a2db\"/\"default-dockercfg-6lfqt\""
Sep 17 00:35:15.997480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:15.997273    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-47a2db\"/\"auth-test-model-47a2db-kserve-self-signed-certs\""
Sep 17 00:35:16.000278 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.000255    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"]
Sep 17 00:35:16.115605 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.115557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djhtd\" (UniqueName: \"kubernetes.io/projected/3971a2a6-b425-43b5-87a2-76599f5d371b-kube-api-access-djhtd\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.116002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.115627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-home\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.116002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.115736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-model-cache\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.116002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.115766    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-dshm\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.116002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.115860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-tmp-dir\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.116002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.115924    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3971a2a6-b425-43b5-87a2-76599f5d371b-tls-certs\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.217438 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.217398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3971a2a6-b425-43b5-87a2-76599f5d371b-tls-certs\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.217647 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.217524    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djhtd\" (UniqueName: \"kubernetes.io/projected/3971a2a6-b425-43b5-87a2-76599f5d371b-kube-api-access-djhtd\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.217647 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.217589    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-home\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.217784 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.217692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-model-cache\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.217784 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.217722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-dshm\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.217784 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.217774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-tmp-dir\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.218157 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.218127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-home\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.218157 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.218142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-model-cache\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.218364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.218208    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-tmp-dir\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.220685 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.220659    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-dshm\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.220927 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.220910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3971a2a6-b425-43b5-87a2-76599f5d371b-tls-certs\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.227674 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.227654    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djhtd\" (UniqueName: \"kubernetes.io/projected/3971a2a6-b425-43b5-87a2-76599f5d371b-kube-api-access-djhtd\") pod \"auth-test-model-47a2db-kserve-685b9bf855-sd4rs\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.304092 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.304070    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:16.306607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.306566    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:16.415291 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.415262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:16.577326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:16.577296    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"]
Sep 17 00:35:16.578943 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:35:16.578919    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3971a2a6_b425_43b5_87a2_76599f5d371b.slice/crio-b70bfe81a05072b8c8426356a9a303066236250daf032499f47a3e175ef018bd WatchSource:0}: Error finding container b70bfe81a05072b8c8426356a9a303066236250daf032499f47a3e175ef018bd: Status 404 returned error can't find the container with id b70bfe81a05072b8c8426356a9a303066236250daf032499f47a3e175ef018bd
Sep 17 00:35:17.218325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:17.218280    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:17.472390 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:17.472302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs" event={"ID":"3971a2a6-b425-43b5-87a2-76599f5d371b","Type":"ContainerStarted","Data":"38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c"}
Sep 17 00:35:17.472390 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:17.472346    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs" event={"ID":"3971a2a6-b425-43b5-87a2-76599f5d371b","Type":"ContainerStarted","Data":"b70bfe81a05072b8c8426356a9a303066236250daf032499f47a3e175ef018bd"}
Sep 17 00:35:17.491629 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:17.491575    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs" podStartSLOduration=2.491560144 podStartE2EDuration="2.491560144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:35:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:35:17.48905336 +0000 UTC m=+1518.015792874" watchObservedRunningTime="2026-09-17 00:35:17.491560144 +0000 UTC m=+1518.018299619"
Sep 17 00:35:18.027299 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:18.027263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:18.654152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:18.654121    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:19.428579 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:19.428547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:20.040318 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:20.040284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:20.690906 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:20.690863    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:26.304870 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:26.304834    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:26.305285 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:26.304883    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:26.317870 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:26.317840    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:26.533534 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:26.533502    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:35:27.622518 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:27.622477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:27.725619 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:27.725586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:30.052110 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.052054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:30.082937 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.082907    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"]
Sep 17 00:35:30.083138 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.083111    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5" podUID="0dc81474-899a-4f42-81ad-ce7b8785dc70" containerName="payload-processing" containerID="cri-o://1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70" gracePeriod=30
Sep 17 00:35:30.094722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.094686    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"]
Sep 17 00:35:30.095021 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.094970    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg" podUID="883b0498-0a18-4f4b-89e4-3b7185b2e54e" containerName="payload-pre-processing" containerID="cri-o://109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5" gracePeriod=30
Sep 17 00:35:30.122578 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.122546    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:30.184601 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.184571    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:30.285079 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.285003    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:30.377440 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.377412    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:35:30.402478 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.402447    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:30.446178 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.446148    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:35:30.475434 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.475408    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xk2f\" (UniqueName: \"kubernetes.io/projected/0dc81474-899a-4f42-81ad-ce7b8785dc70-kube-api-access-8xk2f\") pod \"0dc81474-899a-4f42-81ad-ce7b8785dc70\" (UID: \"0dc81474-899a-4f42-81ad-ce7b8785dc70\") "
Sep 17 00:35:30.475592 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.475502    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc81474-899a-4f42-81ad-ce7b8785dc70-plugins-config-volume\") pod \"0dc81474-899a-4f42-81ad-ce7b8785dc70\" (UID: \"0dc81474-899a-4f42-81ad-ce7b8785dc70\") "
Sep 17 00:35:30.475874 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.475848    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dc81474-899a-4f42-81ad-ce7b8785dc70-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0dc81474-899a-4f42-81ad-ce7b8785dc70" (UID: "0dc81474-899a-4f42-81ad-ce7b8785dc70"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:35:30.477549 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.477523    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dc81474-899a-4f42-81ad-ce7b8785dc70-kube-api-access-8xk2f" (OuterVolumeSpecName: "kube-api-access-8xk2f") pod "0dc81474-899a-4f42-81ad-ce7b8785dc70" (UID: "0dc81474-899a-4f42-81ad-ce7b8785dc70"). InnerVolumeSpecName "kube-api-access-8xk2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:35:30.544131 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.544101    2565 generic.go:356] "Generic (PLEG): container finished" podID="0dc81474-899a-4f42-81ad-ce7b8785dc70" containerID="1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70" exitCode=0
Sep 17 00:35:30.544231 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.544141    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"
Sep 17 00:35:30.544231 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.544172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5" event={"ID":"0dc81474-899a-4f42-81ad-ce7b8785dc70","Type":"ContainerDied","Data":"1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70"}
Sep 17 00:35:30.544231 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.544223    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5" event={"ID":"0dc81474-899a-4f42-81ad-ce7b8785dc70","Type":"ContainerDied","Data":"816fa17bc3cb7f2e967935e5b55edc5194d8fd51c9119d58a3f98da40e6fee3b"}
Sep 17 00:35:30.544413 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.544255    2565 scope.go:117] "RemoveContainer" containerID="1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70"
Sep 17 00:35:30.545636 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.545608    2565 generic.go:356] "Generic (PLEG): container finished" podID="883b0498-0a18-4f4b-89e4-3b7185b2e54e" containerID="109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5" exitCode=0
Sep 17 00:35:30.545738 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.545638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg" event={"ID":"883b0498-0a18-4f4b-89e4-3b7185b2e54e","Type":"ContainerDied","Data":"109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5"}
Sep 17 00:35:30.545738 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.545657    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"
Sep 17 00:35:30.545738 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.545693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg" event={"ID":"883b0498-0a18-4f4b-89e4-3b7185b2e54e","Type":"ContainerDied","Data":"956efd045ee61362d69451a471c33ee92839a9b198e5cb0f982a66d3dc9763e9"}
Sep 17 00:35:30.554898 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.554883    2565 scope.go:117] "RemoveContainer" containerID="1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70"
Sep 17 00:35:30.555147 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:35:30.555129    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70\": container with ID starting with 1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70 not found: ID does not exist" containerID="1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70"
Sep 17 00:35:30.555206 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.555154    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70"} err="failed to get container status \"1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70\": rpc error: code = NotFound desc = could not find container \"1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70\": container with ID starting with 1a032268d25806367b209f03a269f16a6d35c2d17b2f237c25af32dc41d4fd70 not found: ID does not exist"
Sep 17 00:35:30.555206 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.555170    2565 scope.go:117] "RemoveContainer" containerID="109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5"
Sep 17 00:35:30.563193 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.563176    2565 scope.go:117] "RemoveContainer" containerID="109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5"
Sep 17 00:35:30.563446 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:35:30.563428    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5\": container with ID starting with 109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5 not found: ID does not exist" containerID="109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5"
Sep 17 00:35:30.563497 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.563452    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5"} err="failed to get container status \"109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5\": rpc error: code = NotFound desc = could not find container \"109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5\": container with ID starting with 109fc2bb571ad884cc018dd6ab2fe018e5c1db2cd7fd57345e958cd2ed8f0de5 not found: ID does not exist"
Sep 17 00:35:30.567254 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.567231    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"]
Sep 17 00:35:30.570424 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.570398    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-c5ae0fdd-65dbc65fb9-jdvp5"]
Sep 17 00:35:30.577071 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.577051    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/883b0498-0a18-4f4b-89e4-3b7185b2e54e-plugins-config-volume\") pod \"883b0498-0a18-4f4b-89e4-3b7185b2e54e\" (UID: \"883b0498-0a18-4f4b-89e4-3b7185b2e54e\") "
Sep 17 00:35:30.577187 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.577097    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bxz7\" (UniqueName: \"kubernetes.io/projected/883b0498-0a18-4f4b-89e4-3b7185b2e54e-kube-api-access-6bxz7\") pod \"883b0498-0a18-4f4b-89e4-3b7185b2e54e\" (UID: \"883b0498-0a18-4f4b-89e4-3b7185b2e54e\") "
Sep 17 00:35:30.577382 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.577368    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc81474-899a-4f42-81ad-ce7b8785dc70-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:35:30.577455 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.577382    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xk2f\" (UniqueName: \"kubernetes.io/projected/0dc81474-899a-4f42-81ad-ce7b8785dc70-kube-api-access-8xk2f\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:35:30.577455 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.577415    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/883b0498-0a18-4f4b-89e4-3b7185b2e54e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "883b0498-0a18-4f4b-89e4-3b7185b2e54e" (UID: "883b0498-0a18-4f4b-89e4-3b7185b2e54e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:35:30.579016 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.578997    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/883b0498-0a18-4f4b-89e4-3b7185b2e54e-kube-api-access-6bxz7" (OuterVolumeSpecName: "kube-api-access-6bxz7") pod "883b0498-0a18-4f4b-89e4-3b7185b2e54e" (UID: "883b0498-0a18-4f4b-89e4-3b7185b2e54e"). InnerVolumeSpecName "kube-api-access-6bxz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:35:30.635182 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.635149    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:30.677999 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.677970    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/883b0498-0a18-4f4b-89e4-3b7185b2e54e-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:35:30.677999 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.677993    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bxz7\" (UniqueName: \"kubernetes.io/projected/883b0498-0a18-4f4b-89e4-3b7185b2e54e-kube-api-access-6bxz7\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:35:30.866861 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.866834    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"]
Sep 17 00:35:30.870006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:30.869982    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-c5ae0fdd-8447464ccd-5wklg"]
Sep 17 00:35:31.426744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:31.426702    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:31.927104 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:31.927070    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dc81474-899a-4f42-81ad-ce7b8785dc70" path="/var/lib/kubelet/pods/0dc81474-899a-4f42-81ad-ce7b8785dc70/volumes"
Sep 17 00:35:31.927495 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:31.927481    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="883b0498-0a18-4f4b-89e4-3b7185b2e54e" path="/var/lib/kubelet/pods/883b0498-0a18-4f4b-89e4-3b7185b2e54e/volumes"
Sep 17 00:35:32.070928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:32.070884    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:32.719509 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:32.719461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:33.526850 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:33.526782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:33.626032 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:33.625972    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:34.165253 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:34.165200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:34.919689 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:34.919645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:35:38.580347 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:35:38.580311    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:10.717024 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:10.716983    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:15.239621 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:15.239570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:15.732788 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:15.732755    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:15.957738 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:15.957708    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:21.386252 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:21.386211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:26.324731 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:26.324688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:35.527249 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:35.527207    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:36.104426 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:36.104385    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:36.164381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:36.164336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:36.373717 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:36.373614    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"]
Sep 17 00:36:36.374233 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:36.374180    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy" containerID="cri-o://e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d" gracePeriod=30
Sep 17 00:36:36.388119 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:36.388080    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:37.698348 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:37.698302    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:37.797181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:37.797145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:37.897501 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:37.897463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:38.570238 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:38.570169    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:38.665498 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:38.665461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:38.774835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:38.774769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:40.137608 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:40.137563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:41.647583 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.647512    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:36:41.776502 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.776464    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-data\") pod \"444817f3-3be0-4320-8dd0-6f8980b63f25\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") "
Sep 17 00:36:41.776696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.776548    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-credential-socket\") pod \"444817f3-3be0-4320-8dd0-6f8980b63f25\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") "
Sep 17 00:36:41.776696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.776572    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-certs\") pod \"444817f3-3be0-4320-8dd0-6f8980b63f25\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") "
Sep 17 00:36:41.776696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.776601    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/444817f3-3be0-4320-8dd0-6f8980b63f25-istiod-ca-cert\") pod \"444817f3-3be0-4320-8dd0-6f8980b63f25\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") "
Sep 17 00:36:41.776696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.776628    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-token\") pod \"444817f3-3be0-4320-8dd0-6f8980b63f25\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") "
Sep 17 00:36:41.776696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.776663    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-podinfo\") pod \"444817f3-3be0-4320-8dd0-6f8980b63f25\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") "
Sep 17 00:36:41.776696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.776683    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-envoy\") pod \"444817f3-3be0-4320-8dd0-6f8980b63f25\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") "
Sep 17 00:36:41.777049 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.776730    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-socket\") pod \"444817f3-3be0-4320-8dd0-6f8980b63f25\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") "
Sep 17 00:36:41.777049 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.776841    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-data" (OuterVolumeSpecName: "istio-data") pod "444817f3-3be0-4320-8dd0-6f8980b63f25" (UID: "444817f3-3be0-4320-8dd0-6f8980b63f25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:36:41.777049 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.776860    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "444817f3-3be0-4320-8dd0-6f8980b63f25" (UID: "444817f3-3be0-4320-8dd0-6f8980b63f25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:36:41.777049 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.776875    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz2v8\" (UniqueName: \"kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-kube-api-access-nz2v8\") pod \"444817f3-3be0-4320-8dd0-6f8980b63f25\" (UID: \"444817f3-3be0-4320-8dd0-6f8980b63f25\") "
Sep 17 00:36:41.777250 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.777079    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "444817f3-3be0-4320-8dd0-6f8980b63f25" (UID: "444817f3-3be0-4320-8dd0-6f8980b63f25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:36:41.777250 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.777203    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "444817f3-3be0-4320-8dd0-6f8980b63f25" (UID: "444817f3-3be0-4320-8dd0-6f8980b63f25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:36:41.777347 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.777317    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/444817f3-3be0-4320-8dd0-6f8980b63f25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "444817f3-3be0-4320-8dd0-6f8980b63f25" (UID: "444817f3-3be0-4320-8dd0-6f8980b63f25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:36:41.777405 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.777348    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:36:41.777405 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.777372    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:36:41.777405 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.777387    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:36:41.777405 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.777401    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:36:41.779230 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.779203    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-kube-api-access-nz2v8" (OuterVolumeSpecName: "kube-api-access-nz2v8") pod "444817f3-3be0-4320-8dd0-6f8980b63f25" (UID: "444817f3-3be0-4320-8dd0-6f8980b63f25"). InnerVolumeSpecName "kube-api-access-nz2v8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:36:41.779230 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.779214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-token" (OuterVolumeSpecName: "istio-token") pod "444817f3-3be0-4320-8dd0-6f8980b63f25" (UID: "444817f3-3be0-4320-8dd0-6f8980b63f25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:36:41.779387 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.779356    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "444817f3-3be0-4320-8dd0-6f8980b63f25" (UID: "444817f3-3be0-4320-8dd0-6f8980b63f25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:36:41.779489 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.779473    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "444817f3-3be0-4320-8dd0-6f8980b63f25" (UID: "444817f3-3be0-4320-8dd0-6f8980b63f25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:36:41.878341 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.878297    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/444817f3-3be0-4320-8dd0-6f8980b63f25-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:36:41.878341 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.878332    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:36:41.878341 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.878340    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:36:41.878341 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.878348    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/444817f3-3be0-4320-8dd0-6f8980b63f25-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:36:41.878627 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.878359    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz2v8\" (UniqueName: \"kubernetes.io/projected/444817f3-3be0-4320-8dd0-6f8980b63f25-kube-api-access-nz2v8\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:36:41.949722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.949686    2565 generic.go:356] "Generic (PLEG): container finished" podID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerID="e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d" exitCode=0
Sep 17 00:36:41.949917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.949740    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"
Sep 17 00:36:41.949917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.949771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" event={"ID":"444817f3-3be0-4320-8dd0-6f8980b63f25","Type":"ContainerDied","Data":"e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d"}
Sep 17 00:36:41.949917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.949837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5" event={"ID":"444817f3-3be0-4320-8dd0-6f8980b63f25","Type":"ContainerDied","Data":"d6bc39197806e3cfe510f0c8143d4eef517f55475f0b5e475495c8918f06f669"}
Sep 17 00:36:41.949917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.949859    2565 scope.go:117] "RemoveContainer" containerID="e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d"
Sep 17 00:36:41.959894 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.959872    2565 scope.go:117] "RemoveContainer" containerID="ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f"
Sep 17 00:36:41.967590 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.967558    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"]
Sep 17 00:36:41.970191 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.970168    2565 scope.go:117] "RemoveContainer" containerID="e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d"
Sep 17 00:36:41.970270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.970250    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c5ae0fdd-openshift-default-67545b9b56-5bzs5"]
Sep 17 00:36:41.970525 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:36:41.970504    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d\": container with ID starting with e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d not found: ID does not exist" containerID="e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d"
Sep 17 00:36:41.970580 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.970535    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d"} err="failed to get container status \"e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d\": rpc error: code = NotFound desc = could not find container \"e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d\": container with ID starting with e57b1a580575467c34b200688e450c17e601fec316e0a0b634e74a345916cf9d not found: ID does not exist"
Sep 17 00:36:41.970580 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.970556    2565 scope.go:117] "RemoveContainer" containerID="ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f"
Sep 17 00:36:41.970861 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:36:41.970841    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f\": container with ID starting with ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f not found: ID does not exist" containerID="ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f"
Sep 17 00:36:41.970917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:41.970874    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f"} err="failed to get container status \"ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f\": rpc error: code = NotFound desc = could not find container \"ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f\": container with ID starting with ba9fa836827144bae04756c52e163ab5da733a4a593f6705c6dedc2b8b099d6f not found: ID does not exist"
Sep 17 00:36:43.932315 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:43.932279    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" path="/var/lib/kubelet/pods/444817f3-3be0-4320-8dd0-6f8980b63f25/volumes"
Sep 17 00:36:45.995183 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:45.995147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:46.096243 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:46.096196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:46.702115 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:46.702075    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:51.464695 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:51.464657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:52.353530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:52.353431    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:52.458904 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:52.458856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:52.553676 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:52.553636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:57.700135 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700093    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"]
Sep 17 00:36:57.700758 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700741    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy"
Sep 17 00:36:57.700819 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700762    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy"
Sep 17 00:36:57.700819 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700778    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883b0498-0a18-4f4b-89e4-3b7185b2e54e" containerName="payload-pre-processing"
Sep 17 00:36:57.700819 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700788    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="883b0498-0a18-4f4b-89e4-3b7185b2e54e" containerName="payload-pre-processing"
Sep 17 00:36:57.700932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700821    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy"
Sep 17 00:36:57.700932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700831    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy"
Sep 17 00:36:57.700932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700845    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dc81474-899a-4f42-81ad-ce7b8785dc70" containerName="payload-processing"
Sep 17 00:36:57.700932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700854    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dc81474-899a-4f42-81ad-ce7b8785dc70" containerName="payload-processing"
Sep 17 00:36:57.701054 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700966    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy"
Sep 17 00:36:57.701054 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700978    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="444817f3-3be0-4320-8dd0-6f8980b63f25" containerName="istio-proxy"
Sep 17 00:36:57.701054 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.700992    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="883b0498-0a18-4f4b-89e4-3b7185b2e54e" containerName="payload-pre-processing"
Sep 17 00:36:57.701054 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.701003    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dc81474-899a-4f42-81ad-ce7b8785dc70" containerName="payload-processing"
Sep 17 00:36:57.706202 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.706174    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.709949 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.709302    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-cfe049\"/\"embedding-w0-cfe049-kserve-self-signed-certs\""
Sep 17 00:36:57.724333 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.723220    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"]
Sep 17 00:36:57.728141 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.728091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:36:57.745666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.745602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tmp-dir\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.745666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.745658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-model-cache\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.745956 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.745707    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-dshm\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.745956 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.745782    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tls-certs\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.745956 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.745827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtrhf\" (UniqueName: \"kubernetes.io/projected/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-kube-api-access-vtrhf\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.745956 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.745921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-home\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.846480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.846435    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-home\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.846678 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.846517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tmp-dir\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.846678 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.846543    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-model-cache\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.846678 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.846581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-dshm\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.846678 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.846627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tls-certs\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.846678 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.846649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtrhf\" (UniqueName: \"kubernetes.io/projected/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-kube-api-access-vtrhf\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.846917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.846844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-home\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.846955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.846937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-model-cache\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.846996 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.846951    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tmp-dir\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.849013 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.848979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-dshm\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.849199 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.849180    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tls-certs\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:57.857342 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:57.857314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtrhf\" (UniqueName: \"kubernetes.io/projected/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-kube-api-access-vtrhf\") pod \"embedding-w0-cfe049-kserve-5b7bf74869-pwv58\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") " pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:58.026108 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:58.026007    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:36:58.305179 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:58.305151    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"]
Sep 17 00:36:58.307309 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:36:58.307283    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57c1d6ba_05dd_44fb_8f17_5ed3fdfa0f7d.slice/crio-f6600890ebe859fb50501a5e5ed3c9f58b08b6920a01c620fe06364d97e0dc0d WatchSource:0}: Error finding container f6600890ebe859fb50501a5e5ed3c9f58b08b6920a01c620fe06364d97e0dc0d: Status 404 returned error can't find the container with id f6600890ebe859fb50501a5e5ed3c9f58b08b6920a01c620fe06364d97e0dc0d
Sep 17 00:36:59.048666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:59.048630    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58" event={"ID":"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d","Type":"ContainerStarted","Data":"d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619"}
Sep 17 00:36:59.049089 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:59.048682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58" event={"ID":"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d","Type":"ContainerStarted","Data":"f6600890ebe859fb50501a5e5ed3c9f58b08b6920a01c620fe06364d97e0dc0d"}
Sep 17 00:36:59.063986 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:36:59.063935    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58" podStartSLOduration=2.063918855 podStartE2EDuration="2.063918855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:36:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:36:59.062765403 +0000 UTC m=+1619.589504881" watchObservedRunningTime="2026-09-17 00:36:59.063918855 +0000 UTC m=+1619.590658333"
Sep 17 00:37:03.045235 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:03.045193    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:03.301312 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:03.301214    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:08.026868 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:08.026822    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:37:08.027377 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:08.026886    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:37:08.039465 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:08.039430    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:37:08.112662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:08.112602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:37:24.246567 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:24.246524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:25.420566 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:25.420526    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:30.065298 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.065260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:30.121784 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.121746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:30.408345 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.408255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:30.708082 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.707980    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"]
Sep 17 00:37:30.711987 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.711958    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.714348 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.714324    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-0f806c-openshift-default-dockercfg-6tgnw\""
Sep 17 00:37:30.723959 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.723931    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"]
Sep 17 00:37:30.736476 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.736450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:30.776094 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.776063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-podinfo\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.776267 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.776119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xtcj\" (UniqueName: \"kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-kube-api-access-9xtcj\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.776267 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.776145    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-socket\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.776267 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.776171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-token\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.776267 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.776190    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-envoy\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.776267 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.776236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-credential-socket\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.776509 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.776282    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-data\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.776509 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.776312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-certs\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.776509 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.776338    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f10b29a-1abb-449e-b669-a901309d8fd5-istiod-ca-cert\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877059 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877019    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xtcj\" (UniqueName: \"kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-kube-api-access-9xtcj\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877059 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-socket\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-token\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-envoy\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-credential-socket\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-data\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877278    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-certs\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f10b29a-1abb-449e-b669-a901309d8fd5-istiod-ca-cert\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877637 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877393    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-podinfo\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877637 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-socket\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877631    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-credential-socket\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.877905 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877856    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-data\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.878033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.877911    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-certs\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.878195 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.878172    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f10b29a-1abb-449e-b669-a901309d8fd5-istiod-ca-cert\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.879748 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.879721    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-envoy\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.879988 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.879971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-podinfo\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.885213 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.885194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-token\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:30.885621 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:30.885600    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xtcj\" (UniqueName: \"kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-kube-api-access-9xtcj\") pod \"e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") " pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:31.025723 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:31.025638    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:31.058405 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:31.058365    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:31.304493 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:31.304458    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"]
Sep 17 00:37:31.305961 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:37:31.305935    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f10b29a_1abb_449e_b669_a901309d8fd5.slice/crio-70698c4300e652024882559f736ea312b43912f90065b1ee861bb3a2b5ed929e WatchSource:0}: Error finding container 70698c4300e652024882559f736ea312b43912f90065b1ee861bb3a2b5ed929e: Status 404 returned error can't find the container with id 70698c4300e652024882559f736ea312b43912f90065b1ee861bb3a2b5ed929e
Sep 17 00:37:31.310316 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:31.308903    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:37:31.310316 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:31.309060    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:37:31.310316 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:31.309149    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:37:32.228589 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:32.228553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" event={"ID":"5f10b29a-1abb-449e-b669-a901309d8fd5","Type":"ContainerStarted","Data":"6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8"}
Sep 17 00:37:32.228815 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:32.228610    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" event={"ID":"5f10b29a-1abb-449e-b669-a901309d8fd5","Type":"ContainerStarted","Data":"70698c4300e652024882559f736ea312b43912f90065b1ee861bb3a2b5ed929e"}
Sep 17 00:37:32.247426 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:32.247362    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" podStartSLOduration=2.247341653 podStartE2EDuration="2.247341653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:37:32.246090369 +0000 UTC m=+1652.772829868" watchObservedRunningTime="2026-09-17 00:37:32.247341653 +0000 UTC m=+1652.774081133"
Sep 17 00:37:33.026817 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:33.026772    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:33.031974 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:33.031944    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:33.234853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:33.234821    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:33.235712 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:33.235692    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:37:33.501386 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:33.501355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:34.130125 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:34.130091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:34.230653 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:34.230616    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:34.330837 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:34.330776    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:34.966664 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:34.966626    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:35.732670 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:35.732630    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:36.409786 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:36.409756    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:37.209281 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:37.209249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:37.844901 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:37.844864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:38.606559 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.606524    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"]
Sep 17 00:37:38.614595 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.614556    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.620600 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.620572    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-0f806c-serving-cert\""
Sep 17 00:37:38.630924 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.630895    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"]
Sep 17 00:37:38.635494 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.635453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:38.660888 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.660853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-maas-api-tls\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.661023 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.660894    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-metrics-certs\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.661023 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.660925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkdck\" (UniqueName: \"kubernetes.io/projected/21f71371-82ca-408d-b485-81f3aea76dd9-kube-api-access-xkdck\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.661109 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.661067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f71371-82ca-408d-b485-81f3aea76dd9-openshift-service-ca\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.737178 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.737129    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:38.761983 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.761946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f71371-82ca-408d-b485-81f3aea76dd9-openshift-service-ca\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.762180 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.762059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-maas-api-tls\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.762180 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.762083    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-metrics-certs\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.762180 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.762112    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkdck\" (UniqueName: \"kubernetes.io/projected/21f71371-82ca-408d-b485-81f3aea76dd9-kube-api-access-xkdck\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.762688 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.762661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f71371-82ca-408d-b485-81f3aea76dd9-openshift-service-ca\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.764627 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.764603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-maas-api-tls\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.764743 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.764649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-metrics-certs\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.769883 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.769861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkdck\" (UniqueName: \"kubernetes.io/projected/21f71371-82ca-408d-b485-81f3aea76dd9-kube-api-access-xkdck\") pod \"maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:38.836533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.836492    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:38.935538 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:38.935457    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:39.088626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.088589    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:39.182963 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.182928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:39.207304 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.207277    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"]
Sep 17 00:37:39.209257 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:37:39.209226    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f71371_82ca_408d_b485_81f3aea76dd9.slice/crio-8c433660f832c6da67529ab2f75502fb13f1ca44052a8cb5e9ccdb3195bca8e8 WatchSource:0}: Error finding container 8c433660f832c6da67529ab2f75502fb13f1ca44052a8cb5e9ccdb3195bca8e8: Status 404 returned error can't find the container with id 8c433660f832c6da67529ab2f75502fb13f1ca44052a8cb5e9ccdb3195bca8e8
Sep 17 00:37:39.251148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.251111    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"]
Sep 17 00:37:39.256189 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.256165    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:37:39.258701 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.258673    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-0f806c\""
Sep 17 00:37:39.259019 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.259001    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-0f806c-dockercfg-d48fv\""
Sep 17 00:37:39.264601 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.264575    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"]
Sep 17 00:37:39.272101 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.272072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k" event={"ID":"21f71371-82ca-408d-b485-81f3aea76dd9","Type":"ContainerStarted","Data":"8c433660f832c6da67529ab2f75502fb13f1ca44052a8cb5e9ccdb3195bca8e8"}
Sep 17 00:37:39.370228 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.370189    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5jtt\" (UniqueName: \"kubernetes.io/projected/1a949037-bb39-40f8-ae87-81504793ba44-kube-api-access-p5jtt\") pod \"payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv\" (UID: \"1a949037-bb39-40f8-ae87-81504793ba44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:37:39.370406 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.370341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a949037-bb39-40f8-ae87-81504793ba44-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv\" (UID: \"1a949037-bb39-40f8-ae87-81504793ba44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:37:39.471334 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.471246    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5jtt\" (UniqueName: \"kubernetes.io/projected/1a949037-bb39-40f8-ae87-81504793ba44-kube-api-access-p5jtt\") pod \"payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv\" (UID: \"1a949037-bb39-40f8-ae87-81504793ba44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:37:39.471497 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.471420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a949037-bb39-40f8-ae87-81504793ba44-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv\" (UID: \"1a949037-bb39-40f8-ae87-81504793ba44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:37:39.472128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.472102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a949037-bb39-40f8-ae87-81504793ba44-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv\" (UID: \"1a949037-bb39-40f8-ae87-81504793ba44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:37:39.478617 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.478598    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5jtt\" (UniqueName: \"kubernetes.io/projected/1a949037-bb39-40f8-ae87-81504793ba44-kube-api-access-p5jtt\") pod \"payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv\" (UID: \"1a949037-bb39-40f8-ae87-81504793ba44\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:37:39.571598 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.571573    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:37:39.840907 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:39.840883    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"]
Sep 17 00:37:39.841771 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:37:39.841745    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a949037_bb39_40f8_ae87_81504793ba44.slice/crio-b22bd3df0a4dea1830df69237ed6fc0dc9f0c03fc474d5878931a33a473efb85 WatchSource:0}: Error finding container b22bd3df0a4dea1830df69237ed6fc0dc9f0c03fc474d5878931a33a473efb85: Status 404 returned error can't find the container with id b22bd3df0a4dea1830df69237ed6fc0dc9f0c03fc474d5878931a33a473efb85
Sep 17 00:37:40.279111 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:40.279021    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k" event={"ID":"21f71371-82ca-408d-b485-81f3aea76dd9","Type":"ContainerStarted","Data":"720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7"}
Sep 17 00:37:40.279111 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:40.279089    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:40.280706 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:40.280682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv" event={"ID":"1a949037-bb39-40f8-ae87-81504793ba44","Type":"ContainerStarted","Data":"8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d"}
Sep 17 00:37:40.280862 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:40.280727    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:37:40.280862 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:40.280745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv" event={"ID":"1a949037-bb39-40f8-ae87-81504793ba44","Type":"ContainerStarted","Data":"b22bd3df0a4dea1830df69237ed6fc0dc9f0c03fc474d5878931a33a473efb85"}
Sep 17 00:37:40.294425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:40.294373    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k" podStartSLOduration=1.8639671020000002 podStartE2EDuration="2.294355999s" totalImagesPullingTime="430.388897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:37:40.293430957 +0000 UTC m=+1660.820170436" watchObservedRunningTime="2026-09-17 00:37:40.294355999 +0000 UTC m=+1660.821095478"
Sep 17 00:37:40.309958 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:40.309912    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv" podStartSLOduration=1.309894582 podStartE2EDuration="1.309894582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:37:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:37:40.307200086 +0000 UTC m=+1660.833939580" watchObservedRunningTime="2026-09-17 00:37:40.309894582 +0000 UTC m=+1660.836634063"
Sep 17 00:37:46.291521 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:46.291486    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:37:48.465716 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:48.465671    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:37:51.288746 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:51.288710    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:37:59.588424 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:37:59.588384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:00.926741 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:00.926692    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:01.561087 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:01.561050    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:02.330266 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:02.330229    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:02.960850 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:02.960783    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:03.705317 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:03.705279    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:04.275992 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:04.275939    2565 patch_prober.go:28] interesting pod/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 00:38:04.276188 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:04.276021    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 00:38:04.409763 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:04.409713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:04.521990 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:04.521956    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:04.830979 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:04.830943    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:05.154485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:05.154390    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:05.433777 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:05.433678    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:05.534237 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:05.534201    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:06.053696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:06.053670    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:06.154067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:06.154041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:06.433733 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:06.433654    2565 generic.go:356] "Generic (PLEG): container finished" podID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerID="6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8" exitCode=0
Sep 17 00:38:06.433912 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:06.433727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" event={"ID":"5f10b29a-1abb-449e-b669-a901309d8fd5","Type":"ContainerDied","Data":"6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8"}
Sep 17 00:38:06.434260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:06.434238    2565 scope.go:117] "RemoveContainer" containerID="6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8"
Sep 17 00:38:06.435526 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:06.435498    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:38:06.435583 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:06.435570    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:38:06.435622 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:06.435597    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:38:07.441281 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:07.441241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" event={"ID":"5f10b29a-1abb-449e-b669-a901309d8fd5","Type":"ContainerStarted","Data":"e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522"}
Sep 17 00:38:07.535122 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:07.535092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:08.025902 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:08.025873    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:38:08.026088 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:08.026048    2565 patch_prober.go:28] interesting pod/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 17 00:38:08.026164 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:08.026094    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 17 00:38:08.203732 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:08.203703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:08.305106 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:08.305064    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:08.364634 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:08.364578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:08.441555 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:08.441517    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:09.027075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:09.027037    2565 patch_prober.go:28] interesting pod/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 17 00:38:09.027287 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:09.027093    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 17 00:38:09.428864 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:09.428828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:10.026833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:10.026779    2565 patch_prober.go:28] interesting pod/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 17 00:38:10.027323 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:10.026869    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 17 00:38:10.164273 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:10.164246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:11.026559 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:11.026523    2565 patch_prober.go:28] interesting pod/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 17 00:38:11.026731 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:11.026578    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 17 00:38:11.111422 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:11.111389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:11.861491 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:11.861448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:12.026542 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:12.026503    2565 patch_prober.go:28] interesting pod/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 17 00:38:12.026706 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:12.026586    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 17 00:38:12.829291 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:12.829255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:13.026511 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:13.026474    2565 patch_prober.go:28] interesting pod/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 17 00:38:13.026672 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:13.026547    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 17 00:38:13.555339 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:13.555299    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:14.030221 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.030144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:38:14.030571 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.030381    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:38:14.031195 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.031177    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:38:14.335269 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.335227    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:14.388561 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.388531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:14.627233 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.627138    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:14.789759 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.789726    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:14.884202 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.884120    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:14.884500 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.884482    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"]
Sep 17 00:38:14.889403 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.889384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:38:14.891999 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.891980    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-1b3aae\""
Sep 17 00:38:14.892171 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.892153    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-1b3aae-dockercfg-z247j\""
Sep 17 00:38:14.896843 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.896821    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"]
Sep 17 00:38:14.932796 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.932773    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"]
Sep 17 00:38:14.934626 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.934602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4866fc25-dc2e-45f5-83ba-4d6532396dcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8\" (UID: \"4866fc25-dc2e-45f5-83ba-4d6532396dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:38:14.934721 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.934675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxs9n\" (UniqueName: \"kubernetes.io/projected/4866fc25-dc2e-45f5-83ba-4d6532396dcd-kube-api-access-nxs9n\") pod \"payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8\" (UID: \"4866fc25-dc2e-45f5-83ba-4d6532396dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:38:14.936303 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.936288    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:38:14.947280 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:14.947258    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"]
Sep 17 00:38:15.038058 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.036882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7517378b-609b-42cf-8a34-b1e42d3771da-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1b3aae-759899696c-kphpv\" (UID: \"7517378b-609b-42cf-8a34-b1e42d3771da\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:38:15.038058 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.036995    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8f5c\" (UniqueName: \"kubernetes.io/projected/7517378b-609b-42cf-8a34-b1e42d3771da-kube-api-access-x8f5c\") pod \"payload-processing-e2e-api-b-1b3aae-759899696c-kphpv\" (UID: \"7517378b-609b-42cf-8a34-b1e42d3771da\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:38:15.038058 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.037149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4866fc25-dc2e-45f5-83ba-4d6532396dcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8\" (UID: \"4866fc25-dc2e-45f5-83ba-4d6532396dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:38:15.038058 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.037250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxs9n\" (UniqueName: \"kubernetes.io/projected/4866fc25-dc2e-45f5-83ba-4d6532396dcd-kube-api-access-nxs9n\") pod \"payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8\" (UID: \"4866fc25-dc2e-45f5-83ba-4d6532396dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:38:15.042011 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.040852    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4866fc25-dc2e-45f5-83ba-4d6532396dcd-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8\" (UID: \"4866fc25-dc2e-45f5-83ba-4d6532396dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:38:15.046599 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.046575    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxs9n\" (UniqueName: \"kubernetes.io/projected/4866fc25-dc2e-45f5-83ba-4d6532396dcd-kube-api-access-nxs9n\") pod \"payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8\" (UID: \"4866fc25-dc2e-45f5-83ba-4d6532396dcd\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:38:15.138201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.138143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7517378b-609b-42cf-8a34-b1e42d3771da-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1b3aae-759899696c-kphpv\" (UID: \"7517378b-609b-42cf-8a34-b1e42d3771da\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:38:15.138201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.138191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8f5c\" (UniqueName: \"kubernetes.io/projected/7517378b-609b-42cf-8a34-b1e42d3771da-kube-api-access-x8f5c\") pod \"payload-processing-e2e-api-b-1b3aae-759899696c-kphpv\" (UID: \"7517378b-609b-42cf-8a34-b1e42d3771da\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:38:15.138785 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.138766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7517378b-609b-42cf-8a34-b1e42d3771da-plugins-config-volume\") pod \"payload-processing-e2e-api-b-1b3aae-759899696c-kphpv\" (UID: \"7517378b-609b-42cf-8a34-b1e42d3771da\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:38:15.146170 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.146147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8f5c\" (UniqueName: \"kubernetes.io/projected/7517378b-609b-42cf-8a34-b1e42d3771da-kube-api-access-x8f5c\") pod \"payload-processing-e2e-api-b-1b3aae-759899696c-kphpv\" (UID: \"7517378b-609b-42cf-8a34-b1e42d3771da\") " pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:38:15.201564 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.201541    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:38:15.247640 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.247607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:38:15.472523 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.472494    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"]
Sep 17 00:38:15.473363 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:38:15.473333    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4866fc25_dc2e_45f5_83ba_4d6532396dcd.slice/crio-71d5db6e9a9d76897bd87ca75a34a39cd176a01a7208d199d55cf4fe4d488911 WatchSource:0}: Error finding container 71d5db6e9a9d76897bd87ca75a34a39cd176a01a7208d199d55cf4fe4d488911: Status 404 returned error can't find the container with id 71d5db6e9a9d76897bd87ca75a34a39cd176a01a7208d199d55cf4fe4d488911
Sep 17 00:38:15.493139 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.493057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8" event={"ID":"4866fc25-dc2e-45f5-83ba-4d6532396dcd","Type":"ContainerStarted","Data":"71d5db6e9a9d76897bd87ca75a34a39cd176a01a7208d199d55cf4fe4d488911"}
Sep 17 00:38:15.529470 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:15.529449    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"]
Sep 17 00:38:15.534706 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:38:15.534684    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7517378b_609b_42cf_8a34_b1e42d3771da.slice/crio-025c2f4acccdccda46e85d32ac56db667ee25bd3199aab47cbb26a83e1885a91 WatchSource:0}: Error finding container 025c2f4acccdccda46e85d32ac56db667ee25bd3199aab47cbb26a83e1885a91: Status 404 returned error can't find the container with id 025c2f4acccdccda46e85d32ac56db667ee25bd3199aab47cbb26a83e1885a91
Sep 17 00:38:16.501651 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:16.501546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8" event={"ID":"4866fc25-dc2e-45f5-83ba-4d6532396dcd","Type":"ContainerStarted","Data":"eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801"}
Sep 17 00:38:16.501651 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:16.501613    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:38:16.503690 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:16.503657    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv" event={"ID":"7517378b-609b-42cf-8a34-b1e42d3771da","Type":"ContainerStarted","Data":"ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03"}
Sep 17 00:38:16.503861 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:16.503713    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:38:16.503861 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:16.503735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv" event={"ID":"7517378b-609b-42cf-8a34-b1e42d3771da","Type":"ContainerStarted","Data":"025c2f4acccdccda46e85d32ac56db667ee25bd3199aab47cbb26a83e1885a91"}
Sep 17 00:38:16.518846 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:16.518783    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8" podStartSLOduration=2.518765861 podStartE2EDuration="2.518765861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:38:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:38:16.517660464 +0000 UTC m=+1697.044399941" watchObservedRunningTime="2026-09-17 00:38:16.518765861 +0000 UTC m=+1697.045505339"
Sep 17 00:38:16.534166 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:16.534119    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv" podStartSLOduration=2.534101944 podStartE2EDuration="2.534101944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:38:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:38:16.533380162 +0000 UTC m=+1697.060119669" watchObservedRunningTime="2026-09-17 00:38:16.534101944 +0000 UTC m=+1697.060841421"
Sep 17 00:38:18.329457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:18.329404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:18.384942 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:18.384917    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:27.510863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:27.510830    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:38:27.511286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:27.511264    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:38:27.679846 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:27.679791    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:27.732596 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:27.732564    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:36.131137 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:36.131098    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:36.813567 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:36.813532    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:37.454726 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:37.454685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:38.112532 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:38.112497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:38.339755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:38.339720    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:38.924303 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:38.924267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:39.675341 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:39.675307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:40.312479 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:40.312435    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:41.124707 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:41.124666    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:41.955898 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:41.955865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:42.855839 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:42.855772    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:43.627787 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:43.627750    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:44.424201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:44.424168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:45.268923 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:45.268883    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:45.958872 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:45.958837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:46.768158 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:46.768122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:47.528720 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:47.528676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:48.440600 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:48.440567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:51.419796 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:51.419752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:53.024059 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:53.024001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:56.996614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:56.996578    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"]
Sep 17 00:38:56.997112 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:56.996844    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k" podUID="21f71371-82ca-408d-b485-81f3aea76dd9" containerName="maas-api" containerID="cri-o://720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7" gracePeriod=30
Sep 17 00:38:57.025507 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.025474    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:57.060721 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.060687    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"]
Sep 17 00:38:57.060990 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.060952    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv" podUID="1a949037-bb39-40f8-ae87-81504793ba44" containerName="payload-pre-processing" containerID="cri-o://8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d" gracePeriod=30
Sep 17 00:38:57.094770 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.094734    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:57.150925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.150886    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:57.241967 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.241909    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:57.297774 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.297732    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:57.335152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.334821    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:38:57.379890 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.374563    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkdck\" (UniqueName: \"kubernetes.io/projected/21f71371-82ca-408d-b485-81f3aea76dd9-kube-api-access-xkdck\") pod \"21f71371-82ca-408d-b485-81f3aea76dd9\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") "
Sep 17 00:38:57.379890 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.374658    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-metrics-certs\") pod \"21f71371-82ca-408d-b485-81f3aea76dd9\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") "
Sep 17 00:38:57.379890 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.374863    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-maas-api-tls\") pod \"21f71371-82ca-408d-b485-81f3aea76dd9\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") "
Sep 17 00:38:57.379890 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.374919    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f71371-82ca-408d-b485-81f3aea76dd9-openshift-service-ca\") pod \"21f71371-82ca-408d-b485-81f3aea76dd9\" (UID: \"21f71371-82ca-408d-b485-81f3aea76dd9\") "
Sep 17 00:38:57.379890 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.375876    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f71371-82ca-408d-b485-81f3aea76dd9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21f71371-82ca-408d-b485-81f3aea76dd9" (UID: "21f71371-82ca-408d-b485-81f3aea76dd9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:38:57.388237 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.388156    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f71371-82ca-408d-b485-81f3aea76dd9-kube-api-access-xkdck" (OuterVolumeSpecName: "kube-api-access-xkdck") pod "21f71371-82ca-408d-b485-81f3aea76dd9" (UID: "21f71371-82ca-408d-b485-81f3aea76dd9"). InnerVolumeSpecName "kube-api-access-xkdck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:38:57.388785 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.388748    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "21f71371-82ca-408d-b485-81f3aea76dd9" (UID: "21f71371-82ca-408d-b485-81f3aea76dd9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:38:57.390151 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.390080    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21f71371-82ca-408d-b485-81f3aea76dd9" (UID: "21f71371-82ca-408d-b485-81f3aea76dd9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:38:57.395590 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.395564    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:38:57.476454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.476416    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a949037-bb39-40f8-ae87-81504793ba44-plugins-config-volume\") pod \"1a949037-bb39-40f8-ae87-81504793ba44\" (UID: \"1a949037-bb39-40f8-ae87-81504793ba44\") "
Sep 17 00:38:57.476647 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.476517    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5jtt\" (UniqueName: \"kubernetes.io/projected/1a949037-bb39-40f8-ae87-81504793ba44-kube-api-access-p5jtt\") pod \"1a949037-bb39-40f8-ae87-81504793ba44\" (UID: \"1a949037-bb39-40f8-ae87-81504793ba44\") "
Sep 17 00:38:57.476819 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.476781    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a949037-bb39-40f8-ae87-81504793ba44-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1a949037-bb39-40f8-ae87-81504793ba44" (UID: "1a949037-bb39-40f8-ae87-81504793ba44"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:38:57.476972 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.476956    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-maas-api-tls\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:38:57.477017 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.476978    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21f71371-82ca-408d-b485-81f3aea76dd9-openshift-service-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:38:57.477017 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.476994    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a949037-bb39-40f8-ae87-81504793ba44-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:38:57.477017 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.477009    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkdck\" (UniqueName: \"kubernetes.io/projected/21f71371-82ca-408d-b485-81f3aea76dd9-kube-api-access-xkdck\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:38:57.477131 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.477023    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/21f71371-82ca-408d-b485-81f3aea76dd9-metrics-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:38:57.478651 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.478630    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a949037-bb39-40f8-ae87-81504793ba44-kube-api-access-p5jtt" (OuterVolumeSpecName: "kube-api-access-p5jtt") pod "1a949037-bb39-40f8-ae87-81504793ba44" (UID: "1a949037-bb39-40f8-ae87-81504793ba44"). InnerVolumeSpecName "kube-api-access-p5jtt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:38:57.577645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.577610    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5jtt\" (UniqueName: \"kubernetes.io/projected/1a949037-bb39-40f8-ae87-81504793ba44-kube-api-access-p5jtt\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:38:57.583248 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.583219    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:57.739530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.739496    2565 generic.go:356] "Generic (PLEG): container finished" podID="21f71371-82ca-408d-b485-81f3aea76dd9" containerID="720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7" exitCode=0
Sep 17 00:38:57.739736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.739559    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"
Sep 17 00:38:57.739736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.739572    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k" event={"ID":"21f71371-82ca-408d-b485-81f3aea76dd9","Type":"ContainerDied","Data":"720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7"}
Sep 17 00:38:57.739736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.739659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k" event={"ID":"21f71371-82ca-408d-b485-81f3aea76dd9","Type":"ContainerDied","Data":"8c433660f832c6da67529ab2f75502fb13f1ca44052a8cb5e9ccdb3195bca8e8"}
Sep 17 00:38:57.739736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.739690    2565 scope.go:117] "RemoveContainer" containerID="720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7"
Sep 17 00:38:57.741128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.741105    2565 generic.go:356] "Generic (PLEG): container finished" podID="1a949037-bb39-40f8-ae87-81504793ba44" containerID="8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d" exitCode=0
Sep 17 00:38:57.741228 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.741165    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"
Sep 17 00:38:57.741228 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.741189    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv" event={"ID":"1a949037-bb39-40f8-ae87-81504793ba44","Type":"ContainerDied","Data":"8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d"}
Sep 17 00:38:57.741375 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.741241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv" event={"ID":"1a949037-bb39-40f8-ae87-81504793ba44","Type":"ContainerDied","Data":"b22bd3df0a4dea1830df69237ed6fc0dc9f0c03fc474d5878931a33a473efb85"}
Sep 17 00:38:57.749298 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.749270    2565 scope.go:117] "RemoveContainer" containerID="720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7"
Sep 17 00:38:57.749601 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:38:57.749577    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7\": container with ID starting with 720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7 not found: ID does not exist" containerID="720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7"
Sep 17 00:38:57.749685 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.749610    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7"} err="failed to get container status \"720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7\": rpc error: code = NotFound desc = could not find container \"720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7\": container with ID starting with 720d51958f96b5925cebd12897cac69a942917b0e088c51a09e364b7e7b031d7 not found: ID does not exist"
Sep 17 00:38:57.749685 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.749634    2565 scope.go:117] "RemoveContainer" containerID="8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d"
Sep 17 00:38:57.758959 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.758944    2565 scope.go:117] "RemoveContainer" containerID="8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d"
Sep 17 00:38:57.759240 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:38:57.759210    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d\": container with ID starting with 8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d not found: ID does not exist" containerID="8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d"
Sep 17 00:38:57.759326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.759248    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d"} err="failed to get container status \"8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d\": rpc error: code = NotFound desc = could not find container \"8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d\": container with ID starting with 8fa0541ae899fbd28b30289f5eae3c00fa6898794dcdfb21f4a813698418919d not found: ID does not exist"
Sep 17 00:38:57.759386 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.759368    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:57.765451 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.765430    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"]
Sep 17 00:38:57.769443 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.769419    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0f806c-fc78c48cd-lspbv"]
Sep 17 00:38:57.778487 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.778455    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"]
Sep 17 00:38:57.782452 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.782433    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0f806c-c5dc76d4-b9h2k"]
Sep 17 00:38:57.928927 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.928842    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a949037-bb39-40f8-ae87-81504793ba44" path="/var/lib/kubelet/pods/1a949037-bb39-40f8-ae87-81504793ba44/volumes"
Sep 17 00:38:57.929251 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:57.929235    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f71371-82ca-408d-b485-81f3aea76dd9" path="/var/lib/kubelet/pods/21f71371-82ca-408d-b485-81f3aea76dd9/volumes"
Sep 17 00:38:58.573516 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:58.573482    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:38:59.299430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:38:59.299392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:00.116226 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:00.116195    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:00.765670 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:00.765629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:01.439765 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:01.439725    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:01.873278 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:01.873243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:02.300193 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:02.300155    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:03.065687 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:03.065648    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:03.548895 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:03.548862    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:03.639388 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:03.639339    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:03.796420 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:03.796388    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"]
Sep 17 00:39:03.796654 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:03.796624    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy" containerID="cri-o://e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522" gracePeriod=30
Sep 17 00:39:03.822612 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:03.822548    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:03.879417 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:03.879389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:04.661535 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:04.661498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:05.501948 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:05.501913    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:06.238242 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:06.238209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:06.858592 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:06.858560    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"]
Sep 17 00:39:06.872949 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:06.872923    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"]
Sep 17 00:39:06.936601 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:06.936565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:07.031211 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:07.031162    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:07.709408 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:07.709373    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:08.372079 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:08.372040    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:09.053537 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.053517    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:39:09.173271 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.173181    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:09.196148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196123    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-token\") pod \"5f10b29a-1abb-449e-b669-a901309d8fd5\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") "
Sep 17 00:39:09.196259 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xtcj\" (UniqueName: \"kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-kube-api-access-9xtcj\") pod \"5f10b29a-1abb-449e-b669-a901309d8fd5\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") "
Sep 17 00:39:09.196259 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196195    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-data\") pod \"5f10b29a-1abb-449e-b669-a901309d8fd5\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") "
Sep 17 00:39:09.196336 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196306    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-certs\") pod \"5f10b29a-1abb-449e-b669-a901309d8fd5\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") "
Sep 17 00:39:09.196372 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196359    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-podinfo\") pod \"5f10b29a-1abb-449e-b669-a901309d8fd5\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") "
Sep 17 00:39:09.196416 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196407    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-credential-socket\") pod \"5f10b29a-1abb-449e-b669-a901309d8fd5\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") "
Sep 17 00:39:09.196488 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196466    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f10b29a-1abb-449e-b669-a901309d8fd5" (UID: "5f10b29a-1abb-449e-b669-a901309d8fd5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:09.196549 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196484    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-envoy\") pod \"5f10b29a-1abb-449e-b669-a901309d8fd5\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") "
Sep 17 00:39:09.196549 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196515    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-socket\") pod \"5f10b29a-1abb-449e-b669-a901309d8fd5\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") "
Sep 17 00:39:09.196649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196556    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f10b29a-1abb-449e-b669-a901309d8fd5" (UID: "5f10b29a-1abb-449e-b669-a901309d8fd5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:09.196649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196572    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f10b29a-1abb-449e-b669-a901309d8fd5-istiod-ca-cert\") pod \"5f10b29a-1abb-449e-b669-a901309d8fd5\" (UID: \"5f10b29a-1abb-449e-b669-a901309d8fd5\") "
Sep 17 00:39:09.196755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196698    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f10b29a-1abb-449e-b669-a901309d8fd5" (UID: "5f10b29a-1abb-449e-b669-a901309d8fd5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:09.196983 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196960    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f10b29a-1abb-449e-b669-a901309d8fd5" (UID: "5f10b29a-1abb-449e-b669-a901309d8fd5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:09.197123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.197022    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f10b29a-1abb-449e-b669-a901309d8fd5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f10b29a-1abb-449e-b669-a901309d8fd5" (UID: "5f10b29a-1abb-449e-b669-a901309d8fd5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:09.197123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.196978    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:09.197299 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.197139    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:09.197299 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.197156    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:09.198651 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.198616    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f10b29a-1abb-449e-b669-a901309d8fd5" (UID: "5f10b29a-1abb-449e-b669-a901309d8fd5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:39:09.198651 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.198629    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f10b29a-1abb-449e-b669-a901309d8fd5" (UID: "5f10b29a-1abb-449e-b669-a901309d8fd5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:09.198854 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.198821    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f10b29a-1abb-449e-b669-a901309d8fd5" (UID: "5f10b29a-1abb-449e-b669-a901309d8fd5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:09.198960 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.198943    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-kube-api-access-9xtcj" (OuterVolumeSpecName: "kube-api-access-9xtcj") pod "5f10b29a-1abb-449e-b669-a901309d8fd5" (UID: "5f10b29a-1abb-449e-b669-a901309d8fd5"). InnerVolumeSpecName "kube-api-access-9xtcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:09.297895 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.297864    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:09.297895 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.297890    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xtcj\" (UniqueName: \"kubernetes.io/projected/5f10b29a-1abb-449e-b669-a901309d8fd5-kube-api-access-9xtcj\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:09.297895 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.297901    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:09.298122 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.297910    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:09.298122 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.297918    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f10b29a-1abb-449e-b669-a901309d8fd5-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:09.298122 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.297926    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f10b29a-1abb-449e-b669-a901309d8fd5-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:09.816247 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.816211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:09.824869 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.824838    2565 generic.go:356] "Generic (PLEG): container finished" podID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerID="e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522" exitCode=0
Sep 17 00:39:09.825048 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.824884    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"
Sep 17 00:39:09.825048 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.824925    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" event={"ID":"5f10b29a-1abb-449e-b669-a901309d8fd5","Type":"ContainerDied","Data":"e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522"}
Sep 17 00:39:09.825048 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.824983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6" event={"ID":"5f10b29a-1abb-449e-b669-a901309d8fd5","Type":"ContainerDied","Data":"70698c4300e652024882559f736ea312b43912f90065b1ee861bb3a2b5ed929e"}
Sep 17 00:39:09.825048 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.825007    2565 scope.go:117] "RemoveContainer" containerID="e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522"
Sep 17 00:39:09.835144 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.835126    2565 scope.go:117] "RemoveContainer" containerID="6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8"
Sep 17 00:39:09.846647 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.846616    2565 scope.go:117] "RemoveContainer" containerID="e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522"
Sep 17 00:39:09.847018 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:39:09.846993    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522\": container with ID starting with e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522 not found: ID does not exist" containerID="e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522"
Sep 17 00:39:09.847116 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.847025    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522"} err="failed to get container status \"e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522\": rpc error: code = NotFound desc = could not find container \"e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522\": container with ID starting with e8e120f161147e620fa139a4ddcab79120b947a80c89b10624cf21e8c42b7522 not found: ID does not exist"
Sep 17 00:39:09.847116 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.847043    2565 scope.go:117] "RemoveContainer" containerID="6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8"
Sep 17 00:39:09.847344 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:39:09.847319    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8\": container with ID starting with 6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8 not found: ID does not exist" containerID="6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8"
Sep 17 00:39:09.847445 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.847349    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8"} err="failed to get container status \"6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8\": rpc error: code = NotFound desc = could not find container \"6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8\": container with ID starting with 6337d7dbdff4bcda8669437688882ecc7d90501a6640e9c00dc729d89cbac8a8 not found: ID does not exist"
Sep 17 00:39:09.848682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.848663    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"]
Sep 17 00:39:09.852427 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.852406    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-0f806c-openshift-default-ffc79cf58-bfbs6"]
Sep 17 00:39:09.927579 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:09.927545    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" path="/var/lib/kubelet/pods/5f10b29a-1abb-449e-b669-a901309d8fd5/volumes"
Sep 17 00:39:14.315339 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:14.315299    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:17.782836 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:17.782766    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"]
Sep 17 00:39:17.783462 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:17.783197    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt" podUID="ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1" containerName="maas-api" containerID="cri-o://aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6" gracePeriod=30
Sep 17 00:39:17.795954 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:17.795924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:17.862605 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:17.862568    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:17.917789 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:17.917756    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:17.987243 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:17.987211    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:18.042172 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.042109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:18.042679 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.042662    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:39:18.087337 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.087231    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-metrics-certs\") pod \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") "
Sep 17 00:39:18.087337 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.087306    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-openshift-service-ca\") pod \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") "
Sep 17 00:39:18.087337 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.087343    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-maas-api-tls\") pod \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") "
Sep 17 00:39:18.087666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.087374    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fqph\" (UniqueName: \"kubernetes.io/projected/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-kube-api-access-7fqph\") pod \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\" (UID: \"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1\") "
Sep 17 00:39:18.088624 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.088191    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1" (UID: "ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:18.094150 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.092790    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1" (UID: "ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:39:18.094150 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.093755    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-kube-api-access-7fqph" (OuterVolumeSpecName: "kube-api-access-7fqph") pod "ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1" (UID: "ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1"). InnerVolumeSpecName "kube-api-access-7fqph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:18.094150 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.093966    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1" (UID: "ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:39:18.145959 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.145921    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:18.184662 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.184408    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"]
Sep 17 00:39:18.185162 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.185129    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv" podUID="7517378b-609b-42cf-8a34-b1e42d3771da" containerName="payload-processing" containerID="cri-o://ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03" gracePeriod=30
Sep 17 00:39:18.190797 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.188506    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"]
Sep 17 00:39:18.190797 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.188736    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8" podUID="4866fc25-dc2e-45f5-83ba-4d6532396dcd" containerName="payload-pre-processing" containerID="cri-o://eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801" gracePeriod=30
Sep 17 00:39:18.190797 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.190256    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-metrics-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.190797 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.190283    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-openshift-service-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.190797 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.190300    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-maas-api-tls\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.190797 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.190313    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fqph\" (UniqueName: \"kubernetes.io/projected/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1-kube-api-access-7fqph\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.222928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.222890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:18.278697 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.278668    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:18.382196 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.382165    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:18.458961 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.458937    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:39:18.466849 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.466830    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:39:18.478085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.478060    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:18.506743 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.506621    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4866fc25-dc2e-45f5-83ba-4d6532396dcd-plugins-config-volume\") pod \"4866fc25-dc2e-45f5-83ba-4d6532396dcd\" (UID: \"4866fc25-dc2e-45f5-83ba-4d6532396dcd\") "
Sep 17 00:39:18.506743 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.506667    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7517378b-609b-42cf-8a34-b1e42d3771da-plugins-config-volume\") pod \"7517378b-609b-42cf-8a34-b1e42d3771da\" (UID: \"7517378b-609b-42cf-8a34-b1e42d3771da\") "
Sep 17 00:39:18.506743 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.506700    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8f5c\" (UniqueName: \"kubernetes.io/projected/7517378b-609b-42cf-8a34-b1e42d3771da-kube-api-access-x8f5c\") pod \"7517378b-609b-42cf-8a34-b1e42d3771da\" (UID: \"7517378b-609b-42cf-8a34-b1e42d3771da\") "
Sep 17 00:39:18.507063 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.506773    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxs9n\" (UniqueName: \"kubernetes.io/projected/4866fc25-dc2e-45f5-83ba-4d6532396dcd-kube-api-access-nxs9n\") pod \"4866fc25-dc2e-45f5-83ba-4d6532396dcd\" (UID: \"4866fc25-dc2e-45f5-83ba-4d6532396dcd\") "
Sep 17 00:39:18.507646 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.507609    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7517378b-609b-42cf-8a34-b1e42d3771da-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7517378b-609b-42cf-8a34-b1e42d3771da" (UID: "7517378b-609b-42cf-8a34-b1e42d3771da"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:18.507775 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.507650    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4866fc25-dc2e-45f5-83ba-4d6532396dcd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4866fc25-dc2e-45f5-83ba-4d6532396dcd" (UID: "4866fc25-dc2e-45f5-83ba-4d6532396dcd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:18.512405 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.512379    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4866fc25-dc2e-45f5-83ba-4d6532396dcd-kube-api-access-nxs9n" (OuterVolumeSpecName: "kube-api-access-nxs9n") pod "4866fc25-dc2e-45f5-83ba-4d6532396dcd" (UID: "4866fc25-dc2e-45f5-83ba-4d6532396dcd"). InnerVolumeSpecName "kube-api-access-nxs9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:18.512722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.512698    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7517378b-609b-42cf-8a34-b1e42d3771da-kube-api-access-x8f5c" (OuterVolumeSpecName: "kube-api-access-x8f5c") pod "7517378b-609b-42cf-8a34-b1e42d3771da" (UID: "7517378b-609b-42cf-8a34-b1e42d3771da"). InnerVolumeSpecName "kube-api-access-x8f5c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:18.538375 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.538338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:18.608382 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.608302    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4866fc25-dc2e-45f5-83ba-4d6532396dcd-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.608818 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.608774    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7517378b-609b-42cf-8a34-b1e42d3771da-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.608972 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.608956    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8f5c\" (UniqueName: \"kubernetes.io/projected/7517378b-609b-42cf-8a34-b1e42d3771da-kube-api-access-x8f5c\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.609075 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.609062    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxs9n\" (UniqueName: \"kubernetes.io/projected/4866fc25-dc2e-45f5-83ba-4d6532396dcd-kube-api-access-nxs9n\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.849350 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.849310    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:18.877501 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.877436    2565 generic.go:356] "Generic (PLEG): container finished" podID="4866fc25-dc2e-45f5-83ba-4d6532396dcd" containerID="eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801" exitCode=0
Sep 17 00:39:18.877501 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.877479    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"
Sep 17 00:39:18.877702 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.877525    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8" event={"ID":"4866fc25-dc2e-45f5-83ba-4d6532396dcd","Type":"ContainerDied","Data":"eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801"}
Sep 17 00:39:18.877702 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.877588    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8" event={"ID":"4866fc25-dc2e-45f5-83ba-4d6532396dcd","Type":"ContainerDied","Data":"71d5db6e9a9d76897bd87ca75a34a39cd176a01a7208d199d55cf4fe4d488911"}
Sep 17 00:39:18.877702 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.877618    2565 scope.go:117] "RemoveContainer" containerID="eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801"
Sep 17 00:39:18.879029 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.879004    2565 generic.go:356] "Generic (PLEG): container finished" podID="7517378b-609b-42cf-8a34-b1e42d3771da" containerID="ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03" exitCode=0
Sep 17 00:39:18.879114 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.879057    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"
Sep 17 00:39:18.879174 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.879110    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv" event={"ID":"7517378b-609b-42cf-8a34-b1e42d3771da","Type":"ContainerDied","Data":"ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03"}
Sep 17 00:39:18.879234 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.879182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv" event={"ID":"7517378b-609b-42cf-8a34-b1e42d3771da","Type":"ContainerDied","Data":"025c2f4acccdccda46e85d32ac56db667ee25bd3199aab47cbb26a83e1885a91"}
Sep 17 00:39:18.880677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.880644    2565 generic.go:356] "Generic (PLEG): container finished" podID="ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1" containerID="aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6" exitCode=0
Sep 17 00:39:18.880792 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.880690    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"
Sep 17 00:39:18.880878 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.880732    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt" event={"ID":"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1","Type":"ContainerDied","Data":"aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6"}
Sep 17 00:39:18.880943 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.880890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt" event={"ID":"ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1","Type":"ContainerDied","Data":"79dd534a94bc486b4c87c30556a4763998a440a1c7ebb1e433b46f8a70028170"}
Sep 17 00:39:18.888946 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.888930    2565 scope.go:117] "RemoveContainer" containerID="eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801"
Sep 17 00:39:18.889200 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:39:18.889180    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801\": container with ID starting with eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801 not found: ID does not exist" containerID="eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801"
Sep 17 00:39:18.889286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.889206    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801"} err="failed to get container status \"eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801\": rpc error: code = NotFound desc = could not find container \"eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801\": container with ID starting with eb47ded056b89e6982fc79a77a2060bb3c468c56d75cde30173f9dd0d0e73801 not found: ID does not exist"
Sep 17 00:39:18.889286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.889232    2565 scope.go:117] "RemoveContainer" containerID="ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03"
Sep 17 00:39:18.897867 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.897843    2565 scope.go:117] "RemoveContainer" containerID="ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03"
Sep 17 00:39:18.898167 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:39:18.898144    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03\": container with ID starting with ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03 not found: ID does not exist" containerID="ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03"
Sep 17 00:39:18.898238 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.898176    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03"} err="failed to get container status \"ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03\": rpc error: code = NotFound desc = could not find container \"ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03\": container with ID starting with ae89571aef0e1d9e02e049739b5192aa7e5d93d6e577e88a1abc6f2d7798fb03 not found: ID does not exist"
Sep 17 00:39:18.898238 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.898199    2565 scope.go:117] "RemoveContainer" containerID="aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6"
Sep 17 00:39:18.904425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.904403    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"]
Sep 17 00:39:18.906749 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.906730    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-1b3aae-67cb9fc86-k7ck8"]
Sep 17 00:39:18.907454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.907436    2565 scope.go:117] "RemoveContainer" containerID="aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6"
Sep 17 00:39:18.907735 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:39:18.907715    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6\": container with ID starting with aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6 not found: ID does not exist" containerID="aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6"
Sep 17 00:39:18.907818 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.907739    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6"} err="failed to get container status \"aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6\": rpc error: code = NotFound desc = could not find container \"aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6\": container with ID starting with aad1e8883e6887033b65eb69a18a12986552546bdfbfdcb7b0e95ffa5096fad6 not found: ID does not exist"
Sep 17 00:39:18.916004 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.915983    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"]
Sep 17 00:39:18.920563 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.920542    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-cfe049-674b8b479d-sctqt"]
Sep 17 00:39:18.930709 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.930685    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"]
Sep 17 00:39:18.932642 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:18.932623    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-1b3aae-759899696c-kphpv"]
Sep 17 00:39:19.327538 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:19.327505    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:19.926565 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:19.926533    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4866fc25-dc2e-45f5-83ba-4d6532396dcd" path="/var/lib/kubelet/pods/4866fc25-dc2e-45f5-83ba-4d6532396dcd/volumes"
Sep 17 00:39:19.926931 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:19.926896    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7517378b-609b-42cf-8a34-b1e42d3771da" path="/var/lib/kubelet/pods/7517378b-609b-42cf-8a34-b1e42d3771da/volumes"
Sep 17 00:39:19.927258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:19.927245    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1" path="/var/lib/kubelet/pods/ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1/volumes"
Sep 17 00:39:20.026236 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:20.026207    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:20.740971 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:20.740938    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:21.618340 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:21.618306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:21.878677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:21.878577    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w" podUID="acbe6c6b-25de-4f83-97ab-c06709aebefd" containerName="main" containerID="cri-o://bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25" gracePeriod=45
Sep 17 00:39:21.892600 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:21.892568    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58" podUID="57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" containerName="main" containerID="cri-o://d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619" gracePeriod=45
Sep 17 00:39:22.179352 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.179332    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:39:22.182437 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.182417    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:39:22.240965 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.240932    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-model-cache\") pod \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") "
Sep 17 00:39:22.241148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.240983    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tls-certs\") pod \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") "
Sep 17 00:39:22.241148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.241035    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-dshm\") pod \"acbe6c6b-25de-4f83-97ab-c06709aebefd\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") "
Sep 17 00:39:22.241148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.241091    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tmp-dir\") pod \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") "
Sep 17 00:39:22.241148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.241135    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-home\") pod \"acbe6c6b-25de-4f83-97ab-c06709aebefd\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") "
Sep 17 00:39:22.241373 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.241168    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-model-cache\") pod \"acbe6c6b-25de-4f83-97ab-c06709aebefd\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") "
Sep 17 00:39:22.241373 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.241193    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acbe6c6b-25de-4f83-97ab-c06709aebefd-tls-certs\") pod \"acbe6c6b-25de-4f83-97ab-c06709aebefd\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") "
Sep 17 00:39:22.241736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.241675    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-model-cache" (OuterVolumeSpecName: "model-cache") pod "acbe6c6b-25de-4f83-97ab-c06709aebefd" (UID: "acbe6c6b-25de-4f83-97ab-c06709aebefd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:22.241953 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.241928    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-model-cache" (OuterVolumeSpecName: "model-cache") pod "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" (UID: "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:22.242101 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.242074    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-dshm\") pod \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") "
Sep 17 00:39:22.242221 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.242140    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-home\") pod \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") "
Sep 17 00:39:22.242221 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.242178    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtrhf\" (UniqueName: \"kubernetes.io/projected/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-kube-api-access-vtrhf\") pod \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\" (UID: \"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d\") "
Sep 17 00:39:22.242340 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.242236    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-tmp-dir\") pod \"acbe6c6b-25de-4f83-97ab-c06709aebefd\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") "
Sep 17 00:39:22.242340 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.242308    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sprs9\" (UniqueName: \"kubernetes.io/projected/acbe6c6b-25de-4f83-97ab-c06709aebefd-kube-api-access-sprs9\") pod \"acbe6c6b-25de-4f83-97ab-c06709aebefd\" (UID: \"acbe6c6b-25de-4f83-97ab-c06709aebefd\") "
Sep 17 00:39:22.243233 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.242714    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-model-cache\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.243233 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.242767    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-model-cache\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.243233 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.242824    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-home" (OuterVolumeSpecName: "home") pod "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" (UID: "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:22.243233 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.242882    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-home" (OuterVolumeSpecName: "home") pod "acbe6c6b-25de-4f83-97ab-c06709aebefd" (UID: "acbe6c6b-25de-4f83-97ab-c06709aebefd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:22.243233 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.242988    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" (UID: "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:22.243233 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.243192    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "acbe6c6b-25de-4f83-97ab-c06709aebefd" (UID: "acbe6c6b-25de-4f83-97ab-c06709aebefd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:22.244922 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.244894    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" (UID: "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:39:22.245038 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.244963    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acbe6c6b-25de-4f83-97ab-c06709aebefd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "acbe6c6b-25de-4f83-97ab-c06709aebefd" (UID: "acbe6c6b-25de-4f83-97ab-c06709aebefd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:39:22.245151 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.245126    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-dshm" (OuterVolumeSpecName: "dshm") pod "acbe6c6b-25de-4f83-97ab-c06709aebefd" (UID: "acbe6c6b-25de-4f83-97ab-c06709aebefd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:22.245262 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.245239    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-kube-api-access-vtrhf" (OuterVolumeSpecName: "kube-api-access-vtrhf") pod "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" (UID: "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d"). InnerVolumeSpecName "kube-api-access-vtrhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:22.245736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.245711    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-dshm" (OuterVolumeSpecName: "dshm") pod "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" (UID: "57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:22.246307 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.246273    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acbe6c6b-25de-4f83-97ab-c06709aebefd-kube-api-access-sprs9" (OuterVolumeSpecName: "kube-api-access-sprs9") pod "acbe6c6b-25de-4f83-97ab-c06709aebefd" (UID: "acbe6c6b-25de-4f83-97ab-c06709aebefd"). InnerVolumeSpecName "kube-api-access-sprs9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:22.246580 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.246479    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:22.343613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.343585    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-home\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.343613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.343608    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acbe6c6b-25de-4f83-97ab-c06709aebefd-tls-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.343613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.343617    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-dshm\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.343867 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.343625    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-home\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.343867 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.343634    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtrhf\" (UniqueName: \"kubernetes.io/projected/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-kube-api-access-vtrhf\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.343867 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.343642    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-tmp-dir\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.343867 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.343650    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sprs9\" (UniqueName: \"kubernetes.io/projected/acbe6c6b-25de-4f83-97ab-c06709aebefd-kube-api-access-sprs9\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.343867 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.343657    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tls-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.343867 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.343665    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acbe6c6b-25de-4f83-97ab-c06709aebefd-dshm\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.343867 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.343672    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d-tmp-dir\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:22.908252 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.908204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:22.911051 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.911027    2565 generic.go:356] "Generic (PLEG): container finished" podID="acbe6c6b-25de-4f83-97ab-c06709aebefd" containerID="bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25" exitCode=0
Sep 17 00:39:22.911152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.911064    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"
Sep 17 00:39:22.911152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.911108    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w" event={"ID":"acbe6c6b-25de-4f83-97ab-c06709aebefd","Type":"ContainerDied","Data":"bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25"}
Sep 17 00:39:22.911228 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.911149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w" event={"ID":"acbe6c6b-25de-4f83-97ab-c06709aebefd","Type":"ContainerDied","Data":"51cd71157f09ba8d13f7d541ad4cebf8bdf7f1c26c5b6a2e117fc6b97b4dd31b"}
Sep 17 00:39:22.911228 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.911174    2565 scope.go:117] "RemoveContainer" containerID="bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25"
Sep 17 00:39:22.912645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.912626    2565 generic.go:356] "Generic (PLEG): container finished" podID="57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" containerID="d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619" exitCode=0
Sep 17 00:39:22.912740 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.912710    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"
Sep 17 00:39:22.912740 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.912715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58" event={"ID":"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d","Type":"ContainerDied","Data":"d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619"}
Sep 17 00:39:22.912838 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.912745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58" event={"ID":"57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d","Type":"ContainerDied","Data":"f6600890ebe859fb50501a5e5ed3c9f58b08b6920a01c620fe06364d97e0dc0d"}
Sep 17 00:39:22.922675 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.922660    2565 scope.go:117] "RemoveContainer" containerID="bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25"
Sep 17 00:39:22.922990 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:39:22.922960    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25\": container with ID starting with bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25 not found: ID does not exist" containerID="bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25"
Sep 17 00:39:22.923065 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.922995    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25"} err="failed to get container status \"bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25\": rpc error: code = NotFound desc = could not find container \"bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25\": container with ID starting with bac46221d26a21dedfffee40fc8631482ab786d755f648df12e87ee0711c5f25 not found: ID does not exist"
Sep 17 00:39:22.923065 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.923011    2565 scope.go:117] "RemoveContainer" containerID="d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619"
Sep 17 00:39:22.930809 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.930781    2565 scope.go:117] "RemoveContainer" containerID="d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619"
Sep 17 00:39:22.931073 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:39:22.931054    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619\": container with ID starting with d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619 not found: ID does not exist" containerID="d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619"
Sep 17 00:39:22.931142 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.931079    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619"} err="failed to get container status \"d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619\": rpc error: code = NotFound desc = could not find container \"d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619\": container with ID starting with d993640cc0f23ea6e5588a5b13dbf5be64c70526f8718036c32df83290e37619 not found: ID does not exist"
Sep 17 00:39:22.935148 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.935128    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"]
Sep 17 00:39:22.938843 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.938822    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/distinct-2-w0-cfe049-kserve-7c4cfb54c9-fmx2w"]
Sep 17 00:39:22.950905 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.950884    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"]
Sep 17 00:39:22.952680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:22.952662    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-cfe049/embedding-w0-cfe049-kserve-5b7bf74869-pwv58"]
Sep 17 00:39:23.926553 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:23.926519    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" path="/var/lib/kubelet/pods/57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d/volumes"
Sep 17 00:39:23.926946 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:23.926931    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acbe6c6b-25de-4f83-97ab-c06709aebefd" path="/var/lib/kubelet/pods/acbe6c6b-25de-4f83-97ab-c06709aebefd/volumes"
Sep 17 00:39:24.665448 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:24.665407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:24.763649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:24.763613    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:24.868839 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:24.868789    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:24.930704 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:24.930623    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:25.065404 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:25.065317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:25.169839 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:25.169721    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:25.412983 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:25.412928    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:25.782674 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:25.782578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:25.974692 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:25.974658    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:26.075797 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:26.075757    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:26.227642 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:26.227602    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:26.714083 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:26.714042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:27.628912 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:27.628875    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:28.420592 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:28.420552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:29.059616 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:29.059582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:29.692347 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:29.692306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:30.430125 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:30.430088    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:31.066220 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:31.066183    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:31.748631 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:31.748601    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:37.227740 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.227684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:37.252028 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.251961    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"]
Sep 17 00:39:37.252485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.252456    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz" podUID="f060865e-634e-440d-96d2-0ca5aa87f650" containerName="payload-processing" containerID="cri-o://58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d" gracePeriod=30
Sep 17 00:39:37.255454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.255423    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"]
Sep 17 00:39:37.255672 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.255631    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf" podUID="da23edc7-1508-4948-8973-51099fb80c75" containerName="payload-pre-processing" containerID="cri-o://f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7" gracePeriod=30
Sep 17 00:39:37.293446 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.293406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:37.350237 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.350205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:37.414455 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.414411    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:37.528131 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.528105    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:39:37.547683 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.547658    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:39:37.697686 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.697655    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f060865e-634e-440d-96d2-0ca5aa87f650-plugins-config-volume\") pod \"f060865e-634e-440d-96d2-0ca5aa87f650\" (UID: \"f060865e-634e-440d-96d2-0ca5aa87f650\") "
Sep 17 00:39:37.697860 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.697706    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pdgl\" (UniqueName: \"kubernetes.io/projected/da23edc7-1508-4948-8973-51099fb80c75-kube-api-access-7pdgl\") pod \"da23edc7-1508-4948-8973-51099fb80c75\" (UID: \"da23edc7-1508-4948-8973-51099fb80c75\") "
Sep 17 00:39:37.697860 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.697739    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da23edc7-1508-4948-8973-51099fb80c75-plugins-config-volume\") pod \"da23edc7-1508-4948-8973-51099fb80c75\" (UID: \"da23edc7-1508-4948-8973-51099fb80c75\") "
Sep 17 00:39:37.697860 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.697839    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-456nv\" (UniqueName: \"kubernetes.io/projected/f060865e-634e-440d-96d2-0ca5aa87f650-kube-api-access-456nv\") pod \"f060865e-634e-440d-96d2-0ca5aa87f650\" (UID: \"f060865e-634e-440d-96d2-0ca5aa87f650\") "
Sep 17 00:39:37.698127 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.698087    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f060865e-634e-440d-96d2-0ca5aa87f650-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f060865e-634e-440d-96d2-0ca5aa87f650" (UID: "f060865e-634e-440d-96d2-0ca5aa87f650"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:37.698260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.698177    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da23edc7-1508-4948-8973-51099fb80c75-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "da23edc7-1508-4948-8973-51099fb80c75" (UID: "da23edc7-1508-4948-8973-51099fb80c75"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:37.698260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.698192    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f060865e-634e-440d-96d2-0ca5aa87f650-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:37.699867 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.699844    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da23edc7-1508-4948-8973-51099fb80c75-kube-api-access-7pdgl" (OuterVolumeSpecName: "kube-api-access-7pdgl") pod "da23edc7-1508-4948-8973-51099fb80c75" (UID: "da23edc7-1508-4948-8973-51099fb80c75"). InnerVolumeSpecName "kube-api-access-7pdgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:37.699951 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.699893    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f060865e-634e-440d-96d2-0ca5aa87f650-kube-api-access-456nv" (OuterVolumeSpecName: "kube-api-access-456nv") pod "f060865e-634e-440d-96d2-0ca5aa87f650" (UID: "f060865e-634e-440d-96d2-0ca5aa87f650"). InnerVolumeSpecName "kube-api-access-456nv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:37.768822 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.768746    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:37.799556 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.799532    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da23edc7-1508-4948-8973-51099fb80c75-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:37.799556 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.799557    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-456nv\" (UniqueName: \"kubernetes.io/projected/f060865e-634e-440d-96d2-0ca5aa87f650-kube-api-access-456nv\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:37.799691 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.799566    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pdgl\" (UniqueName: \"kubernetes.io/projected/da23edc7-1508-4948-8973-51099fb80c75-kube-api-access-7pdgl\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:37.841014 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.840990    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:37.996063 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.996034    2565 generic.go:356] "Generic (PLEG): container finished" podID="f060865e-634e-440d-96d2-0ca5aa87f650" containerID="58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d" exitCode=0
Sep 17 00:39:37.996184 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.996079    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"
Sep 17 00:39:37.996184 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.996118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz" event={"ID":"f060865e-634e-440d-96d2-0ca5aa87f650","Type":"ContainerDied","Data":"58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d"}
Sep 17 00:39:37.996184 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.996169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz" event={"ID":"f060865e-634e-440d-96d2-0ca5aa87f650","Type":"ContainerDied","Data":"ade42037b08c7379edce338d90b8d8a10913f538584c38c3d76616699e587bd5"}
Sep 17 00:39:37.996325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.996194    2565 scope.go:117] "RemoveContainer" containerID="58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d"
Sep 17 00:39:37.997530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.997505    2565 generic.go:356] "Generic (PLEG): container finished" podID="da23edc7-1508-4948-8973-51099fb80c75" containerID="f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7" exitCode=0
Sep 17 00:39:37.997641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.997544    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"
Sep 17 00:39:37.997641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.997592    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf" event={"ID":"da23edc7-1508-4948-8973-51099fb80c75","Type":"ContainerDied","Data":"f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7"}
Sep 17 00:39:37.997753 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:37.997640    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf" event={"ID":"da23edc7-1508-4948-8973-51099fb80c75","Type":"ContainerDied","Data":"7db615a26c2130eee00a13fa26c8973251a50fa6d9d62187bbb0cf454f85719b"}
Sep 17 00:39:38.005165 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:38.005150    2565 scope.go:117] "RemoveContainer" containerID="58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d"
Sep 17 00:39:38.005437 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:39:38.005417    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d\": container with ID starting with 58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d not found: ID does not exist" containerID="58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d"
Sep 17 00:39:38.005491 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:38.005444    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d"} err="failed to get container status \"58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d\": rpc error: code = NotFound desc = could not find container \"58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d\": container with ID starting with 58b3b5e674f0fd94a6ddbf051ee7c26e19776a1c779c7c8ef3f332b622cf383d not found: ID does not exist"
Sep 17 00:39:38.005491 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:38.005459    2565 scope.go:117] "RemoveContainer" containerID="f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7"
Sep 17 00:39:38.012613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:38.012590    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"]
Sep 17 00:39:38.014036 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:38.014017    2565 scope.go:117] "RemoveContainer" containerID="f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7"
Sep 17 00:39:38.014399 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:39:38.014377    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7\": container with ID starting with f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7 not found: ID does not exist" containerID="f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7"
Sep 17 00:39:38.014466 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:38.014404    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7"} err="failed to get container status \"f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7\": rpc error: code = NotFound desc = could not find container \"f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7\": container with ID starting with f29b7c056feada6a1de23d0277baddf2a02a72011cae1b279817a6f57ef5bde7 not found: ID does not exist"
Sep 17 00:39:38.016166 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:38.016147    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-48e479-6cdbb7b946-t7wvf"]
Sep 17 00:39:38.029604 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:38.029546    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"]
Sep 17 00:39:38.035190 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:38.035170    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-48e479-6b95f76bc-2f7hz"]
Sep 17 00:39:38.444262 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:38.444235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:39.176455 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:39.176424    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:39.926442 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:39.926406    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da23edc7-1508-4948-8973-51099fb80c75" path="/var/lib/kubelet/pods/da23edc7-1508-4948-8973-51099fb80c75/volumes"
Sep 17 00:39:39.926916 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:39.926893    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f060865e-634e-440d-96d2-0ca5aa87f650" path="/var/lib/kubelet/pods/f060865e-634e-440d-96d2-0ca5aa87f650/volumes"
Sep 17 00:39:39.928487 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:39.928461    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:40.560403 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:40.560361    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:43.567172 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:43.567136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:43.629136 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:43.629094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:43.807559 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:43.807525    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:44.404871 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:44.404840    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:45.140837 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:45.140782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:45.785720 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:45.785685    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:46.519716 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:46.519679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:47.328118 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:47.328080    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:48.232429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:48.232395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:51.450836 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:51.450784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:51.814531 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:51.814496    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:52.624073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:52.624034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:53.375009 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:53.374968    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:53.985280 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:53.985242    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:54.716082 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:54.716044    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:55.425799 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:55.425760    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:56.054582 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.054547    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"]
Sep 17 00:39:56.054869 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.054824    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9" podUID="35dd59f4-f6d4-4d4c-9aae-49b68564b70a" containerName="maas-api" containerID="cri-o://62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e" gracePeriod=30
Sep 17 00:39:56.083240 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.083166    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:56.150236 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.150128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:56.207667 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.207631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:56.269081 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.269048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:56.315990 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.315927    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:39:56.323463 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.323440    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:56.377667 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.377630    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-openshift-service-ca\") pod \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") "
Sep 17 00:39:56.377901 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.377710    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45qkx\" (UniqueName: \"kubernetes.io/projected/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-kube-api-access-45qkx\") pod \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") "
Sep 17 00:39:56.377901 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.377788    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-maas-api-tls\") pod \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") "
Sep 17 00:39:56.378039 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.377903    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-metrics-certs\") pod \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\" (UID: \"35dd59f4-f6d4-4d4c-9aae-49b68564b70a\") "
Sep 17 00:39:56.378147 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.378103    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "35dd59f4-f6d4-4d4c-9aae-49b68564b70a" (UID: "35dd59f4-f6d4-4d4c-9aae-49b68564b70a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:56.378305 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.378285    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-openshift-service-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:56.380711 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.380681    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "35dd59f4-f6d4-4d4c-9aae-49b68564b70a" (UID: "35dd59f4-f6d4-4d4c-9aae-49b68564b70a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:39:56.380854 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.380833    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-kube-api-access-45qkx" (OuterVolumeSpecName: "kube-api-access-45qkx") pod "35dd59f4-f6d4-4d4c-9aae-49b68564b70a" (UID: "35dd59f4-f6d4-4d4c-9aae-49b68564b70a"). InnerVolumeSpecName "kube-api-access-45qkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:56.381556 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.381530    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "35dd59f4-f6d4-4d4c-9aae-49b68564b70a" (UID: "35dd59f4-f6d4-4d4c-9aae-49b68564b70a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:39:56.479575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.479529    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-maas-api-tls\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:56.479575 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.479578    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-metrics-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:56.480058 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.479595    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45qkx\" (UniqueName: \"kubernetes.io/projected/35dd59f4-f6d4-4d4c-9aae-49b68564b70a-kube-api-access-45qkx\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:39:56.498157 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.498114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:56.603128 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.603034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:56.739201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:56.739163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:57.107794 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:57.107759    2565 generic.go:356] "Generic (PLEG): container finished" podID="35dd59f4-f6d4-4d4c-9aae-49b68564b70a" containerID="62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e" exitCode=0
Sep 17 00:39:57.107971 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:57.107828    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"
Sep 17 00:39:57.107971 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:57.107840    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9" event={"ID":"35dd59f4-f6d4-4d4c-9aae-49b68564b70a","Type":"ContainerDied","Data":"62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e"}
Sep 17 00:39:57.107971 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:57.107902    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9" event={"ID":"35dd59f4-f6d4-4d4c-9aae-49b68564b70a","Type":"ContainerDied","Data":"8a2ea1e3f2d9c779719b21fbc0d748f3f17807a5d8cbd886ef4c5dc5cc7a1188"}
Sep 17 00:39:57.107971 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:57.107934    2565 scope.go:117] "RemoveContainer" containerID="62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e"
Sep 17 00:39:57.116731 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:57.116715    2565 scope.go:117] "RemoveContainer" containerID="62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e"
Sep 17 00:39:57.117046 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:39:57.117027    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e\": container with ID starting with 62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e not found: ID does not exist" containerID="62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e"
Sep 17 00:39:57.117107 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:57.117060    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e"} err="failed to get container status \"62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e\": rpc error: code = NotFound desc = could not find container \"62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e\": container with ID starting with 62d8de9149e84555688a8f74bfa6c6c0460271403303050209514128b859026e not found: ID does not exist"
Sep 17 00:39:57.138332 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:57.138301    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"]
Sep 17 00:39:57.138460 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:57.138352    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-edbd82-54bc9f7574-bsfw9"]
Sep 17 00:39:57.431102 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:57.431010    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:57.928114 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:57.928076    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35dd59f4-f6d4-4d4c-9aae-49b68564b70a" path="/var/lib/kubelet/pods/35dd59f4-f6d4-4d4c-9aae-49b68564b70a/volumes"
Sep 17 00:39:58.143585 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:58.143499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:39:58.864787 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:39:58.864752    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:01.680326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:01.680291    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:02.579607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:02.579573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:02.680320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:02.680290    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:02.816749 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:02.816715    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"]
Sep 17 00:40:02.817115 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:02.816998    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy" containerID="cri-o://66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee" gracePeriod=30
Sep 17 00:40:02.839429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:02.839347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:05.759243 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:05.759215    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:40:05.767919 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:05.767895    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:40:07.443727 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:07.443697    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:07.505092 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:07.505055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:07.574552 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:07.574513    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:07.639103 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:07.639063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:07.994292 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:07.994259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:08.070187 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.070155    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:40:08.095425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.095329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:08.168203 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.168169    2565 generic.go:356] "Generic (PLEG): container finished" podID="8147eff5-d245-4a69-a988-51f95ac681e8" containerID="66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee" exitCode=0
Sep 17 00:40:08.168381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.168218    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"
Sep 17 00:40:08.168381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.168262    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" event={"ID":"8147eff5-d245-4a69-a988-51f95ac681e8","Type":"ContainerDied","Data":"66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee"}
Sep 17 00:40:08.168381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.168316    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz" event={"ID":"8147eff5-d245-4a69-a988-51f95ac681e8","Type":"ContainerDied","Data":"83c4632608ead47d90a5d9acc730d14cda1defc2e4d7b784ca280931cb89087a"}
Sep 17 00:40:08.168381 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.168342    2565 scope.go:117] "RemoveContainer" containerID="66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee"
Sep 17 00:40:08.177091 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.177077    2565 scope.go:117] "RemoveContainer" containerID="5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0"
Sep 17 00:40:08.184953 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.184935    2565 scope.go:117] "RemoveContainer" containerID="66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee"
Sep 17 00:40:08.185208 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:40:08.185189    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee\": container with ID starting with 66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee not found: ID does not exist" containerID="66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee"
Sep 17 00:40:08.185252 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.185216    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee"} err="failed to get container status \"66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee\": rpc error: code = NotFound desc = could not find container \"66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee\": container with ID starting with 66fb5d4490ba05ba3a13497907508ea1fccfd333291b7261e2d7f59f19cdaeee not found: ID does not exist"
Sep 17 00:40:08.185252 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.185233    2565 scope.go:117] "RemoveContainer" containerID="5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0"
Sep 17 00:40:08.185467 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:40:08.185452    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0\": container with ID starting with 5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0 not found: ID does not exist" containerID="5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0"
Sep 17 00:40:08.185506 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.185470    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0"} err="failed to get container status \"5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0\": rpc error: code = NotFound desc = could not find container \"5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0\": container with ID starting with 5b75bb32888b2677fba1e09a95b31ba0bc4998000731497ade66b81708c6d3a0 not found: ID does not exist"
Sep 17 00:40:08.188789 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.188773    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-credential-socket\") pod \"8147eff5-d245-4a69-a988-51f95ac681e8\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") "
Sep 17 00:40:08.188867 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.188836    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8147eff5-d245-4a69-a988-51f95ac681e8-istio-podinfo\") pod \"8147eff5-d245-4a69-a988-51f95ac681e8\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") "
Sep 17 00:40:08.188915 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.188874    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvhds\" (UniqueName: \"kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-kube-api-access-gvhds\") pod \"8147eff5-d245-4a69-a988-51f95ac681e8\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") "
Sep 17 00:40:08.188977 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.188962    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-envoy\") pod \"8147eff5-d245-4a69-a988-51f95ac681e8\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") "
Sep 17 00:40:08.189019 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.188978    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8147eff5-d245-4a69-a988-51f95ac681e8" (UID: "8147eff5-d245-4a69-a988-51f95ac681e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:08.189019 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.188997    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8147eff5-d245-4a69-a988-51f95ac681e8-istiod-ca-cert\") pod \"8147eff5-d245-4a69-a988-51f95ac681e8\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") "
Sep 17 00:40:08.189118 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189025    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-data\") pod \"8147eff5-d245-4a69-a988-51f95ac681e8\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") "
Sep 17 00:40:08.189197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-istio-token\") pod \"8147eff5-d245-4a69-a988-51f95ac681e8\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") "
Sep 17 00:40:08.189255 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189222    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-socket\") pod \"8147eff5-d245-4a69-a988-51f95ac681e8\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") "
Sep 17 00:40:08.189255 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189247    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-certs\") pod \"8147eff5-d245-4a69-a988-51f95ac681e8\" (UID: \"8147eff5-d245-4a69-a988-51f95ac681e8\") "
Sep 17 00:40:08.189364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189285    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "8147eff5-d245-4a69-a988-51f95ac681e8" (UID: "8147eff5-d245-4a69-a988-51f95ac681e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:08.189507 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189408    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8147eff5-d245-4a69-a988-51f95ac681e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8147eff5-d245-4a69-a988-51f95ac681e8" (UID: "8147eff5-d245-4a69-a988-51f95ac681e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:40:08.189507 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189490    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8147eff5-d245-4a69-a988-51f95ac681e8" (UID: "8147eff5-d245-4a69-a988-51f95ac681e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:08.189665 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189641    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8147eff5-d245-4a69-a988-51f95ac681e8" (UID: "8147eff5-d245-4a69-a988-51f95ac681e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:08.189723 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189704    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8147eff5-d245-4a69-a988-51f95ac681e8-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:08.189780 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189726    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:08.189780 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189740    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:08.189780 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.189755    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:08.190980 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.190961    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8147eff5-d245-4a69-a988-51f95ac681e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8147eff5-d245-4a69-a988-51f95ac681e8" (UID: "8147eff5-d245-4a69-a988-51f95ac681e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:40:08.191143 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.191118    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-kube-api-access-gvhds" (OuterVolumeSpecName: "kube-api-access-gvhds") pod "8147eff5-d245-4a69-a988-51f95ac681e8" (UID: "8147eff5-d245-4a69-a988-51f95ac681e8"). InnerVolumeSpecName "kube-api-access-gvhds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:40:08.191435 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.191390    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8147eff5-d245-4a69-a988-51f95ac681e8" (UID: "8147eff5-d245-4a69-a988-51f95ac681e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:08.191508 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.191437    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "8147eff5-d245-4a69-a988-51f95ac681e8" (UID: "8147eff5-d245-4a69-a988-51f95ac681e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:40:08.291009 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.290965    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:08.291009 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.291004    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:08.291009 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.291014    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8147eff5-d245-4a69-a988-51f95ac681e8-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:08.291009 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.291022    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvhds\" (UniqueName: \"kubernetes.io/projected/8147eff5-d245-4a69-a988-51f95ac681e8-kube-api-access-gvhds\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:08.291273 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.291033    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8147eff5-d245-4a69-a988-51f95ac681e8-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:08.491635 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.491602    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"]
Sep 17 00:40:08.499318 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.499278    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-edbd82-openshift-default-77765c4c5d-25znz"]
Sep 17 00:40:08.710828 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:08.710719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:09.638204 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:09.638166    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:09.926283 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:09.926201    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" path="/var/lib/kubelet/pods/8147eff5-d245-4a69-a988-51f95ac681e8/volumes"
Sep 17 00:40:13.831301 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:13.831261    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:13.931949 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:13.931920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:14.060235 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:14.060201    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"]
Sep 17 00:40:14.060472 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:14.060444    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy" containerID="cri-o://d1c9360f8d0c000dbbacf0d7a6731ff2a41431d159c3e2448fe57a0305b69e50" gracePeriod=30
Sep 17 00:40:14.073137 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:14.073101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:19.235257 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.235222    2565 generic.go:356] "Generic (PLEG): container finished" podID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerID="d1c9360f8d0c000dbbacf0d7a6731ff2a41431d159c3e2448fe57a0305b69e50" exitCode=0
Sep 17 00:40:19.235748 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.235354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" event={"ID":"87c0feab-a237-489c-98e0-8f17ebd5c1d5","Type":"ContainerDied","Data":"d1c9360f8d0c000dbbacf0d7a6731ff2a41431d159c3e2448fe57a0305b69e50"}
Sep 17 00:40:19.235887 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.235849    2565 scope.go:117] "RemoveContainer" containerID="1ce2ff2caf201afc167041a037d052125a2372183847710fd1c1a8845356923d"
Sep 17 00:40:19.318387 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.318363    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:40:19.401774 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.401720    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjfwm\" (UniqueName: \"kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-kube-api-access-bjfwm\") pod \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") "
Sep 17 00:40:19.401774 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.401764    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-data\") pod \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") "
Sep 17 00:40:19.401940 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.401790    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-credential-socket\") pod \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") "
Sep 17 00:40:19.401940 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.401847    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-envoy\") pod \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") "
Sep 17 00:40:19.401940 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.401871    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-certs\") pod \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") "
Sep 17 00:40:19.401940 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.401903    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-socket\") pod \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") "
Sep 17 00:40:19.401940 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.401932    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istiod-ca-cert\") pod \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") "
Sep 17 00:40:19.402198 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.401987    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-podinfo\") pod \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") "
Sep 17 00:40:19.402198 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.402041    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-token\") pod \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\" (UID: \"87c0feab-a237-489c-98e0-8f17ebd5c1d5\") "
Sep 17 00:40:19.402198 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.402062    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "87c0feab-a237-489c-98e0-8f17ebd5c1d5" (UID: "87c0feab-a237-489c-98e0-8f17ebd5c1d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:19.402198 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.402112    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "87c0feab-a237-489c-98e0-8f17ebd5c1d5" (UID: "87c0feab-a237-489c-98e0-8f17ebd5c1d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:19.402198 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.402152    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "87c0feab-a237-489c-98e0-8f17ebd5c1d5" (UID: "87c0feab-a237-489c-98e0-8f17ebd5c1d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:19.402198 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.402168    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "87c0feab-a237-489c-98e0-8f17ebd5c1d5" (UID: "87c0feab-a237-489c-98e0-8f17ebd5c1d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:19.402490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.402369    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "87c0feab-a237-489c-98e0-8f17ebd5c1d5" (UID: "87c0feab-a237-489c-98e0-8f17ebd5c1d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:40:19.402490 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.402476    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:19.402596 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.402493    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:19.402596 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.402502    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:19.402596 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.402511    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:19.402596 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.402519    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:19.403896 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.403873    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-kube-api-access-bjfwm" (OuterVolumeSpecName: "kube-api-access-bjfwm") pod "87c0feab-a237-489c-98e0-8f17ebd5c1d5" (UID: "87c0feab-a237-489c-98e0-8f17ebd5c1d5"). InnerVolumeSpecName "kube-api-access-bjfwm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:40:19.404197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.404184    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "87c0feab-a237-489c-98e0-8f17ebd5c1d5" (UID: "87c0feab-a237-489c-98e0-8f17ebd5c1d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:40:19.404405 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.404380    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "87c0feab-a237-489c-98e0-8f17ebd5c1d5" (UID: "87c0feab-a237-489c-98e0-8f17ebd5c1d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:19.404405 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.404389    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "87c0feab-a237-489c-98e0-8f17ebd5c1d5" (UID: "87c0feab-a237-489c-98e0-8f17ebd5c1d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:40:19.503530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.503507    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:19.503530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.503528    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:19.503655 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.503541    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:19.503655 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:19.503552    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjfwm\" (UniqueName: \"kubernetes.io/projected/87c0feab-a237-489c-98e0-8f17ebd5c1d5-kube-api-access-bjfwm\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:40:20.242326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:20.242265    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"
Sep 17 00:40:20.242326 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:20.242304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh" event={"ID":"87c0feab-a237-489c-98e0-8f17ebd5c1d5","Type":"ContainerDied","Data":"36789457b7b5912197bd10af405832cba3f61a336c75f6d96721799b572a4839"}
Sep 17 00:40:20.242778 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:20.242362    2565 scope.go:117] "RemoveContainer" containerID="d1c9360f8d0c000dbbacf0d7a6731ff2a41431d159c3e2448fe57a0305b69e50"
Sep 17 00:40:20.262997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:20.262973    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"]
Sep 17 00:40:20.266500 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:20.266476    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-2faea3-openshift-default-684fcb68f6-vvtrh"]
Sep 17 00:40:21.926659 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:21.926611    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" path="/var/lib/kubelet/pods/87c0feab-a237-489c-98e0-8f17ebd5c1d5/volumes"
Sep 17 00:40:33.383152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:33.383111    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:34.703074 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:34.703033    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:48.119963 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:48.119921    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:51.149846 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:51.149794    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"]
Sep 17 00:40:51.168545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:51.168512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:40:52.198358 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:40:52.198317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:41:06.169685 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.169631    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs" podUID="3971a2a6-b425-43b5-87a2-76599f5d371b" containerName="main" containerID="cri-o://38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c" gracePeriod=45
Sep 17 00:41:06.425006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.424943    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:41:06.482681 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.482646    2565 generic.go:356] "Generic (PLEG): container finished" podID="3971a2a6-b425-43b5-87a2-76599f5d371b" containerID="38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c" exitCode=0
Sep 17 00:41:06.482850 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.482691    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"
Sep 17 00:41:06.482850 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.482696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs" event={"ID":"3971a2a6-b425-43b5-87a2-76599f5d371b","Type":"ContainerDied","Data":"38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c"}
Sep 17 00:41:06.482850 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.482827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs" event={"ID":"3971a2a6-b425-43b5-87a2-76599f5d371b","Type":"ContainerDied","Data":"b70bfe81a05072b8c8426356a9a303066236250daf032499f47a3e175ef018bd"}
Sep 17 00:41:06.482850 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.482855    2565 scope.go:117] "RemoveContainer" containerID="38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c"
Sep 17 00:41:06.491529 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.491508    2565 scope.go:117] "RemoveContainer" containerID="38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c"
Sep 17 00:41:06.491794 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:41:06.491767    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c\": container with ID starting with 38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c not found: ID does not exist" containerID="38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c"
Sep 17 00:41:06.491872 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.491817    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c"} err="failed to get container status \"38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c\": rpc error: code = NotFound desc = could not find container \"38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c\": container with ID starting with 38a938bdb34fe42710acfd4082840fb6cbcf31010a8636071e291cf2f2106f2c not found: ID does not exist"
Sep 17 00:41:06.539143 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.539115    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-home\") pod \"3971a2a6-b425-43b5-87a2-76599f5d371b\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") "
Sep 17 00:41:06.539270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.539190    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djhtd\" (UniqueName: \"kubernetes.io/projected/3971a2a6-b425-43b5-87a2-76599f5d371b-kube-api-access-djhtd\") pod \"3971a2a6-b425-43b5-87a2-76599f5d371b\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") "
Sep 17 00:41:06.539270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.539210    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3971a2a6-b425-43b5-87a2-76599f5d371b-tls-certs\") pod \"3971a2a6-b425-43b5-87a2-76599f5d371b\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") "
Sep 17 00:41:06.539270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.539235    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-tmp-dir\") pod \"3971a2a6-b425-43b5-87a2-76599f5d371b\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") "
Sep 17 00:41:06.539403 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.539274    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-dshm\") pod \"3971a2a6-b425-43b5-87a2-76599f5d371b\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") "
Sep 17 00:41:06.539403 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.539321    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-model-cache\") pod \"3971a2a6-b425-43b5-87a2-76599f5d371b\" (UID: \"3971a2a6-b425-43b5-87a2-76599f5d371b\") "
Sep 17 00:41:06.539509 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.539414    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-home" (OuterVolumeSpecName: "home") pod "3971a2a6-b425-43b5-87a2-76599f5d371b" (UID: "3971a2a6-b425-43b5-87a2-76599f5d371b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:06.539509 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.539499    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3971a2a6-b425-43b5-87a2-76599f5d371b" (UID: "3971a2a6-b425-43b5-87a2-76599f5d371b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:06.539629 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.539597    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-model-cache" (OuterVolumeSpecName: "model-cache") pod "3971a2a6-b425-43b5-87a2-76599f5d371b" (UID: "3971a2a6-b425-43b5-87a2-76599f5d371b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:06.539701 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.539681    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-home\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:41:06.539744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.539705    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-tmp-dir\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:41:06.541555 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.541528    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3971a2a6-b425-43b5-87a2-76599f5d371b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3971a2a6-b425-43b5-87a2-76599f5d371b" (UID: "3971a2a6-b425-43b5-87a2-76599f5d371b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:41:06.541555 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.541539    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-dshm" (OuterVolumeSpecName: "dshm") pod "3971a2a6-b425-43b5-87a2-76599f5d371b" (UID: "3971a2a6-b425-43b5-87a2-76599f5d371b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:41:06.541698 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.541590    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3971a2a6-b425-43b5-87a2-76599f5d371b-kube-api-access-djhtd" (OuterVolumeSpecName: "kube-api-access-djhtd") pod "3971a2a6-b425-43b5-87a2-76599f5d371b" (UID: "3971a2a6-b425-43b5-87a2-76599f5d371b"). InnerVolumeSpecName "kube-api-access-djhtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:41:06.640798 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.640767    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djhtd\" (UniqueName: \"kubernetes.io/projected/3971a2a6-b425-43b5-87a2-76599f5d371b-kube-api-access-djhtd\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:41:06.640798 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.640795    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3971a2a6-b425-43b5-87a2-76599f5d371b-tls-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:41:06.641013 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.640832    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-dshm\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:41:06.641013 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.640840    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3971a2a6-b425-43b5-87a2-76599f5d371b-model-cache\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:41:06.804441 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.804412    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"]
Sep 17 00:41:06.806274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:06.806251    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/auth-test-model-47a2db-kserve-685b9bf855-sd4rs"]
Sep 17 00:41:07.926322 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:07.926274    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3971a2a6-b425-43b5-87a2-76599f5d371b" path="/var/lib/kubelet/pods/3971a2a6-b425-43b5-87a2-76599f5d371b/volumes"
Sep 17 00:41:23.001462 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001387    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"]
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001740    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35dd59f4-f6d4-4d4c-9aae-49b68564b70a" containerName="maas-api"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001751    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="35dd59f4-f6d4-4d4c-9aae-49b68564b70a" containerName="maas-api"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001762    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001768    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001775    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7517378b-609b-42cf-8a34-b1e42d3771da" containerName="payload-processing"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001780    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7517378b-609b-42cf-8a34-b1e42d3771da" containerName="payload-processing"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001792    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da23edc7-1508-4948-8973-51099fb80c75" containerName="payload-pre-processing"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001797    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da23edc7-1508-4948-8973-51099fb80c75" containerName="payload-pre-processing"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001825    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4866fc25-dc2e-45f5-83ba-4d6532396dcd" containerName="payload-pre-processing"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001832    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4866fc25-dc2e-45f5-83ba-4d6532396dcd" containerName="payload-pre-processing"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001842    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3971a2a6-b425-43b5-87a2-76599f5d371b" containerName="main"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001848    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3971a2a6-b425-43b5-87a2-76599f5d371b" containerName="main"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001854    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1" containerName="maas-api"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001859    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1" containerName="maas-api"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001864    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001869    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001878    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acbe6c6b-25de-4f83-97ab-c06709aebefd" containerName="main"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001884    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="acbe6c6b-25de-4f83-97ab-c06709aebefd" containerName="main"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001890    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f060865e-634e-440d-96d2-0ca5aa87f650" containerName="payload-processing"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001895    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f060865e-634e-440d-96d2-0ca5aa87f650" containerName="payload-processing"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001902    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001908    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001917    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001922    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001931    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" containerName="main"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001936    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" containerName="main"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001943    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f71371-82ca-408d-b485-81f3aea76dd9" containerName="maas-api"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001947    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f71371-82ca-408d-b485-81f3aea76dd9" containerName="maas-api"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001953    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a949037-bb39-40f8-ae87-81504793ba44" containerName="payload-pre-processing"
Sep 17 00:41:23.001952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.001958    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a949037-bb39-40f8-ae87-81504793ba44" containerName="payload-pre-processing"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002026    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a949037-bb39-40f8-ae87-81504793ba44" containerName="payload-pre-processing"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002033    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002042    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002048    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f71371-82ca-408d-b485-81f3aea76dd9" containerName="maas-api"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002053    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7517378b-609b-42cf-8a34-b1e42d3771da" containerName="payload-processing"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002060    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="da23edc7-1508-4948-8973-51099fb80c75" containerName="payload-pre-processing"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002065    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002070    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002076    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f060865e-634e-440d-96d2-0ca5aa87f650" containerName="payload-processing"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002081    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="acbe6c6b-25de-4f83-97ab-c06709aebefd" containerName="main"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002085    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3971a2a6-b425-43b5-87a2-76599f5d371b" containerName="main"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002091    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4866fc25-dc2e-45f5-83ba-4d6532396dcd" containerName="payload-pre-processing"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002097    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca894ebc-20fc-4f1b-935b-6ed8a2d1d6e1" containerName="maas-api"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002102    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="35dd59f4-f6d4-4d4c-9aae-49b68564b70a" containerName="maas-api"
Sep 17 00:41:23.002925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.002106    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c1d6ba-05dd-44fb-8f17-5ed3fdfa0f7d" containerName="main"
Sep 17 00:41:23.006688 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.006665    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.009341 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.009311    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-47a2db\"/\"kube-root-ca.crt\""
Sep 17 00:41:23.009480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.009355    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-47a2db\"/\"openshift-service-ca.crt\""
Sep 17 00:41:23.010570 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.010547    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-47a2db\"/\"default-dockercfg-6lfqt\""
Sep 17 00:41:23.010744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.010548    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-47a2db\"/\"sub-test-model-47a2db-kserve-self-signed-certs\""
Sep 17 00:41:23.013908 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.013887    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"]
Sep 17 00:41:23.032378 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.032352    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:41:23.086322 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.086292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-model-cache\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.086506 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.086370    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpmf9\" (UniqueName: \"kubernetes.io/projected/d6544117-4204-4a4f-91a5-2ab2c16d1e25-kube-api-access-hpmf9\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.086506 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.086426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-home\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.086595 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.086505    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tmp-dir\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.086595 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.086535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-dshm\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.086595 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.086554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tls-certs\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.187351 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.187308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-home\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.187528 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.187391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tmp-dir\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.187528 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.187419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-dshm\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.187528 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.187445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tls-certs\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.187528 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.187487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-model-cache\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.187708 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.187565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpmf9\" (UniqueName: \"kubernetes.io/projected/d6544117-4204-4a4f-91a5-2ab2c16d1e25-kube-api-access-hpmf9\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.188366 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.188339    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-home\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.188619 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.188594    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tmp-dir\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.188960 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.188935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-model-cache\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.191641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.191583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-dshm\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.192283 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.192259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tls-certs\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.196460 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.196439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpmf9\" (UniqueName: \"kubernetes.io/projected/d6544117-4204-4a4f-91a5-2ab2c16d1e25-kube-api-access-hpmf9\") pod \"sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") " pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.318991 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.318956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:23.588228 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:23.588202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"]
Sep 17 00:41:23.590129 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:41:23.590103    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6544117_4204_4a4f_91a5_2ab2c16d1e25.slice/crio-80d7b8dadc3d1aab693c4092d91d02a2254bb31bdb0848c5f9e4cb3850a1f0a8 WatchSource:0}: Error finding container 80d7b8dadc3d1aab693c4092d91d02a2254bb31bdb0848c5f9e4cb3850a1f0a8: Status 404 returned error can't find the container with id 80d7b8dadc3d1aab693c4092d91d02a2254bb31bdb0848c5f9e4cb3850a1f0a8
Sep 17 00:41:24.572970 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:24.572935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr" event={"ID":"d6544117-4204-4a4f-91a5-2ab2c16d1e25","Type":"ContainerStarted","Data":"4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb"}
Sep 17 00:41:24.572970 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:24.572977    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr" event={"ID":"d6544117-4204-4a4f-91a5-2ab2c16d1e25","Type":"ContainerStarted","Data":"80d7b8dadc3d1aab693c4092d91d02a2254bb31bdb0848c5f9e4cb3850a1f0a8"}
Sep 17 00:41:24.588550 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:24.588501    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr" podStartSLOduration=2.588485942 podStartE2EDuration="2.588485942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:41:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:41:24.587896979 +0000 UTC m=+1885.114636483" watchObservedRunningTime="2026-09-17 00:41:24.588485942 +0000 UTC m=+1885.115225420"
Sep 17 00:41:33.319339 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:33.319297    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:33.319952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:33.319364    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:33.332218 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:33.332189    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:33.628977 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:33.628892    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:41:43.429654 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:41:43.429612    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:42:14.231158 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:14.231118    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"]
Sep 17 00:42:14.248929 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:14.248901    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:42:15.322286 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:15.322246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:42:22.420858 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:22.420823    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:42:29.250638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.250589    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr" podUID="d6544117-4204-4a4f-91a5-2ab2c16d1e25" containerName="main" containerID="cri-o://4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb" gracePeriod=45
Sep 17 00:42:29.502865 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.502812    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:42:29.528235 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528210    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-home\") pod \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") "
Sep 17 00:42:29.528362 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528259    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-model-cache\") pod \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") "
Sep 17 00:42:29.528362 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528287    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpmf9\" (UniqueName: \"kubernetes.io/projected/d6544117-4204-4a4f-91a5-2ab2c16d1e25-kube-api-access-hpmf9\") pod \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") "
Sep 17 00:42:29.528452 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528369    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tmp-dir\") pod \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") "
Sep 17 00:42:29.528452 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528441    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-dshm\") pod \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") "
Sep 17 00:42:29.528573 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528505    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tls-certs\") pod \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\" (UID: \"d6544117-4204-4a4f-91a5-2ab2c16d1e25\") "
Sep 17 00:42:29.528573 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528509    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-home" (OuterVolumeSpecName: "home") pod "d6544117-4204-4a4f-91a5-2ab2c16d1e25" (UID: "d6544117-4204-4a4f-91a5-2ab2c16d1e25"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:42:29.528573 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528524    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-model-cache" (OuterVolumeSpecName: "model-cache") pod "d6544117-4204-4a4f-91a5-2ab2c16d1e25" (UID: "d6544117-4204-4a4f-91a5-2ab2c16d1e25"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:42:29.528728 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528663    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d6544117-4204-4a4f-91a5-2ab2c16d1e25" (UID: "d6544117-4204-4a4f-91a5-2ab2c16d1e25"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:42:29.528835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528816    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tmp-dir\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:42:29.528891 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528840    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-home\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:42:29.528891 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.528853    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-model-cache\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:42:29.530486 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.530458    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-dshm" (OuterVolumeSpecName: "dshm") pod "d6544117-4204-4a4f-91a5-2ab2c16d1e25" (UID: "d6544117-4204-4a4f-91a5-2ab2c16d1e25"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:42:29.530603 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.530549    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d6544117-4204-4a4f-91a5-2ab2c16d1e25" (UID: "d6544117-4204-4a4f-91a5-2ab2c16d1e25"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:42:29.530835 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.530792    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6544117-4204-4a4f-91a5-2ab2c16d1e25-kube-api-access-hpmf9" (OuterVolumeSpecName: "kube-api-access-hpmf9") pod "d6544117-4204-4a4f-91a5-2ab2c16d1e25" (UID: "d6544117-4204-4a4f-91a5-2ab2c16d1e25"). InnerVolumeSpecName "kube-api-access-hpmf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:42:29.629607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.629580    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpmf9\" (UniqueName: \"kubernetes.io/projected/d6544117-4204-4a4f-91a5-2ab2c16d1e25-kube-api-access-hpmf9\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:42:29.629607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.629605    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d6544117-4204-4a4f-91a5-2ab2c16d1e25-dshm\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:42:29.629755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.629614    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6544117-4204-4a4f-91a5-2ab2c16d1e25-tls-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:42:29.906035 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.905999    2565 generic.go:356] "Generic (PLEG): container finished" podID="d6544117-4204-4a4f-91a5-2ab2c16d1e25" containerID="4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb" exitCode=0
Sep 17 00:42:29.906183 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.906034    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"
Sep 17 00:42:29.906183 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.906058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr" event={"ID":"d6544117-4204-4a4f-91a5-2ab2c16d1e25","Type":"ContainerDied","Data":"4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb"}
Sep 17 00:42:29.906183 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.906097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr" event={"ID":"d6544117-4204-4a4f-91a5-2ab2c16d1e25","Type":"ContainerDied","Data":"80d7b8dadc3d1aab693c4092d91d02a2254bb31bdb0848c5f9e4cb3850a1f0a8"}
Sep 17 00:42:29.906183 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.906113    2565 scope.go:117] "RemoveContainer" containerID="4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb"
Sep 17 00:42:29.915260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.915242    2565 scope.go:117] "RemoveContainer" containerID="4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb"
Sep 17 00:42:29.915529 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:42:29.915510    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb\": container with ID starting with 4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb not found: ID does not exist" containerID="4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb"
Sep 17 00:42:29.915566 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.915539    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb"} err="failed to get container status \"4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb\": rpc error: code = NotFound desc = could not find container \"4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb\": container with ID starting with 4b3f54bbd09da4a149fb8966b58b55d23f5d878b8bd77737074606b8f3f785cb not found: ID does not exist"
Sep 17 00:42:29.927547 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.927522    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"]
Sep 17 00:42:29.929345 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:29.929324    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-47a2db/sub-test-model-47a2db-kserve-86b6f44dc5-wx4fr"]
Sep 17 00:42:31.925701 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:31.925670    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6544117-4204-4a4f-91a5-2ab2c16d1e25" path="/var/lib/kubelet/pods/d6544117-4204-4a4f-91a5-2ab2c16d1e25/volumes"
Sep 17 00:42:43.807219 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.807184    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"]
Sep 17 00:42:43.807663 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.807558    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy"
Sep 17 00:42:43.807663 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.807569    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8147eff5-d245-4a69-a988-51f95ac681e8" containerName="istio-proxy"
Sep 17 00:42:43.807663 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.807586    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy"
Sep 17 00:42:43.807663 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.807592    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy"
Sep 17 00:42:43.807663 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.807601    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6544117-4204-4a4f-91a5-2ab2c16d1e25" containerName="main"
Sep 17 00:42:43.807663 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.807607    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6544117-4204-4a4f-91a5-2ab2c16d1e25" containerName="main"
Sep 17 00:42:43.807984 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.807670    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="87c0feab-a237-489c-98e0-8f17ebd5c1d5" containerName="istio-proxy"
Sep 17 00:42:43.807984 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.807679    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f10b29a-1abb-449e-b669-a901309d8fd5" containerName="istio-proxy"
Sep 17 00:42:43.807984 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.807684    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6544117-4204-4a4f-91a5-2ab2c16d1e25" containerName="main"
Sep 17 00:42:43.810766 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.810749    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:43.814420 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.814398    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-07f9f2\"/\"rate-test-model-07f9f2-kserve-self-signed-certs\""
Sep 17 00:42:43.814541 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.814427    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-07f9f2\"/\"kube-root-ca.crt\""
Sep 17 00:42:43.814541 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.814450    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-07f9f2\"/\"openshift-service-ca.crt\""
Sep 17 00:42:43.814541 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.814405    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-07f9f2\"/\"default-dockercfg-tp66z\""
Sep 17 00:42:43.821871 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.821848    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"]
Sep 17 00:42:43.829524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.829502    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:42:43.969993 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.969959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65hw5\" (UniqueName: \"kubernetes.io/projected/3f0800ac-9807-496d-b4e4-44f065ed638d-kube-api-access-65hw5\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:43.970134 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.970041    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-home\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:43.970134 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.970067    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-tmp-dir\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:43.970134 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.970089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f0800ac-9807-496d-b4e4-44f065ed638d-tls-certs\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:43.970134 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.970108    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-model-cache\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:43.970289 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:43.970156    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-dshm\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.071823 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.071710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-home\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.071997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.071928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-tmp-dir\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.071997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.071966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f0800ac-9807-496d-b4e4-44f065ed638d-tls-certs\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.072124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.071994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-model-cache\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.072124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.072032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-dshm\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.072222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.072145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65hw5\" (UniqueName: \"kubernetes.io/projected/3f0800ac-9807-496d-b4e4-44f065ed638d-kube-api-access-65hw5\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.073049 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.072568    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-tmp-dir\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.073049 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.072912    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-home\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.073991 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.073137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-model-cache\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.075791 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.075724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-dshm\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.076299 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.076274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f0800ac-9807-496d-b4e4-44f065ed638d-tls-certs\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.080187 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.080162    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65hw5\" (UniqueName: \"kubernetes.io/projected/3f0800ac-9807-496d-b4e4-44f065ed638d-kube-api-access-65hw5\") pod \"rate-test-model-07f9f2-kserve-59f5d78bc-9g772\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") " pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.120018 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.119986    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:44.389999 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.389938    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"]
Sep 17 00:42:44.392358 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:42:44.392323    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f0800ac_9807_496d_b4e4_44f065ed638d.slice/crio-4ea73b355af8624d29bcd9dcaa3a25de58928a21c6b31bf24fdd035c34693ad8 WatchSource:0}: Error finding container 4ea73b355af8624d29bcd9dcaa3a25de58928a21c6b31bf24fdd035c34693ad8: Status 404 returned error can't find the container with id 4ea73b355af8624d29bcd9dcaa3a25de58928a21c6b31bf24fdd035c34693ad8
Sep 17 00:42:44.984499 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.984465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772" event={"ID":"3f0800ac-9807-496d-b4e4-44f065ed638d","Type":"ContainerStarted","Data":"bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82"}
Sep 17 00:42:44.984979 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:44.984508    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772" event={"ID":"3f0800ac-9807-496d-b4e4-44f065ed638d","Type":"ContainerStarted","Data":"4ea73b355af8624d29bcd9dcaa3a25de58928a21c6b31bf24fdd035c34693ad8"}
Sep 17 00:42:45.000656 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:45.000613    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772" podStartSLOduration=2.000596842 podStartE2EDuration="2.000596842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:42:44.999513455 +0000 UTC m=+1965.526252948" watchObservedRunningTime="2026-09-17 00:42:45.000596842 +0000 UTC m=+1965.527336357"
Sep 17 00:42:54.120686 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:54.120583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:54.120686 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:54.120651    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:54.133597 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:54.133570    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:42:55.043314 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:42:55.043283    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:43:22.002973 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:22.002932    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:22.894241 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:22.894194    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"]
Sep 17 00:43:22.911498 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:22.911462    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:23.369427 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.369389    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:23.664354 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.664261    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"]
Sep 17 00:43:23.672644 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.672616    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.675657 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.675626    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-eaba37-openshift-default-dockercfg-b7j2c\""
Sep 17 00:43:23.676429 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.676404    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"]
Sep 17 00:43:23.684653 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.684619    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:23.739252 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.739218    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-credential-socket\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.739430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.739329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-certs\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.739430 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.739376    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czmb2\" (UniqueName: \"kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-kube-api-access-czmb2\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.739519 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.739427    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-data\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.739519 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.739464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-socket\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.739519 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.739508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cc93233-c93e-4f6b-937e-15657b1235db-istio-podinfo\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.739663 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.739524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-istio-token\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.739663 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.739581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-envoy\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.739730 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.739681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cc93233-c93e-4f6b-937e-15657b1235db-istiod-ca-cert\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.840903 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.840870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-credential-socket\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.840915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-certs\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.840931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czmb2\" (UniqueName: \"kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-kube-api-access-czmb2\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.840952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-data\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.840976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-socket\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.841029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cc93233-c93e-4f6b-937e-15657b1235db-istio-podinfo\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.841052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-istio-token\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841095 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.841078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-envoy\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841435 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.841115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cc93233-c93e-4f6b-937e-15657b1235db-istiod-ca-cert\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841435 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.841351    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-certs\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841435 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.841394    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-data\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841604 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.841486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-socket\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841705 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.841684    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-credential-socket\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.841924 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.841906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cc93233-c93e-4f6b-937e-15657b1235db-istiod-ca-cert\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.843526 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.843503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cc93233-c93e-4f6b-937e-15657b1235db-istio-podinfo\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.843656 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.843528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-envoy\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.848694 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.848671    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czmb2\" (UniqueName: \"kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-kube-api-access-czmb2\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.849007 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.848989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-istio-token\") pod \"e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") " pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:23.963840 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.963714    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:23.987811 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:23.987773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:24.265302 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:24.265276    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"]
Sep 17 00:43:24.267511 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:43:24.267482    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc93233_c93e_4f6b_937e_15657b1235db.slice/crio-a51b00811dbc2acfe1fd525b9c283abb1e690167c024378505ed7bdaab98a385 WatchSource:0}: Error finding container a51b00811dbc2acfe1fd525b9c283abb1e690167c024378505ed7bdaab98a385: Status 404 returned error can't find the container with id a51b00811dbc2acfe1fd525b9c283abb1e690167c024378505ed7bdaab98a385
Sep 17 00:43:24.269733 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:24.269699    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:43:24.269864 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:24.269779    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:43:24.269864 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:24.269839    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:43:25.184742 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:25.184701    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" event={"ID":"4cc93233-c93e-4f6b-937e-15657b1235db","Type":"ContainerStarted","Data":"4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67"}
Sep 17 00:43:25.185162 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:25.184764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" event={"ID":"4cc93233-c93e-4f6b-937e-15657b1235db","Type":"ContainerStarted","Data":"a51b00811dbc2acfe1fd525b9c283abb1e690167c024378505ed7bdaab98a385"}
Sep 17 00:43:25.204732 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:25.204675    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" podStartSLOduration=2.204655482 podStartE2EDuration="2.204655482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:43:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:43:25.203614643 +0000 UTC m=+2005.730354146" watchObservedRunningTime="2026-09-17 00:43:25.204655482 +0000 UTC m=+2005.731394962"
Sep 17 00:43:25.988028 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:25.987989    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:25.993157 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:25.993129    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:26.190260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:26.190230    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:26.191431 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:26.191413    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:26.946686 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:26.946647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:27.136918 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:27.136878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:27.234153 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:27.234045    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:27.867395 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:27.867355    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:28.606378 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.606344    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"]
Sep 17 00:43:28.611325 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.611296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.613754 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.613729    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-eaba37-serving-cert\""
Sep 17 00:43:28.617922 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.617885    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"]
Sep 17 00:43:28.636396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.636368    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:28.693223 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.693188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-maas-api-tls\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.693391 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.693234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf7vq\" (UniqueName: \"kubernetes.io/projected/261ce033-9e99-45ca-92c4-085d15fcfffa-kube-api-access-tf7vq\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.693391 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.693264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/261ce033-9e99-45ca-92c4-085d15fcfffa-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.693517 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.693408    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-metrics-certs\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.696621 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.696591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:28.794878 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.794841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-metrics-certs\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.795085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.794939    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-maas-api-tls\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.795085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.794970    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf7vq\" (UniqueName: \"kubernetes.io/projected/261ce033-9e99-45ca-92c4-085d15fcfffa-kube-api-access-tf7vq\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.795085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.794996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/261ce033-9e99-45ca-92c4-085d15fcfffa-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.795661 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.795636    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/261ce033-9e99-45ca-92c4-085d15fcfffa-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.797957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.797929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-maas-api-tls\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.798133 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.797950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-metrics-certs\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.802798 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.802771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf7vq\" (UniqueName: \"kubernetes.io/projected/261ce033-9e99-45ca-92c4-085d15fcfffa-kube-api-access-tf7vq\") pod \"maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:28.837985 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.837951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:28.927993 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:28.927884    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:29.086193 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:29.086156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:29.186601 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:29.186523    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:29.198901 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:29.198865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"]
Sep 17 00:43:29.200785 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:43:29.200758    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261ce033_9e99_45ca_92c4_085d15fcfffa.slice/crio-421f8ccd544012a049ac7df6349af12ad77b887ba5a8402677b29aec5b5d3254 WatchSource:0}: Error finding container 421f8ccd544012a049ac7df6349af12ad77b887ba5a8402677b29aec5b5d3254: Status 404 returned error can't find the container with id 421f8ccd544012a049ac7df6349af12ad77b887ba5a8402677b29aec5b5d3254
Sep 17 00:43:29.202205 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:29.202183    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:43:30.213677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:30.213641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8" event={"ID":"261ce033-9e99-45ca-92c4-085d15fcfffa","Type":"ContainerStarted","Data":"32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510"}
Sep 17 00:43:30.214176 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:30.213691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8" event={"ID":"261ce033-9e99-45ca-92c4-085d15fcfffa","Type":"ContainerStarted","Data":"421f8ccd544012a049ac7df6349af12ad77b887ba5a8402677b29aec5b5d3254"}
Sep 17 00:43:30.214176 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:30.213782    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:30.232433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:30.232388    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8" podStartSLOduration=1.707088969 podStartE2EDuration="2.232373356s" totalImagesPullingTime="525.284387ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:43:30.230365945 +0000 UTC m=+2010.757105427" watchObservedRunningTime="2026-09-17 00:43:30.232373356 +0000 UTC m=+2010.759112833"
Sep 17 00:43:36.227679 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:36.227648    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:43:37.924624 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:37.924574    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772" podUID="3f0800ac-9807-496d-b4e4-44f065ed638d" containerName="main" containerID="cri-o://bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82" gracePeriod=45
Sep 17 00:43:38.198436 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.198410    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:43:38.256652 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.256620    2565 generic.go:356] "Generic (PLEG): container finished" podID="3f0800ac-9807-496d-b4e4-44f065ed638d" containerID="bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82" exitCode=0
Sep 17 00:43:38.256652 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.256657    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772" event={"ID":"3f0800ac-9807-496d-b4e4-44f065ed638d","Type":"ContainerDied","Data":"bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82"}
Sep 17 00:43:38.256952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.256670    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"
Sep 17 00:43:38.256952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.256684    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772" event={"ID":"3f0800ac-9807-496d-b4e4-44f065ed638d","Type":"ContainerDied","Data":"4ea73b355af8624d29bcd9dcaa3a25de58928a21c6b31bf24fdd035c34693ad8"}
Sep 17 00:43:38.256952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.256702    2565 scope.go:117] "RemoveContainer" containerID="bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82"
Sep 17 00:43:38.265608 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.265586    2565 scope.go:117] "RemoveContainer" containerID="bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82"
Sep 17 00:43:38.265964 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:43:38.265941    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82\": container with ID starting with bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82 not found: ID does not exist" containerID="bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82"
Sep 17 00:43:38.266064 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.265977    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82"} err="failed to get container status \"bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82\": rpc error: code = NotFound desc = could not find container \"bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82\": container with ID starting with bc974156e9cea1c91e29aaf09f21d6dca66237b138abd38dbe6504711465df82 not found: ID does not exist"
Sep 17 00:43:38.286201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.286174    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f0800ac-9807-496d-b4e4-44f065ed638d-tls-certs\") pod \"3f0800ac-9807-496d-b4e4-44f065ed638d\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") "
Sep 17 00:43:38.286314 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.286209    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65hw5\" (UniqueName: \"kubernetes.io/projected/3f0800ac-9807-496d-b4e4-44f065ed638d-kube-api-access-65hw5\") pod \"3f0800ac-9807-496d-b4e4-44f065ed638d\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") "
Sep 17 00:43:38.286314 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.286238    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-dshm\") pod \"3f0800ac-9807-496d-b4e4-44f065ed638d\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") "
Sep 17 00:43:38.286314 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.286305    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-home\") pod \"3f0800ac-9807-496d-b4e4-44f065ed638d\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") "
Sep 17 00:43:38.286500 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.286330    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-model-cache\") pod \"3f0800ac-9807-496d-b4e4-44f065ed638d\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") "
Sep 17 00:43:38.286500 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.286373    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-tmp-dir\") pod \"3f0800ac-9807-496d-b4e4-44f065ed638d\" (UID: \"3f0800ac-9807-496d-b4e4-44f065ed638d\") "
Sep 17 00:43:38.286630 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.286564    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-home" (OuterVolumeSpecName: "home") pod "3f0800ac-9807-496d-b4e4-44f065ed638d" (UID: "3f0800ac-9807-496d-b4e4-44f065ed638d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:43:38.286710 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.286649    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-model-cache" (OuterVolumeSpecName: "model-cache") pod "3f0800ac-9807-496d-b4e4-44f065ed638d" (UID: "3f0800ac-9807-496d-b4e4-44f065ed638d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:43:38.286762 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.286713    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3f0800ac-9807-496d-b4e4-44f065ed638d" (UID: "3f0800ac-9807-496d-b4e4-44f065ed638d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:43:38.288457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.288434    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f0800ac-9807-496d-b4e4-44f065ed638d-kube-api-access-65hw5" (OuterVolumeSpecName: "kube-api-access-65hw5") pod "3f0800ac-9807-496d-b4e4-44f065ed638d" (UID: "3f0800ac-9807-496d-b4e4-44f065ed638d"). InnerVolumeSpecName "kube-api-access-65hw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:43:38.288457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.288448    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-dshm" (OuterVolumeSpecName: "dshm") pod "3f0800ac-9807-496d-b4e4-44f065ed638d" (UID: "3f0800ac-9807-496d-b4e4-44f065ed638d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:43:38.288583 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.288459    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f0800ac-9807-496d-b4e4-44f065ed638d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3f0800ac-9807-496d-b4e4-44f065ed638d" (UID: "3f0800ac-9807-496d-b4e4-44f065ed638d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:43:38.387164 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.387133    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-model-cache\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:43:38.387164 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.387160    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-tmp-dir\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:43:38.387164 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.387168    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f0800ac-9807-496d-b4e4-44f065ed638d-tls-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:43:38.387164 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.387177    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65hw5\" (UniqueName: \"kubernetes.io/projected/3f0800ac-9807-496d-b4e4-44f065ed638d-kube-api-access-65hw5\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:43:38.387421 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.387186    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-dshm\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:43:38.387421 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.387195    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f0800ac-9807-496d-b4e4-44f065ed638d-home\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:43:38.578917 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.578872    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"]
Sep 17 00:43:38.581661 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:38.581636    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-07f9f2/rate-test-model-07f9f2-kserve-59f5d78bc-9g772"]
Sep 17 00:43:39.931003 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:39.930966    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f0800ac-9807-496d-b4e4-44f065ed638d" path="/var/lib/kubelet/pods/3f0800ac-9807-496d-b4e4-44f065ed638d/volumes"
Sep 17 00:43:42.232007 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:42.231956    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 00:43:42.232535 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:42.232039    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 00:43:44.290766 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:44.290683    2565 generic.go:356] "Generic (PLEG): container finished" podID="4cc93233-c93e-4f6b-937e-15657b1235db" containerID="4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67" exitCode=0
Sep 17 00:43:44.291164 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:44.290765    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" event={"ID":"4cc93233-c93e-4f6b-937e-15657b1235db","Type":"ContainerDied","Data":"4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67"}
Sep 17 00:43:44.291211 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:44.291188    2565 scope.go:117] "RemoveContainer" containerID="4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67"
Sep 17 00:43:44.292218 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:44.292192    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:43:44.292275 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:44.292257    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:43:44.292321 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:44.292288    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:43:45.297998 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:45.297962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" event={"ID":"4cc93233-c93e-4f6b-937e-15657b1235db","Type":"ContainerStarted","Data":"09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11"}
Sep 17 00:43:45.988124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:45.988083    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:45.988336 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:45.988252    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 17 00:43:45.988336 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:45.988307    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 17 00:43:46.988434 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:46.988398    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 17 00:43:46.988836 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:46.988466    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 17 00:43:47.988729 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:47.988690    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 17 00:43:47.989197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:47.988761    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 17 00:43:48.988350 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:48.988313    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 17 00:43:48.988528 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:48.988370    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 17 00:43:49.988566 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:49.988530    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 17 00:43:49.988980 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:49.988584    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 17 00:43:50.517524 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:50.517487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:50.991794 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:50.991753    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:50.992185 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:50.992032    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:50.992616 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:50.992596    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:43:51.161201 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:51.161168    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:51.816289 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:51.816258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:52.158682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:52.158592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:52.535007 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:52.534918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:52.900120 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:52.900085    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:53.203470 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.203375    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"]
Sep 17 00:43:53.204364 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.204336    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f0800ac-9807-496d-b4e4-44f065ed638d" containerName="main"
Sep 17 00:43:53.204448 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.204368    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f0800ac-9807-496d-b4e4-44f065ed638d" containerName="main"
Sep 17 00:43:53.204613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.204598    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f0800ac-9807-496d-b4e4-44f065ed638d" containerName="main"
Sep 17 00:43:53.209081 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.209053    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.212299 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.212239    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-a8402d-openshift-default-dockercfg-x9dhp\""
Sep 17 00:43:53.217371 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.217346    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"]
Sep 17 00:43:53.229431 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.229329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:53.241276 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.241236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-data\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.241417 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.241279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-istio-token\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.241417 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.241357    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-certs\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.241417 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.241384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224438ed-93ee-477c-9934-0b16c1be65c1-istio-podinfo\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.241417 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.241410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/224438ed-93ee-477c-9934-0b16c1be65c1-istiod-ca-cert\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.241640 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.241435    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwgpc\" (UniqueName: \"kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-kube-api-access-kwgpc\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.241640 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.241499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-envoy\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.241640 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.241533    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-socket\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.241640 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.241582    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-credential-socket\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.342961 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.342925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-data\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.342961 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.342960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-istio-token\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343186 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343006    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-certs\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343186 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224438ed-93ee-477c-9934-0b16c1be65c1-istio-podinfo\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343186 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/224438ed-93ee-477c-9934-0b16c1be65c1-istiod-ca-cert\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343186 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343058    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwgpc\" (UniqueName: \"kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-kube-api-access-kwgpc\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343394 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343242    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-envoy\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343394 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343305    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-socket\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343394 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-data\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343394 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343374    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-credential-socket\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343580 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-certs\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343643 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-socket\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343721 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343699    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-credential-socket\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.343783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.343757    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/224438ed-93ee-477c-9934-0b16c1be65c1-istiod-ca-cert\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.345840 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.345778    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-envoy\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.346414 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.346392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224438ed-93ee-477c-9934-0b16c1be65c1-istio-podinfo\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.352001 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.351979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-istio-token\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.352082 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.352067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwgpc\" (UniqueName: \"kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-kube-api-access-kwgpc\") pod \"e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") " pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.377855 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.377820    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:53.523272 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.523175    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:53.804723 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.804690    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"]
Sep 17 00:43:53.807315 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:43:53.807291    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224438ed_93ee_477c_9934_0b16c1be65c1.slice/crio-0aae4de69302b8590570dc2afd53862f3e41e5baab3bf8e00c5f2e341eaff527 WatchSource:0}: Error finding container 0aae4de69302b8590570dc2afd53862f3e41e5baab3bf8e00c5f2e341eaff527: Status 404 returned error can't find the container with id 0aae4de69302b8590570dc2afd53862f3e41e5baab3bf8e00c5f2e341eaff527
Sep 17 00:43:53.809647 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.809611    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:43:53.809751 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.809695    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:43:53.809751 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:53.809741    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:43:54.356000 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:54.355956    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" event={"ID":"224438ed-93ee-477c-9934-0b16c1be65c1","Type":"ContainerStarted","Data":"a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c"}
Sep 17 00:43:54.356472 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:54.356007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" event={"ID":"224438ed-93ee-477c-9934-0b16c1be65c1","Type":"ContainerStarted","Data":"0aae4de69302b8590570dc2afd53862f3e41e5baab3bf8e00c5f2e341eaff527"}
Sep 17 00:43:54.375752 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:54.375696    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" podStartSLOduration=1.375676701 podStartE2EDuration="1.375676701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:43:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:43:54.373982156 +0000 UTC m=+2034.900721658" watchObservedRunningTime="2026-09-17 00:43:54.375676701 +0000 UTC m=+2034.902416183"
Sep 17 00:43:54.523757 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:54.523722    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:54.528932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:54.528907    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:55.361332 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:55.361293    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:55.362334 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:55.362317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:43:55.709011 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:55.708906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:56.332791 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:56.332753    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:56.430160 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:56.430123    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:57.231908 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:57.231867    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:58.111453 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:58.111393    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:58.740679 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:58.740631    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:58.794664 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:58.794629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:58.922028 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:58.921997    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:59.188990 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.188951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:59.283765 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.283721    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:43:59.290214 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.290186    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"]
Sep 17 00:43:59.293183 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.293162    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:43:59.295795 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.295775    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-a8402d\""
Sep 17 00:43:59.295953 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.295933    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-a8402d-dockercfg-b4c7x\""
Sep 17 00:43:59.304671 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.304642    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"]
Sep 17 00:43:59.327705 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.327681    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"]
Sep 17 00:43:59.330103 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.330083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:43:59.340136 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.340116    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"]
Sep 17 00:43:59.404254 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.404206    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn4m6\" (UniqueName: \"kubernetes.io/projected/d23ea127-8000-4628-a2e1-92ded24ea115-kube-api-access-qn4m6\") pod \"payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6\" (UID: \"d23ea127-8000-4628-a2e1-92ded24ea115\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:43:59.404446 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.404380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23ea127-8000-4628-a2e1-92ded24ea115-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6\" (UID: \"d23ea127-8000-4628-a2e1-92ded24ea115\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:43:59.404513 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.404442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrlzk\" (UniqueName: \"kubernetes.io/projected/dc4f085d-2a48-467b-89af-c2e42e34eb8d-kube-api-access-vrlzk\") pod \"payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql\" (UID: \"dc4f085d-2a48-467b-89af-c2e42e34eb8d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:43:59.404513 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.404480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc4f085d-2a48-467b-89af-c2e42e34eb8d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql\" (UID: \"dc4f085d-2a48-467b-89af-c2e42e34eb8d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:43:59.505669 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.505572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23ea127-8000-4628-a2e1-92ded24ea115-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6\" (UID: \"d23ea127-8000-4628-a2e1-92ded24ea115\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:43:59.505669 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.505645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrlzk\" (UniqueName: \"kubernetes.io/projected/dc4f085d-2a48-467b-89af-c2e42e34eb8d-kube-api-access-vrlzk\") pod \"payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql\" (UID: \"dc4f085d-2a48-467b-89af-c2e42e34eb8d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:43:59.505919 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.505693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc4f085d-2a48-467b-89af-c2e42e34eb8d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql\" (UID: \"dc4f085d-2a48-467b-89af-c2e42e34eb8d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:43:59.505919 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.505726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn4m6\" (UniqueName: \"kubernetes.io/projected/d23ea127-8000-4628-a2e1-92ded24ea115-kube-api-access-qn4m6\") pod \"payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6\" (UID: \"d23ea127-8000-4628-a2e1-92ded24ea115\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:43:59.506322 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.506302    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23ea127-8000-4628-a2e1-92ded24ea115-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6\" (UID: \"d23ea127-8000-4628-a2e1-92ded24ea115\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:43:59.506469 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.506451    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc4f085d-2a48-467b-89af-c2e42e34eb8d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql\" (UID: \"dc4f085d-2a48-467b-89af-c2e42e34eb8d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:43:59.513108 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.513074    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn4m6\" (UniqueName: \"kubernetes.io/projected/d23ea127-8000-4628-a2e1-92ded24ea115-kube-api-access-qn4m6\") pod \"payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6\" (UID: \"d23ea127-8000-4628-a2e1-92ded24ea115\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:43:59.513222 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.513133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrlzk\" (UniqueName: \"kubernetes.io/projected/dc4f085d-2a48-467b-89af-c2e42e34eb8d-kube-api-access-vrlzk\") pod \"payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql\" (UID: \"dc4f085d-2a48-467b-89af-c2e42e34eb8d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:43:59.605169 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.605134    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:43:59.641293 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.641265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:43:59.879449 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.879422    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"]
Sep 17 00:43:59.880117 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:43:59.880091    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4f085d_2a48_467b_89af_c2e42e34eb8d.slice/crio-01fc07302da96e7254be33ddc21baba89d0c0fd9e64952dcaa7c7a2dcef2e39f WatchSource:0}: Error finding container 01fc07302da96e7254be33ddc21baba89d0c0fd9e64952dcaa7c7a2dcef2e39f: Status 404 returned error can't find the container with id 01fc07302da96e7254be33ddc21baba89d0c0fd9e64952dcaa7c7a2dcef2e39f
Sep 17 00:43:59.927813 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:43:59.927778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"]
Sep 17 00:43:59.930817 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:43:59.930779    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd23ea127_8000_4628_a2e1_92ded24ea115.slice/crio-051055b235035b56422a1b36cf9f9fbdb95f0c1e881f40e739389228e6dc4d71 WatchSource:0}: Error finding container 051055b235035b56422a1b36cf9f9fbdb95f0c1e881f40e739389228e6dc4d71: Status 404 returned error can't find the container with id 051055b235035b56422a1b36cf9f9fbdb95f0c1e881f40e739389228e6dc4d71
Sep 17 00:44:00.393939 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:00.393899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql" event={"ID":"dc4f085d-2a48-467b-89af-c2e42e34eb8d","Type":"ContainerStarted","Data":"2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2"}
Sep 17 00:44:00.394413 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:00.393965    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:44:00.394413 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:00.393989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql" event={"ID":"dc4f085d-2a48-467b-89af-c2e42e34eb8d","Type":"ContainerStarted","Data":"01fc07302da96e7254be33ddc21baba89d0c0fd9e64952dcaa7c7a2dcef2e39f"}
Sep 17 00:44:00.395545 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:00.395521    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6" event={"ID":"d23ea127-8000-4628-a2e1-92ded24ea115","Type":"ContainerStarted","Data":"f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319"}
Sep 17 00:44:00.395620 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:00.395565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6" event={"ID":"d23ea127-8000-4628-a2e1-92ded24ea115","Type":"ContainerStarted","Data":"051055b235035b56422a1b36cf9f9fbdb95f0c1e881f40e739389228e6dc4d71"}
Sep 17 00:44:00.395675 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:00.395618    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:44:00.411579 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:00.411517    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql" podStartSLOduration=1.411493719 podStartE2EDuration="1.411493719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:43:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:44:00.408498983 +0000 UTC m=+2040.935238462" watchObservedRunningTime="2026-09-17 00:44:00.411493719 +0000 UTC m=+2040.938233197"
Sep 17 00:44:00.424821 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:00.424748    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6" podStartSLOduration=1.424730018 podStartE2EDuration="1.424730018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:43:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:44:00.423840139 +0000 UTC m=+2040.950579642" watchObservedRunningTime="2026-09-17 00:44:00.424730018 +0000 UTC m=+2040.951469496"
Sep 17 00:44:11.402564 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:11.402527    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:44:11.403031 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:11.402629    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:44:14.485682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:14.485580    2565 generic.go:356] "Generic (PLEG): container finished" podID="224438ed-93ee-477c-9934-0b16c1be65c1" containerID="a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c" exitCode=0
Sep 17 00:44:14.485682 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:14.485628    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" event={"ID":"224438ed-93ee-477c-9934-0b16c1be65c1","Type":"ContainerDied","Data":"a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c"}
Sep 17 00:44:14.486152 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:14.486047    2565 scope.go:117] "RemoveContainer" containerID="a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c"
Sep 17 00:44:14.487137 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:14.487105    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:44:14.487197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:14.487185    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:44:14.487234 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:14.487221    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:44:15.492865 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:15.492828    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" event={"ID":"224438ed-93ee-477c-9934-0b16c1be65c1","Type":"ContainerStarted","Data":"17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155"}
Sep 17 00:44:15.523717 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:15.523670    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:44:15.524159 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:15.524125    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 17 00:44:15.524269 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:15.524188    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 17 00:44:16.524444 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:16.524402    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 17 00:44:16.525065 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:16.525029    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 17 00:44:17.524300 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:17.524259    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 17 00:44:17.524520 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:17.524345    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 17 00:44:18.524195 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:18.524157    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 17 00:44:18.524497 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:18.524469    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 17 00:44:19.524546 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:19.524498    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 17 00:44:19.525081 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:19.524580    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 17 00:44:20.524156 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:20.524107    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 17 00:44:20.524380 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:20.524183    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 17 00:44:20.607634 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:20.607587    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:44:21.335135 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:21.335091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:44:21.528243 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:21.528208    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:44:21.528580 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:21.528551    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:44:21.529495 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:21.529472    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:44:21.531460 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:21.531431    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:44:22.017020 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:22.016981    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:44:22.791983 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:22.791939    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:44:23.427433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:23.427395    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:44:26.174450 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:26.174406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:44:27.084613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:27.084549    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-4wlhv_a125c8de-812e-4c55-88bb-43ef7857b91e/payload-processing/0.log"
Sep 17 00:44:27.210984 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:27.210953    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6_d23ea127-8000-4628-a2e1-92ded24ea115/payload-processing/0.log"
Sep 17 00:44:31.084293 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:31.084257    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:44:42.998591 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:42.998554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:44:55.819960 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:44:55.819925    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:01.059160 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:01.059126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:05.791167 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:05.791139    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:45:05.801481 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:05.801461    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:45:13.834501 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:13.834465    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-4wlhv_a125c8de-812e-4c55-88bb-43ef7857b91e/payload-processing/0.log"
Sep 17 00:45:13.963732 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:13.963706    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6_d23ea127-8000-4628-a2e1-92ded24ea115/payload-processing/0.log"
Sep 17 00:45:14.090876 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.090779    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6_d23ea127-8000-4628-a2e1-92ded24ea115/payload-processing/0.log"
Sep 17 00:45:14.374914 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.374828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:14.648144 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.648058    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"]
Sep 17 00:45:14.650889 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.650860    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.653827 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.653778    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-cfebd7-openshift-default-dockercfg-r5cvh\""
Sep 17 00:45:14.662956 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.662933    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"]
Sep 17 00:45:14.673503 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.673475    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:14.783935 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.783889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-token\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.784208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.783953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-socket\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.784208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.784064    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv24c\" (UniqueName: \"kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-kube-api-access-mv24c\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.784208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.784117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-certs\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.784208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.784144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-envoy\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.784208 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.784196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-credential-socket\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.784476 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.784258    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-data\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.784476 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.784321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.784476 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.784372    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-podinfo\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.885534 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.885505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-data\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.885955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.885552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.885955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.885599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-podinfo\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.885955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.885797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-token\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.885955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.885868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-socket\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.885955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.885948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv24c\" (UniqueName: \"kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-kube-api-access-mv24c\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.885955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.885952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-data\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.886288 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.886001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-certs\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.886288 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.886031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-envoy\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.886288 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.886188    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-socket\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.886454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.886311    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-credential-socket\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.886454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.886338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.886454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.886344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-certs\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.886613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.886595    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-credential-socket\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.888123 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.888101    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-envoy\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.888271 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.888253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-podinfo\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.893825 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.893776    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-token\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.893978 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.893960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv24c\" (UniqueName: \"kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-kube-api-access-mv24c\") pod \"e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") " pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:14.963918 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:14.963838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:15.158169 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:15.158133    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:15.242767 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:15.242742    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"]
Sep 17 00:45:15.244604 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:45:15.244570    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d0a488_72e9_4fb5_a5ec_8d2ea01ea68a.slice/crio-e2b9b3b714c1594a973cc6da8fbcf751c16249870ab7c737b9ae870fdc844217 WatchSource:0}: Error finding container e2b9b3b714c1594a973cc6da8fbcf751c16249870ab7c737b9ae870fdc844217: Status 404 returned error can't find the container with id e2b9b3b714c1594a973cc6da8fbcf751c16249870ab7c737b9ae870fdc844217
Sep 17 00:45:15.247402 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:15.247370    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:45:15.247503 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:15.247449    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:45:15.247503 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:15.247494    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:45:15.827860 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:15.827791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" event={"ID":"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a","Type":"ContainerStarted","Data":"3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb"}
Sep 17 00:45:15.828034 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:15.827877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" event={"ID":"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a","Type":"ContainerStarted","Data":"e2b9b3b714c1594a973cc6da8fbcf751c16249870ab7c737b9ae870fdc844217"}
Sep 17 00:45:15.847049 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:15.846991    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" podStartSLOduration=1.846971352 podStartE2EDuration="1.846971352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:45:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:45:15.84566867 +0000 UTC m=+2116.372408147" watchObservedRunningTime="2026-09-17 00:45:15.846971352 +0000 UTC m=+2116.373710830"
Sep 17 00:45:15.964196 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:15.964158    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:16.970067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:16.970036    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:17.046453 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:17.046418    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:17.825624 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:17.825576    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:17.838875 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:17.838838    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:17.839879 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:17.839857    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:17.915711 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:17.915679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:18.661772 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:18.661740    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:19.446975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:19.446936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:20.119270 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:20.119231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:20.770504 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:20.770470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:20.872784 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:20.872744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:20.973379 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:20.973336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:21.207098 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:21.207067    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:21.326279 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:21.326231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:33.879986 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:33.879938    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 00:45:33.880410 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:33.880011    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 00:45:34.536305 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:34.536260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:35.951391 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:35.951356    2565 generic.go:356] "Generic (PLEG): container finished" podID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerID="3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb" exitCode=0
Sep 17 00:45:35.951391 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:35.951392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" event={"ID":"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a","Type":"ContainerDied","Data":"3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb"}
Sep 17 00:45:35.951905 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:35.951776    2565 scope.go:117] "RemoveContainer" containerID="3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb"
Sep 17 00:45:35.952972 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:35.952944    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:45:35.953036 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:35.953012    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:45:35.953080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:35.953047    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:45:36.958787 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:36.958748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" event={"ID":"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a","Type":"ContainerStarted","Data":"e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529"}
Sep 17 00:45:36.964397 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:36.964375    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:37.964472 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:37.964436    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 17 00:45:37.964871 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:37.964502    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 17 00:45:38.965162 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:38.965121    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 17 00:45:38.965645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:38.965189    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 17 00:45:39.964775 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:39.964740    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 17 00:45:39.964975 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:39.964832    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 17 00:45:40.965194 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:40.965159    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 17 00:45:40.965674 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:40.965219    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 17 00:45:41.965143 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:41.965108    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused" start-of-body=
Sep 17 00:45:41.965328 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:41.965164    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.87:15021/healthz/ready\": dial tcp 10.134.0.87:15021: connect: connection refused"
Sep 17 00:45:42.751183 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:42.751148    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:42.968087 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:42.968059    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:42.968453 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:42.968352    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:42.968900 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:42.968883    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:45:44.325170 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:44.325136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:44.873024 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:44.872983    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:45.527160 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:45.527115    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:46.330559 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:46.330527    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:46.951002 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:46.950966    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:47.634580 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:47.634543    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:49.233706 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:49.233671    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:49.777473 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:49.777431    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:49.875469 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:49.875429    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:49.953044 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:49.953012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:50.006477 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:50.006421    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:50.305407 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:50.305364    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:50.424028 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:50.423986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:51.036702 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:51.036665    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:51.137048 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:51.137015    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:51.714934 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:51.714899    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:52.535618 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:52.535531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:53.170526 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:53.170490    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:55.947492 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:55.947456    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:56.003211 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:56.003156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:56.196655 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:56.196622    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"]
Sep 17 00:45:56.196879 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:56.196851    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy" containerID="cri-o://e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529" gracePeriod=30
Sep 17 00:45:56.212284 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:56.212210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:45:57.970768 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:57.970727    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 17 00:45:57.971174 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:45:57.970794    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:46:00.831015 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:00.830973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:01.444505 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.444481    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:46:01.455634 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.455605    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:01.465153 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465081    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-certs\") pod \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") "
Sep 17 00:46:01.465342 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465323    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-data\") pod \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") "
Sep 17 00:46:01.465461 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465387    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istiod-ca-cert\") pod \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") "
Sep 17 00:46:01.465461 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465432    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-socket\") pod \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") "
Sep 17 00:46:01.465584 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465450    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" (UID: "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:46:01.465584 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465504    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv24c\" (UniqueName: \"kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-kube-api-access-mv24c\") pod \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") "
Sep 17 00:46:01.465584 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465548    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-envoy\") pod \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") "
Sep 17 00:46:01.465744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465586    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-podinfo\") pod \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") "
Sep 17 00:46:01.465744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465606    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" (UID: "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:46:01.465744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465614    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-credential-socket\") pod \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") "
Sep 17 00:46:01.465744 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465712    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-token\") pod \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\" (UID: \"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a\") "
Sep 17 00:46:01.466036 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465771    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" (UID: "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:46:01.466036 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465825    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" (UID: "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:46:01.466036 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.465863    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" (UID: "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:46:01.466179 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.466165    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:01.466237 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.466186    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:01.466237 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.466199    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:01.466237 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.466213    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:01.466237 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.466229    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:01.468318 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.468289    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-kube-api-access-mv24c" (OuterVolumeSpecName: "kube-api-access-mv24c") pod "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" (UID: "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a"). InnerVolumeSpecName "kube-api-access-mv24c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:46:01.469008 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.468982    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" (UID: "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:46:01.469212 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.469174    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" (UID: "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:46:01.469460 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.469441    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" (UID: "c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:46:01.567060 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.567024    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv24c\" (UniqueName: \"kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-kube-api-access-mv24c\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:01.567060 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.567056    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:01.567060 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.567066    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:01.567321 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:01.567074    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:02.094309 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.094273    2565 generic.go:356] "Generic (PLEG): container finished" podID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerID="e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529" exitCode=0
Sep 17 00:46:02.094755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.094322    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"
Sep 17 00:46:02.094755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.094335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" event={"ID":"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a","Type":"ContainerDied","Data":"e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529"}
Sep 17 00:46:02.094755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.094384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr" event={"ID":"c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a","Type":"ContainerDied","Data":"e2b9b3b714c1594a973cc6da8fbcf751c16249870ab7c737b9ae870fdc844217"}
Sep 17 00:46:02.094755 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.094410    2565 scope.go:117] "RemoveContainer" containerID="e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529"
Sep 17 00:46:02.105645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.105626    2565 scope.go:117] "RemoveContainer" containerID="3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb"
Sep 17 00:46:02.114124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.114096    2565 scope.go:117] "RemoveContainer" containerID="e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529"
Sep 17 00:46:02.114415 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:46:02.114395    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529\": container with ID starting with e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529 not found: ID does not exist" containerID="e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529"
Sep 17 00:46:02.114475 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.114427    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529"} err="failed to get container status \"e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529\": rpc error: code = NotFound desc = could not find container \"e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529\": container with ID starting with e995356200361eb5490086da07e723cb800c816d26581a3b1701b716c61f3529 not found: ID does not exist"
Sep 17 00:46:02.114475 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.114448    2565 scope.go:117] "RemoveContainer" containerID="3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb"
Sep 17 00:46:02.114697 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:46:02.114682    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb\": container with ID starting with 3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb not found: ID does not exist" containerID="3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb"
Sep 17 00:46:02.114740 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.114700    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb"} err="failed to get container status \"3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb\": rpc error: code = NotFound desc = could not find container \"3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb\": container with ID starting with 3c5e49480baa20db28ee4693dcd0551cf21f1e1976998c0136071f38ed5b84fb not found: ID does not exist"
Sep 17 00:46:02.114941 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.114922    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"]
Sep 17 00:46:02.118692 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.118667    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:02.119628 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.119611    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cfebd7-openshift-default-769d576446-nt2cr"]
Sep 17 00:46:02.822024 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:02.821987    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:03.607165 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:03.607117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:03.926409 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:03.926328    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" path="/var/lib/kubelet/pods/c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a/volumes"
Sep 17 00:46:13.225877 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:13.225834    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:13.326984 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:13.326937    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:15.417197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.417162    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"]
Sep 17 00:46:15.417658 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.417421    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8" podUID="261ce033-9e99-45ca-92c4-085d15fcfffa" containerName="maas-api" containerID="cri-o://32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510" gracePeriod=30
Sep 17 00:46:15.449516 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.449488    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:15.514537 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.513822    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:15.570011 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.569977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:15.627210 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.627158    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:15.679255 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.679192    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:46:15.680277 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.680253    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:15.812895 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.812864    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/261ce033-9e99-45ca-92c4-085d15fcfffa-openshift-service-ca\") pod \"261ce033-9e99-45ca-92c4-085d15fcfffa\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") "
Sep 17 00:46:15.813073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.812924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf7vq\" (UniqueName: \"kubernetes.io/projected/261ce033-9e99-45ca-92c4-085d15fcfffa-kube-api-access-tf7vq\") pod \"261ce033-9e99-45ca-92c4-085d15fcfffa\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") "
Sep 17 00:46:15.813073 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.812952    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-metrics-certs\") pod \"261ce033-9e99-45ca-92c4-085d15fcfffa\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") "
Sep 17 00:46:15.813177 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.813064    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-maas-api-tls\") pod \"261ce033-9e99-45ca-92c4-085d15fcfffa\" (UID: \"261ce033-9e99-45ca-92c4-085d15fcfffa\") "
Sep 17 00:46:15.813340 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.813310    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/261ce033-9e99-45ca-92c4-085d15fcfffa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "261ce033-9e99-45ca-92c4-085d15fcfffa" (UID: "261ce033-9e99-45ca-92c4-085d15fcfffa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:46:15.813579 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.813554    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/261ce033-9e99-45ca-92c4-085d15fcfffa-openshift-service-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:15.815103 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.815073    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "261ce033-9e99-45ca-92c4-085d15fcfffa" (UID: "261ce033-9e99-45ca-92c4-085d15fcfffa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:46:15.815197 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.815148    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/261ce033-9e99-45ca-92c4-085d15fcfffa-kube-api-access-tf7vq" (OuterVolumeSpecName: "kube-api-access-tf7vq") pod "261ce033-9e99-45ca-92c4-085d15fcfffa" (UID: "261ce033-9e99-45ca-92c4-085d15fcfffa"). InnerVolumeSpecName "kube-api-access-tf7vq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:46:15.815483 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.815456    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "261ce033-9e99-45ca-92c4-085d15fcfffa" (UID: "261ce033-9e99-45ca-92c4-085d15fcfffa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:46:15.914965 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.914933    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf7vq\" (UniqueName: \"kubernetes.io/projected/261ce033-9e99-45ca-92c4-085d15fcfffa-kube-api-access-tf7vq\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:15.914965 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.914963    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-metrics-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:15.915194 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:15.914976    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/261ce033-9e99-45ca-92c4-085d15fcfffa-maas-api-tls\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:46:16.084973 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.084937    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:16.171952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.171917    2565 generic.go:356] "Generic (PLEG): container finished" podID="261ce033-9e99-45ca-92c4-085d15fcfffa" containerID="32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510" exitCode=0
Sep 17 00:46:16.171952 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.171955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8" event={"ID":"261ce033-9e99-45ca-92c4-085d15fcfffa","Type":"ContainerDied","Data":"32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510"}
Sep 17 00:46:16.172181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.171967    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"
Sep 17 00:46:16.172181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.171999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8" event={"ID":"261ce033-9e99-45ca-92c4-085d15fcfffa","Type":"ContainerDied","Data":"421f8ccd544012a049ac7df6349af12ad77b887ba5a8402677b29aec5b5d3254"}
Sep 17 00:46:16.172181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.172021    2565 scope.go:117] "RemoveContainer" containerID="32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510"
Sep 17 00:46:16.181749 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.181729    2565 scope.go:117] "RemoveContainer" containerID="32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510"
Sep 17 00:46:16.182066 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:46:16.182045    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510\": container with ID starting with 32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510 not found: ID does not exist" containerID="32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510"
Sep 17 00:46:16.182113 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.182074    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510"} err="failed to get container status \"32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510\": rpc error: code = NotFound desc = could not find container \"32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510\": container with ID starting with 32ccbecadd83825dacad5bf08cb8d6e1c669b8e14d0576f45ac213b69cb37510 not found: ID does not exist"
Sep 17 00:46:16.186916 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.186850    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:16.188773 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.188748    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"]
Sep 17 00:46:16.190929 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.190907    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-eaba37-7d775fb575-kwzp8"]
Sep 17 00:46:16.827614 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:16.827579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:17.449562 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:17.449521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:17.926661 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:17.926625    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="261ce033-9e99-45ca-92c4-085d15fcfffa" path="/var/lib/kubelet/pods/261ce033-9e99-45ca-92c4-085d15fcfffa/volumes"
Sep 17 00:46:18.076240 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:18.076200    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:21.088931 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:21.088893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:22.147092 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:22.147039    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:22.203218 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:22.203180    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:57.128439 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:57.128400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:46:57.858078 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:46:57.858043    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:03.472502 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:03.472450    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:03.574294 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:03.574243    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:03.735420 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:03.735332    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"]
Sep 17 00:47:03.735669 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:03.735616    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy" containerID="cri-o://09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11" gracePeriod=30
Sep 17 00:47:03.770340 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:03.770310    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:04.248144 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:04.248095    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:05.013577 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:05.013536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:05.632145 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:05.632113    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:05.994680 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:05.994600    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 00:47:05.994842 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:05.994673    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:47:06.319248 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:06.319216    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:07.025511 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:07.025477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:08.993854 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:08.993825    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:47:09.026792 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.026727    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czmb2\" (UniqueName: \"kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-kube-api-access-czmb2\") pod \"4cc93233-c93e-4f6b-937e-15657b1235db\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") "
Sep 17 00:47:09.026792 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.026765    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cc93233-c93e-4f6b-937e-15657b1235db-istiod-ca-cert\") pod \"4cc93233-c93e-4f6b-937e-15657b1235db\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") "
Sep 17 00:47:09.026792 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.026816    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-certs\") pod \"4cc93233-c93e-4f6b-937e-15657b1235db\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") "
Sep 17 00:47:09.027085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.026843    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-socket\") pod \"4cc93233-c93e-4f6b-937e-15657b1235db\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") "
Sep 17 00:47:09.027085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.026945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-istio-token\") pod \"4cc93233-c93e-4f6b-937e-15657b1235db\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") "
Sep 17 00:47:09.027085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027012    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-envoy\") pod \"4cc93233-c93e-4f6b-937e-15657b1235db\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") "
Sep 17 00:47:09.027085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027072    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cc93233-c93e-4f6b-937e-15657b1235db-istio-podinfo\") pod \"4cc93233-c93e-4f6b-937e-15657b1235db\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") "
Sep 17 00:47:09.027300 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027138    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-credential-socket\") pod \"4cc93233-c93e-4f6b-937e-15657b1235db\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") "
Sep 17 00:47:09.027300 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027156    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cc93233-c93e-4f6b-937e-15657b1235db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4cc93233-c93e-4f6b-937e-15657b1235db" (UID: "4cc93233-c93e-4f6b-937e-15657b1235db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:09.027300 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027178    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-data\") pod \"4cc93233-c93e-4f6b-937e-15657b1235db\" (UID: \"4cc93233-c93e-4f6b-937e-15657b1235db\") "
Sep 17 00:47:09.027480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027159    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4cc93233-c93e-4f6b-937e-15657b1235db" (UID: "4cc93233-c93e-4f6b-937e-15657b1235db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:09.027480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027341    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4cc93233-c93e-4f6b-937e-15657b1235db" (UID: "4cc93233-c93e-4f6b-937e-15657b1235db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:09.027480 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027085    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4cc93233-c93e-4f6b-937e-15657b1235db" (UID: "4cc93233-c93e-4f6b-937e-15657b1235db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:09.027638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027484    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-data" (OuterVolumeSpecName: "istio-data") pod "4cc93233-c93e-4f6b-937e-15657b1235db" (UID: "4cc93233-c93e-4f6b-937e-15657b1235db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:09.027638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027600    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:09.027638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027617    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:09.027638 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027633    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cc93233-c93e-4f6b-937e-15657b1235db-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:09.027879 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027645    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:09.027879 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.027660    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:09.029187 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.029160    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-kube-api-access-czmb2" (OuterVolumeSpecName: "kube-api-access-czmb2") pod "4cc93233-c93e-4f6b-937e-15657b1235db" (UID: "4cc93233-c93e-4f6b-937e-15657b1235db"). InnerVolumeSpecName "kube-api-access-czmb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:09.029297 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.029205    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4cc93233-c93e-4f6b-937e-15657b1235db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4cc93233-c93e-4f6b-937e-15657b1235db" (UID: "4cc93233-c93e-4f6b-937e-15657b1235db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:47:09.029442 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.029426    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-istio-token" (OuterVolumeSpecName: "istio-token") pod "4cc93233-c93e-4f6b-937e-15657b1235db" (UID: "4cc93233-c93e-4f6b-937e-15657b1235db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:09.029531 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.029516    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4cc93233-c93e-4f6b-937e-15657b1235db" (UID: "4cc93233-c93e-4f6b-937e-15657b1235db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:09.128181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.128150    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czmb2\" (UniqueName: \"kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-kube-api-access-czmb2\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:09.128181 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.128180    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cc93233-c93e-4f6b-937e-15657b1235db-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:09.128366 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.128192    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cc93233-c93e-4f6b-937e-15657b1235db-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:09.128366 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.128200    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cc93233-c93e-4f6b-937e-15657b1235db-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:09.455274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.455240    2565 generic.go:356] "Generic (PLEG): container finished" podID="4cc93233-c93e-4f6b-937e-15657b1235db" containerID="09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11" exitCode=0
Sep 17 00:47:09.455452 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.455289    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"
Sep 17 00:47:09.455452 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.455307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" event={"ID":"4cc93233-c93e-4f6b-937e-15657b1235db","Type":"ContainerDied","Data":"09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11"}
Sep 17 00:47:09.455452 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.455349    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8" event={"ID":"4cc93233-c93e-4f6b-937e-15657b1235db","Type":"ContainerDied","Data":"a51b00811dbc2acfe1fd525b9c283abb1e690167c024378505ed7bdaab98a385"}
Sep 17 00:47:09.455452 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.455372    2565 scope.go:117] "RemoveContainer" containerID="09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11"
Sep 17 00:47:09.465126 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.465110    2565 scope.go:117] "RemoveContainer" containerID="4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67"
Sep 17 00:47:09.473124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.473106    2565 scope.go:117] "RemoveContainer" containerID="09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11"
Sep 17 00:47:09.473397 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:47:09.473375    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11\": container with ID starting with 09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11 not found: ID does not exist" containerID="09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11"
Sep 17 00:47:09.473447 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.473407    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11"} err="failed to get container status \"09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11\": rpc error: code = NotFound desc = could not find container \"09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11\": container with ID starting with 09eabf8f014e108c86f0dffa789772ae70d5be2799487b81924c7d5285cb9a11 not found: ID does not exist"
Sep 17 00:47:09.473447 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.473427    2565 scope.go:117] "RemoveContainer" containerID="4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67"
Sep 17 00:47:09.473681 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:47:09.473663    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67\": container with ID starting with 4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67 not found: ID does not exist" containerID="4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67"
Sep 17 00:47:09.473727 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.473690    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67"} err="failed to get container status \"4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67\": rpc error: code = NotFound desc = could not find container \"4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67\": container with ID starting with 4b37faa5ccaebb111aac536c1fc9f728fdb42e5f773a81e7e0577480d71a2f67 not found: ID does not exist"
Sep 17 00:47:09.477581 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.477559    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"]
Sep 17 00:47:09.485784 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.485752    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-eaba37-openshift-default-55d9b5fcd4-77zc8"]
Sep 17 00:47:09.926618 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:09.926583    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" path="/var/lib/kubelet/pods/4cc93233-c93e-4f6b-937e-15657b1235db/volumes"
Sep 17 00:47:14.633607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.633556    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:14.661285 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.661252    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"]
Sep 17 00:47:14.661530 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.661501    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6" podUID="d23ea127-8000-4628-a2e1-92ded24ea115" containerName="payload-processing" containerID="cri-o://f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319" gracePeriod=30
Sep 17 00:47:14.668672 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.668626    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"]
Sep 17 00:47:14.669163 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.668858    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql" podUID="dc4f085d-2a48-467b-89af-c2e42e34eb8d" containerName="payload-pre-processing" containerID="cri-o://2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2" gracePeriod=30
Sep 17 00:47:14.700305 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.700268    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:14.756551 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.756521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:14.812178 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.812143    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:14.864939 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.864908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:14.919047 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.919025    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:47:14.952959 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.952937    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:47:14.980564 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.980534    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn4m6\" (UniqueName: \"kubernetes.io/projected/d23ea127-8000-4628-a2e1-92ded24ea115-kube-api-access-qn4m6\") pod \"d23ea127-8000-4628-a2e1-92ded24ea115\" (UID: \"d23ea127-8000-4628-a2e1-92ded24ea115\") "
Sep 17 00:47:14.980827 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.980631    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23ea127-8000-4628-a2e1-92ded24ea115-plugins-config-volume\") pod \"d23ea127-8000-4628-a2e1-92ded24ea115\" (UID: \"d23ea127-8000-4628-a2e1-92ded24ea115\") "
Sep 17 00:47:14.980827 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.980674    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc4f085d-2a48-467b-89af-c2e42e34eb8d-plugins-config-volume\") pod \"dc4f085d-2a48-467b-89af-c2e42e34eb8d\" (UID: \"dc4f085d-2a48-467b-89af-c2e42e34eb8d\") "
Sep 17 00:47:14.980827 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.980740    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrlzk\" (UniqueName: \"kubernetes.io/projected/dc4f085d-2a48-467b-89af-c2e42e34eb8d-kube-api-access-vrlzk\") pod \"dc4f085d-2a48-467b-89af-c2e42e34eb8d\" (UID: \"dc4f085d-2a48-467b-89af-c2e42e34eb8d\") "
Sep 17 00:47:14.981353 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.981326    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc4f085d-2a48-467b-89af-c2e42e34eb8d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dc4f085d-2a48-467b-89af-c2e42e34eb8d" (UID: "dc4f085d-2a48-467b-89af-c2e42e34eb8d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:14.981569 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.981542    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d23ea127-8000-4628-a2e1-92ded24ea115-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d23ea127-8000-4628-a2e1-92ded24ea115" (UID: "d23ea127-8000-4628-a2e1-92ded24ea115"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:14.985186 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.985157    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc4f085d-2a48-467b-89af-c2e42e34eb8d-kube-api-access-vrlzk" (OuterVolumeSpecName: "kube-api-access-vrlzk") pod "dc4f085d-2a48-467b-89af-c2e42e34eb8d" (UID: "dc4f085d-2a48-467b-89af-c2e42e34eb8d"). InnerVolumeSpecName "kube-api-access-vrlzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:14.986876 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:14.986843    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d23ea127-8000-4628-a2e1-92ded24ea115-kube-api-access-qn4m6" (OuterVolumeSpecName: "kube-api-access-qn4m6") pod "d23ea127-8000-4628-a2e1-92ded24ea115" (UID: "d23ea127-8000-4628-a2e1-92ded24ea115"). InnerVolumeSpecName "kube-api-access-qn4m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:15.082238 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.082199    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23ea127-8000-4628-a2e1-92ded24ea115-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:15.082238 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.082231    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dc4f085d-2a48-467b-89af-c2e42e34eb8d-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:15.082238 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.082244    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrlzk\" (UniqueName: \"kubernetes.io/projected/dc4f085d-2a48-467b-89af-c2e42e34eb8d-kube-api-access-vrlzk\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:15.082478 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.082253    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn4m6\" (UniqueName: \"kubernetes.io/projected/d23ea127-8000-4628-a2e1-92ded24ea115-kube-api-access-qn4m6\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:15.189607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.189471    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:15.289844 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.289797    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:15.487916 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.487820    2565 generic.go:356] "Generic (PLEG): container finished" podID="dc4f085d-2a48-467b-89af-c2e42e34eb8d" containerID="2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2" exitCode=0
Sep 17 00:47:15.487916 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.487869    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"
Sep 17 00:47:15.488122 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.487912    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql" event={"ID":"dc4f085d-2a48-467b-89af-c2e42e34eb8d","Type":"ContainerDied","Data":"2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2"}
Sep 17 00:47:15.488122 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.487969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql" event={"ID":"dc4f085d-2a48-467b-89af-c2e42e34eb8d","Type":"ContainerDied","Data":"01fc07302da96e7254be33ddc21baba89d0c0fd9e64952dcaa7c7a2dcef2e39f"}
Sep 17 00:47:15.488122 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.487996    2565 scope.go:117] "RemoveContainer" containerID="2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2"
Sep 17 00:47:15.491533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.489792    2565 generic.go:356] "Generic (PLEG): container finished" podID="d23ea127-8000-4628-a2e1-92ded24ea115" containerID="f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319" exitCode=0
Sep 17 00:47:15.491533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.489895    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"
Sep 17 00:47:15.491533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.489911    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6" event={"ID":"d23ea127-8000-4628-a2e1-92ded24ea115","Type":"ContainerDied","Data":"f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319"}
Sep 17 00:47:15.491533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.490007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6" event={"ID":"d23ea127-8000-4628-a2e1-92ded24ea115","Type":"ContainerDied","Data":"051055b235035b56422a1b36cf9f9fbdb95f0c1e881f40e739389228e6dc4d71"}
Sep 17 00:47:15.506136 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.506116    2565 scope.go:117] "RemoveContainer" containerID="2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2"
Sep 17 00:47:15.506438 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:47:15.506415    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2\": container with ID starting with 2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2 not found: ID does not exist" containerID="2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2"
Sep 17 00:47:15.506537 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.506444    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2"} err="failed to get container status \"2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2\": rpc error: code = NotFound desc = could not find container \"2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2\": container with ID starting with 2fc136ba2904bca21ff0e9f55275a19e047d5ea63a3174afef71d4650c686fd2 not found: ID does not exist"
Sep 17 00:47:15.506537 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.506462    2565 scope.go:117] "RemoveContainer" containerID="f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319"
Sep 17 00:47:15.514310 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.514291    2565 scope.go:117] "RemoveContainer" containerID="f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319"
Sep 17 00:47:15.514861 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:47:15.514830    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319\": container with ID starting with f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319 not found: ID does not exist" containerID="f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319"
Sep 17 00:47:15.514978 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.514871    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319"} err="failed to get container status \"f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319\": rpc error: code = NotFound desc = could not find container \"f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319\": container with ID starting with f213635845612306d3bee187ab54e1e814a8a551c09b09174ebce43a65213319 not found: ID does not exist"
Sep 17 00:47:15.517347 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.517328    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"]
Sep 17 00:47:15.520338 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.520316    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a8402d-7bf7f6f68f-drxq6"]
Sep 17 00:47:15.532997 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.532971    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"]
Sep 17 00:47:15.539433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.539411    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a8402d-5fd59896b-ftnql"]
Sep 17 00:47:15.853167 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.853128    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:15.930314 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.930278    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d23ea127-8000-4628-a2e1-92ded24ea115" path="/var/lib/kubelet/pods/d23ea127-8000-4628-a2e1-92ded24ea115/volumes"
Sep 17 00:47:15.930774 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:15.930752    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc4f085d-2a48-467b-89af-c2e42e34eb8d" path="/var/lib/kubelet/pods/dc4f085d-2a48-467b-89af-c2e42e34eb8d/volumes"
Sep 17 00:47:16.518438 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:16.518399    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:20.810105 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:20.810064    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:20.910441 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:20.910400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:21.055894 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:21.055860    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"]
Sep 17 00:47:21.056126 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:21.056102    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy" containerID="cri-o://17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155" gracePeriod=30
Sep 17 00:47:21.070737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:21.070656    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:21.531248 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:21.531147    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 00:47:21.531248 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:21.531233    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:47:21.568372 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:21.568342    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:22.318532 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:22.318446    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:23.114264 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:23.114233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:23.758118 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:23.758083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:26.305641 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.305612    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:47:26.383963 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.383884    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwgpc\" (UniqueName: \"kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-kube-api-access-kwgpc\") pod \"224438ed-93ee-477c-9934-0b16c1be65c1\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") "
Sep 17 00:47:26.383963 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.383954    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224438ed-93ee-477c-9934-0b16c1be65c1-istio-podinfo\") pod \"224438ed-93ee-477c-9934-0b16c1be65c1\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") "
Sep 17 00:47:26.384175 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.383997    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/224438ed-93ee-477c-9934-0b16c1be65c1-istiod-ca-cert\") pod \"224438ed-93ee-477c-9934-0b16c1be65c1\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") "
Sep 17 00:47:26.384175 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384019    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-certs\") pod \"224438ed-93ee-477c-9934-0b16c1be65c1\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") "
Sep 17 00:47:26.384175 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384093    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-envoy\") pod \"224438ed-93ee-477c-9934-0b16c1be65c1\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") "
Sep 17 00:47:26.384344 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384198    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-istio-token\") pod \"224438ed-93ee-477c-9934-0b16c1be65c1\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") "
Sep 17 00:47:26.384344 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384229    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-socket\") pod \"224438ed-93ee-477c-9934-0b16c1be65c1\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") "
Sep 17 00:47:26.384344 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384260    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-data\") pod \"224438ed-93ee-477c-9934-0b16c1be65c1\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") "
Sep 17 00:47:26.384344 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384286    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-credential-socket\") pod \"224438ed-93ee-477c-9934-0b16c1be65c1\" (UID: \"224438ed-93ee-477c-9934-0b16c1be65c1\") "
Sep 17 00:47:26.384520 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384395    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/224438ed-93ee-477c-9934-0b16c1be65c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "224438ed-93ee-477c-9934-0b16c1be65c1" (UID: "224438ed-93ee-477c-9934-0b16c1be65c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:26.384690 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384663    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "224438ed-93ee-477c-9934-0b16c1be65c1" (UID: "224438ed-93ee-477c-9934-0b16c1be65c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:26.384690 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384669    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/224438ed-93ee-477c-9934-0b16c1be65c1-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:26.384690 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384468    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "224438ed-93ee-477c-9934-0b16c1be65c1" (UID: "224438ed-93ee-477c-9934-0b16c1be65c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:26.384881 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384684    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "224438ed-93ee-477c-9934-0b16c1be65c1" (UID: "224438ed-93ee-477c-9934-0b16c1be65c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:26.384881 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.384714    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "224438ed-93ee-477c-9934-0b16c1be65c1" (UID: "224438ed-93ee-477c-9934-0b16c1be65c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:26.386582 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.386543    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "224438ed-93ee-477c-9934-0b16c1be65c1" (UID: "224438ed-93ee-477c-9934-0b16c1be65c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:26.386684 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.386604    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-kube-api-access-kwgpc" (OuterVolumeSpecName: "kube-api-access-kwgpc") pod "224438ed-93ee-477c-9934-0b16c1be65c1" (UID: "224438ed-93ee-477c-9934-0b16c1be65c1"). InnerVolumeSpecName "kube-api-access-kwgpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:26.386684 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.386643    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "224438ed-93ee-477c-9934-0b16c1be65c1" (UID: "224438ed-93ee-477c-9934-0b16c1be65c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:26.386684 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.386650    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/224438ed-93ee-477c-9934-0b16c1be65c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "224438ed-93ee-477c-9934-0b16c1be65c1" (UID: "224438ed-93ee-477c-9934-0b16c1be65c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:47:26.485875 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.485846    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:26.485875 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.485870    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:26.485875 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.485879    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:26.486080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.485887    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:26.486080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.485896    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:26.486080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.485905    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/224438ed-93ee-477c-9934-0b16c1be65c1-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:26.486080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.485914    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwgpc\" (UniqueName: \"kubernetes.io/projected/224438ed-93ee-477c-9934-0b16c1be65c1-kube-api-access-kwgpc\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:26.486080 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.485922    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/224438ed-93ee-477c-9934-0b16c1be65c1-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:26.549606 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.549576    2565 generic.go:356] "Generic (PLEG): container finished" podID="224438ed-93ee-477c-9934-0b16c1be65c1" containerID="17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155" exitCode=0
Sep 17 00:47:26.549778 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.549636    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"
Sep 17 00:47:26.549778 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.549666    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" event={"ID":"224438ed-93ee-477c-9934-0b16c1be65c1","Type":"ContainerDied","Data":"17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155"}
Sep 17 00:47:26.549778 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.549727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv" event={"ID":"224438ed-93ee-477c-9934-0b16c1be65c1","Type":"ContainerDied","Data":"0aae4de69302b8590570dc2afd53862f3e41e5baab3bf8e00c5f2e341eaff527"}
Sep 17 00:47:26.549778 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.549751    2565 scope.go:117] "RemoveContainer" containerID="17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155"
Sep 17 00:47:26.559643 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.559626    2565 scope.go:117] "RemoveContainer" containerID="a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c"
Sep 17 00:47:26.567693 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.567674    2565 scope.go:117] "RemoveContainer" containerID="17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155"
Sep 17 00:47:26.567969 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:47:26.567949    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155\": container with ID starting with 17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155 not found: ID does not exist" containerID="17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155"
Sep 17 00:47:26.568031 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.567978    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155"} err="failed to get container status \"17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155\": rpc error: code = NotFound desc = could not find container \"17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155\": container with ID starting with 17d336ac2d758cd8ad39d49373041fc1a8461aafe1ddc4277dbd3c6eb64f4155 not found: ID does not exist"
Sep 17 00:47:26.568031 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.568007    2565 scope.go:117] "RemoveContainer" containerID="a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c"
Sep 17 00:47:26.568257 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:47:26.568238    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c\": container with ID starting with a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c not found: ID does not exist" containerID="a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c"
Sep 17 00:47:26.568320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.568267    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c"} err="failed to get container status \"a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c\": rpc error: code = NotFound desc = could not find container \"a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c\": container with ID starting with a27cce8c9f20aef39e861f8c2e892204600bdf58b3426b619619580ab8f1a79c not found: ID does not exist"
Sep 17 00:47:26.572441 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.572418    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"]
Sep 17 00:47:26.577533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:26.577510    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-a8402d-openshift-default-dddb88d66-sdjcv"]
Sep 17 00:47:27.926146 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:27.926106    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" path="/var/lib/kubelet/pods/224438ed-93ee-477c-9934-0b16c1be65c1/volumes"
Sep 17 00:47:32.023947 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:32.023913    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:32.092532 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:32.092498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:32.192194 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:32.192156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:32.271921 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:32.271877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:32.595932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:32.595890    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:32.652866 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:32.652830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:33.304278 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:33.304240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:38.322606 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:38.322569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:38.422485 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:38.422448    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:38.638414 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:38.638323    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"]
Sep 17 00:47:38.638580 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:38.638532    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy" containerID="cri-o://2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0" gracePeriod=30
Sep 17 00:47:38.654668 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:38.654642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:39.195396 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:39.195356    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:40.011908 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:40.011869    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:40.635269 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:40.635228    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:43.887426 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:43.887404    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:47:44.042423 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042346    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-certs\") pod \"516de6df-85ce-4073-b663-5d70c941bf22\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") "
Sep 17 00:47:44.042423 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042422    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-kube-api-access-999p9\") pod \"516de6df-85ce-4073-b663-5d70c941bf22\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") "
Sep 17 00:47:44.042649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042443    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-socket\") pod \"516de6df-85ce-4073-b663-5d70c941bf22\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") "
Sep 17 00:47:44.042649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042462    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-istio-token\") pod \"516de6df-85ce-4073-b663-5d70c941bf22\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") "
Sep 17 00:47:44.042649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042484    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-envoy\") pod \"516de6df-85ce-4073-b663-5d70c941bf22\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") "
Sep 17 00:47:44.042649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042534    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-credential-socket\") pod \"516de6df-85ce-4073-b663-5d70c941bf22\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") "
Sep 17 00:47:44.042649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042566    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516de6df-85ce-4073-b663-5d70c941bf22-istiod-ca-cert\") pod \"516de6df-85ce-4073-b663-5d70c941bf22\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") "
Sep 17 00:47:44.042649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042597    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516de6df-85ce-4073-b663-5d70c941bf22-istio-podinfo\") pod \"516de6df-85ce-4073-b663-5d70c941bf22\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") "
Sep 17 00:47:44.042649 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042628    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-data\") pod \"516de6df-85ce-4073-b663-5d70c941bf22\" (UID: \"516de6df-85ce-4073-b663-5d70c941bf22\") "
Sep 17 00:47:44.043061 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042667    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "516de6df-85ce-4073-b663-5d70c941bf22" (UID: "516de6df-85ce-4073-b663-5d70c941bf22"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:44.043061 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042770    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "516de6df-85ce-4073-b663-5d70c941bf22" (UID: "516de6df-85ce-4073-b663-5d70c941bf22"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:44.043061 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.042983    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-data" (OuterVolumeSpecName: "istio-data") pod "516de6df-85ce-4073-b663-5d70c941bf22" (UID: "516de6df-85ce-4073-b663-5d70c941bf22"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:44.043061 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.043031    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "516de6df-85ce-4073-b663-5d70c941bf22" (UID: "516de6df-85ce-4073-b663-5d70c941bf22"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:44.043061 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.043037    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/516de6df-85ce-4073-b663-5d70c941bf22-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "516de6df-85ce-4073-b663-5d70c941bf22" (UID: "516de6df-85ce-4073-b663-5d70c941bf22"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:44.043320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.043041    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:44.043320 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.043095    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-workload-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:44.044748 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.044715    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-istio-token" (OuterVolumeSpecName: "istio-token") pod "516de6df-85ce-4073-b663-5d70c941bf22" (UID: "516de6df-85ce-4073-b663-5d70c941bf22"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:44.044904 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.044744    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/516de6df-85ce-4073-b663-5d70c941bf22-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "516de6df-85ce-4073-b663-5d70c941bf22" (UID: "516de6df-85ce-4073-b663-5d70c941bf22"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:47:44.044904 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.044892    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "516de6df-85ce-4073-b663-5d70c941bf22" (UID: "516de6df-85ce-4073-b663-5d70c941bf22"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:47:44.044904 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.044892    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-kube-api-access-999p9" (OuterVolumeSpecName: "kube-api-access-999p9") pod "516de6df-85ce-4073-b663-5d70c941bf22" (UID: "516de6df-85ce-4073-b663-5d70c941bf22"). InnerVolumeSpecName "kube-api-access-999p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:44.144094 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.144052    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-credential-socket\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:44.144094 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.144092    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/516de6df-85ce-4073-b663-5d70c941bf22-istiod-ca-cert\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:44.144094 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.144103    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/516de6df-85ce-4073-b663-5d70c941bf22-istio-podinfo\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:44.144311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.144112    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-data\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:44.144311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.144121    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-999p9\" (UniqueName: \"kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-kube-api-access-999p9\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:44.144311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.144131    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/516de6df-85ce-4073-b663-5d70c941bf22-istio-token\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:44.144311 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.144139    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/516de6df-85ce-4073-b663-5d70c941bf22-istio-envoy\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:44.650271 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.650238    2565 generic.go:356] "Generic (PLEG): container finished" podID="516de6df-85ce-4073-b663-5d70c941bf22" containerID="2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0" exitCode=0
Sep 17 00:47:44.650454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.650286    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"
Sep 17 00:47:44.650454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.650308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" event={"ID":"516de6df-85ce-4073-b663-5d70c941bf22","Type":"ContainerDied","Data":"2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0"}
Sep 17 00:47:44.650454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.650351    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5" event={"ID":"516de6df-85ce-4073-b663-5d70c941bf22","Type":"ContainerDied","Data":"1d88a4612d0c9d450a1e3aef87e705bc40a9a6e5ca42eea7930fa3da8d2dd248"}
Sep 17 00:47:44.650454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.650373    2565 scope.go:117] "RemoveContainer" containerID="2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0"
Sep 17 00:47:44.662748 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.662729    2565 scope.go:117] "RemoveContainer" containerID="bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a"
Sep 17 00:47:44.670970 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.670947    2565 scope.go:117] "RemoveContainer" containerID="2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0"
Sep 17 00:47:44.671340 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:47:44.671280    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0\": container with ID starting with 2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0 not found: ID does not exist" containerID="2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0"
Sep 17 00:47:44.671340 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.671321    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0"} err="failed to get container status \"2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0\": rpc error: code = NotFound desc = could not find container \"2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0\": container with ID starting with 2633986c1cbc1c63d53bf8ed8c1b619246dae12cf3fc51321bf4a239cd31f8d0 not found: ID does not exist"
Sep 17 00:47:44.671560 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.671344    2565 scope.go:117] "RemoveContainer" containerID="bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a"
Sep 17 00:47:44.671679 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:47:44.671654    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a\": container with ID starting with bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a not found: ID does not exist" containerID="bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a"
Sep 17 00:47:44.671778 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.671688    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a"} err="failed to get container status \"bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a\": rpc error: code = NotFound desc = could not find container \"bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a\": container with ID starting with bb396e1f1a09d52b262ae936d50d0510cb20e91d44ca3539d8f21192b060127a not found: ID does not exist"
Sep 17 00:47:44.675194 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.675171    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"]
Sep 17 00:47:44.677029 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:44.677009    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-47a2db-openshift-default-855b787b8-9szv5"]
Sep 17 00:47:45.926601 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:45.926569    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="516de6df-85ce-4073-b663-5d70c941bf22" path="/var/lib/kubelet/pods/516de6df-85ce-4073-b663-5d70c941bf22/volumes"
Sep 17 00:47:49.400303 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.400270    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"]
Sep 17 00:47:49.400767 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.400525    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6" podUID="20fcbd75-554c-465e-b7ab-069ae464f10d" containerName="maas-api" containerID="cri-o://145e46eb0f40e227c0146c324845aa964b4e90f1feeaa784b8af527419f86fef" gracePeriod=30
Sep 17 00:47:49.425739 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.425694    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:49.451470 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.451433    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"]
Sep 17 00:47:49.451723 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.451694    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q" podUID="1bf052ac-9621-4060-a512-5a89023fb9e7" containerName="payload-pre-processing" containerID="cri-o://0a0bb86bcd915f6c885d1fc9beefcbc3ecabd7ea0915c8de17c4b96352da662b" gracePeriod=30
Sep 17 00:47:49.488793 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.488749    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:49.588655 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.588620    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:49.684713 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.684682    2565 generic.go:356] "Generic (PLEG): container finished" podID="1bf052ac-9621-4060-a512-5a89023fb9e7" containerID="0a0bb86bcd915f6c885d1fc9beefcbc3ecabd7ea0915c8de17c4b96352da662b" exitCode=0
Sep 17 00:47:49.684880 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.684757    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q" event={"ID":"1bf052ac-9621-4060-a512-5a89023fb9e7","Type":"ContainerDied","Data":"0a0bb86bcd915f6c885d1fc9beefcbc3ecabd7ea0915c8de17c4b96352da662b"}
Sep 17 00:47:49.686427 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.686385    2565 generic.go:356] "Generic (PLEG): container finished" podID="20fcbd75-554c-465e-b7ab-069ae464f10d" containerID="145e46eb0f40e227c0146c324845aa964b4e90f1feeaa784b8af527419f86fef" exitCode=0
Sep 17 00:47:49.686519 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.686489    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6" event={"ID":"20fcbd75-554c-465e-b7ab-069ae464f10d","Type":"ContainerDied","Data":"145e46eb0f40e227c0146c324845aa964b4e90f1feeaa784b8af527419f86fef"}
Sep 17 00:47:49.686571 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.686531    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6" event={"ID":"20fcbd75-554c-465e-b7ab-069ae464f10d","Type":"ContainerDied","Data":"0846f2065cf14f0ed26bd59da2ad91712cddb30ec7405daad2726f88192d8fc0"}
Sep 17 00:47:49.686571 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.686556    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0846f2065cf14f0ed26bd59da2ad91712cddb30ec7405daad2726f88192d8fc0"
Sep 17 00:47:49.689369 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.689343    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:49.699211 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.699194    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:47:49.724258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.724233    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:47:49.742854 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.742825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:49.796643 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.796612    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-maas-api-tls\") pod \"20fcbd75-554c-465e-b7ab-069ae464f10d\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") "
Sep 17 00:47:49.796783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.796673    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20fcbd75-554c-465e-b7ab-069ae464f10d-openshift-service-ca\") pod \"20fcbd75-554c-465e-b7ab-069ae464f10d\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") "
Sep 17 00:47:49.796783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.796711    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-metrics-certs\") pod \"20fcbd75-554c-465e-b7ab-069ae464f10d\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") "
Sep 17 00:47:49.796939 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.796795    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6dmz\" (UniqueName: \"kubernetes.io/projected/20fcbd75-554c-465e-b7ab-069ae464f10d-kube-api-access-b6dmz\") pod \"20fcbd75-554c-465e-b7ab-069ae464f10d\" (UID: \"20fcbd75-554c-465e-b7ab-069ae464f10d\") "
Sep 17 00:47:49.797045 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.797022    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20fcbd75-554c-465e-b7ab-069ae464f10d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "20fcbd75-554c-465e-b7ab-069ae464f10d" (UID: "20fcbd75-554c-465e-b7ab-069ae464f10d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:49.797137 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.797113    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/20fcbd75-554c-465e-b7ab-069ae464f10d-openshift-service-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:49.798850 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.798820    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "20fcbd75-554c-465e-b7ab-069ae464f10d" (UID: "20fcbd75-554c-465e-b7ab-069ae464f10d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:47:49.798928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.798854    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "20fcbd75-554c-465e-b7ab-069ae464f10d" (UID: "20fcbd75-554c-465e-b7ab-069ae464f10d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:47:49.798928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.798879    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20fcbd75-554c-465e-b7ab-069ae464f10d-kube-api-access-b6dmz" (OuterVolumeSpecName: "kube-api-access-b6dmz") pod "20fcbd75-554c-465e-b7ab-069ae464f10d" (UID: "20fcbd75-554c-465e-b7ab-069ae464f10d"). InnerVolumeSpecName "kube-api-access-b6dmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:49.844773 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.844747    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:49.897501 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.897473    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqnsp\" (UniqueName: \"kubernetes.io/projected/1bf052ac-9621-4060-a512-5a89023fb9e7-kube-api-access-qqnsp\") pod \"1bf052ac-9621-4060-a512-5a89023fb9e7\" (UID: \"1bf052ac-9621-4060-a512-5a89023fb9e7\") "
Sep 17 00:47:49.897630 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.897523    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bf052ac-9621-4060-a512-5a89023fb9e7-plugins-config-volume\") pod \"1bf052ac-9621-4060-a512-5a89023fb9e7\" (UID: \"1bf052ac-9621-4060-a512-5a89023fb9e7\") "
Sep 17 00:47:49.897736 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.897722    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-metrics-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:49.897783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.897741    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6dmz\" (UniqueName: \"kubernetes.io/projected/20fcbd75-554c-465e-b7ab-069ae464f10d-kube-api-access-b6dmz\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:49.897783 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.897755    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/20fcbd75-554c-465e-b7ab-069ae464f10d-maas-api-tls\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:49.897902 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.897871    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bf052ac-9621-4060-a512-5a89023fb9e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1bf052ac-9621-4060-a512-5a89023fb9e7" (UID: "1bf052ac-9621-4060-a512-5a89023fb9e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:49.899390 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.899370    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bf052ac-9621-4060-a512-5a89023fb9e7-kube-api-access-qqnsp" (OuterVolumeSpecName: "kube-api-access-qqnsp") pod "1bf052ac-9621-4060-a512-5a89023fb9e7" (UID: "1bf052ac-9621-4060-a512-5a89023fb9e7"). InnerVolumeSpecName "kube-api-access-qqnsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:49.998356 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.998322    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqnsp\" (UniqueName: \"kubernetes.io/projected/1bf052ac-9621-4060-a512-5a89023fb9e7-kube-api-access-qqnsp\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:49.998356 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:49.998350    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bf052ac-9621-4060-a512-5a89023fb9e7-plugins-config-volume\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:47:50.162268 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:50.162230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:50.691928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:50.691840    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q" event={"ID":"1bf052ac-9621-4060-a512-5a89023fb9e7","Type":"ContainerDied","Data":"0c29970244991c7e6480b1a142f2e7c18a2d49031295e9f38467854c4e9698c5"}
Sep 17 00:47:50.691928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:50.691894    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"
Sep 17 00:47:50.691928 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:50.691905    2565 scope.go:117] "RemoveContainer" containerID="0a0bb86bcd915f6c885d1fc9beefcbc3ecabd7ea0915c8de17c4b96352da662b"
Sep 17 00:47:50.692470 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:50.692090    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"
Sep 17 00:47:50.713608 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:50.713584    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"]
Sep 17 00:47:50.719053 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:50.719030    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-07f9f2-64d44dfbcd-fkbt6"]
Sep 17 00:47:50.728521 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:50.728498    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"]
Sep 17 00:47:50.730793 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:50.730772    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-07f9f2-7797bf9d54-2548q"]
Sep 17 00:47:51.928229 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:51.928194    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bf052ac-9621-4060-a512-5a89023fb9e7" path="/var/lib/kubelet/pods/1bf052ac-9621-4060-a512-5a89023fb9e7/volumes"
Sep 17 00:47:51.928608 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:51.928563    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20fcbd75-554c-465e-b7ab-069ae464f10d" path="/var/lib/kubelet/pods/20fcbd75-554c-465e-b7ab-069ae464f10d/volumes"
Sep 17 00:47:55.847255 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:55.847214    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:55.904879 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:55.904843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:47:56.115914 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:47:56.115826    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:48:00.311972 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:48:00.311942    2565 scope.go:117] "RemoveContainer" containerID="145e46eb0f40e227c0146c324845aa964b4e90f1feeaa784b8af527419f86fef"
Sep 17 00:49:20.209124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:49:20.209093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:49:22.016955 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:49:22.016909    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:50:05.820039 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:50:05.820009    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:50:05.836734 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:50:05.836711    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:51:03.688165 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:51:03.688118    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:52:05.169129 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:05.169030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:52:19.098477 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098439    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"]
Sep 17 00:52:19.098948 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098894    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bf052ac-9621-4060-a512-5a89023fb9e7" containerName="payload-pre-processing"
Sep 17 00:52:19.098948 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098915    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bf052ac-9621-4060-a512-5a89023fb9e7" containerName="payload-pre-processing"
Sep 17 00:52:19.098948 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098930    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23ea127-8000-4628-a2e1-92ded24ea115" containerName="payload-processing"
Sep 17 00:52:19.098948 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098937    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23ea127-8000-4628-a2e1-92ded24ea115" containerName="payload-processing"
Sep 17 00:52:19.098948 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098948    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098954    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098965    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098971    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098978    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098983    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098994    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.098999    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099005    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099011    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099016    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099021    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099032    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="261ce033-9e99-45ca-92c4-085d15fcfffa" containerName="maas-api"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099038    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="261ce033-9e99-45ca-92c4-085d15fcfffa" containerName="maas-api"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099043    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc4f085d-2a48-467b-89af-c2e42e34eb8d" containerName="payload-pre-processing"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099048    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc4f085d-2a48-467b-89af-c2e42e34eb8d" containerName="payload-pre-processing"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099057    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20fcbd75-554c-465e-b7ab-069ae464f10d" containerName="maas-api"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099061    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="20fcbd75-554c-465e-b7ab-069ae464f10d" containerName="maas-api"
Sep 17 00:52:19.099124 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099133    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy"
Sep 17 00:52:19.099648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099140    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy"
Sep 17 00:52:19.099648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099147    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23ea127-8000-4628-a2e1-92ded24ea115" containerName="payload-processing"
Sep 17 00:52:19.099648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099155    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0d0a488-72e9-4fb5-a5ec-8d2ea01ea68a" containerName="istio-proxy"
Sep 17 00:52:19.099648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099162    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="20fcbd75-554c-465e-b7ab-069ae464f10d" containerName="maas-api"
Sep 17 00:52:19.099648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099168    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bf052ac-9621-4060-a512-5a89023fb9e7" containerName="payload-pre-processing"
Sep 17 00:52:19.099648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099174    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy"
Sep 17 00:52:19.099648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099179    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy"
Sep 17 00:52:19.099648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099185    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cc93233-c93e-4f6b-937e-15657b1235db" containerName="istio-proxy"
Sep 17 00:52:19.099648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099190    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc4f085d-2a48-467b-89af-c2e42e34eb8d" containerName="payload-pre-processing"
Sep 17 00:52:19.099648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.099196    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="261ce033-9e99-45ca-92c4-085d15fcfffa" containerName="maas-api"
Sep 17 00:52:19.102271 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.102244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.104719 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.104691    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jfhbm\""
Sep 17 00:52:19.105950 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.105921    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 00:52:19.106085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.105921    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 00:52:19.106085 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.106006    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-e86aa341-kserve-self-signed-certs\""
Sep 17 00:52:19.111994 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.111968    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"]
Sep 17 00:52:19.126949 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.126919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:52:19.255989 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.255957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-model-cache\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.256114 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.256020    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-home\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.256114 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.256082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tmp-dir\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.256114 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.256108    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-dshm\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.256273 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.256154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tls-certs\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.256273 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.256193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z849v\" (UniqueName: \"kubernetes.io/projected/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-kube-api-access-z849v\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.356741 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.356672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z849v\" (UniqueName: \"kubernetes.io/projected/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-kube-api-access-z849v\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.356741 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.356732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-model-cache\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.356946 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.356798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-home\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.356946 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.356862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tmp-dir\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.357068 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.356973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-dshm\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.357068 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.357024    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tls-certs\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.357230 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.357205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-model-cache\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.357317 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.357235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-home\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.357317 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.357287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tmp-dir\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.359277 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.359253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-dshm\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.359564 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.359544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tls-certs\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.364707 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.364689    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z849v\" (UniqueName: \"kubernetes.io/projected/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-kube-api-access-z849v\") pod \"e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") " pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.413853 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.413834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:19.681373 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.681346    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"]
Sep 17 00:52:19.683481 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:52:19.683455    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab44ea21_9af3_4cdc_989b_30138b2c0fe5.slice/crio-cbb037b1069969689be91422ebee972422badc0a8cbe5d9c83be6848e0aec7d0 WatchSource:0}: Error finding container cbb037b1069969689be91422ebee972422badc0a8cbe5d9c83be6848e0aec7d0: Status 404 returned error can't find the container with id cbb037b1069969689be91422ebee972422badc0a8cbe5d9c83be6848e0aec7d0
Sep 17 00:52:19.992221 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.992150    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn" event={"ID":"ab44ea21-9af3-4cdc-989b-30138b2c0fe5","Type":"ContainerStarted","Data":"51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9"}
Sep 17 00:52:19.992221 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:19.992188    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn" event={"ID":"ab44ea21-9af3-4cdc-989b-30138b2c0fe5","Type":"ContainerStarted","Data":"cbb037b1069969689be91422ebee972422badc0a8cbe5d9c83be6848e0aec7d0"}
Sep 17 00:52:20.008385 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:20.008342    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn" podStartSLOduration=1.008324673 podStartE2EDuration="1.008324673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:52:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:52:20.006451814 +0000 UTC m=+2540.533191292" watchObservedRunningTime="2026-09-17 00:52:20.008324673 +0000 UTC m=+2540.535064149"
Sep 17 00:52:27.494863 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.494826    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"]
Sep 17 00:52:27.495414 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.495367    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy"
Sep 17 00:52:27.495414 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.495389    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy"
Sep 17 00:52:27.495544 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.495441    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy"
Sep 17 00:52:27.495544 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.495450    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy"
Sep 17 00:52:27.495646 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.495550    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="516de6df-85ce-4073-b663-5d70c941bf22" containerName="istio-proxy"
Sep 17 00:52:27.495646 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.495566    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="224438ed-93ee-477c-9934-0b16c1be65c1" containerName="istio-proxy"
Sep 17 00:52:27.498970 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.498947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.501590 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.501558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-e86aa341-kserve-self-signed-certs\""
Sep 17 00:52:27.505788 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.505755    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"]
Sep 17 00:52:27.517510 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.517470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:52:27.519357 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.519329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e884290d-21d0-4601-a82d-4b87ce391ccf-tls-certs\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.519457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.519378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt6nl\" (UniqueName: \"kubernetes.io/projected/e884290d-21d0-4601-a82d-4b87ce391ccf-kube-api-access-tt6nl\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.519457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.519433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-model-cache\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.519457 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.519457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-dshm\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.519582 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.519557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-home\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.519636 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.519601    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-tmp-dir\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.620202 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.620176    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-model-cache\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.620294 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.620214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-dshm\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.620294 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.620249    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-home\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.620294 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.620272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-tmp-dir\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.620421 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.620342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e884290d-21d0-4601-a82d-4b87ce391ccf-tls-certs\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.620421 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.620379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt6nl\" (UniqueName: \"kubernetes.io/projected/e884290d-21d0-4601-a82d-4b87ce391ccf-kube-api-access-tt6nl\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.620620 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.620587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-model-cache\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.620702 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.620638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-tmp-dir\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.620761 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.620706    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-home\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.622425 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.622402    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-dshm\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.622776 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.622756    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e884290d-21d0-4601-a82d-4b87ce391ccf-tls-certs\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.627576 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.627557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt6nl\" (UniqueName: \"kubernetes.io/projected/e884290d-21d0-4601-a82d-4b87ce391ccf-kube-api-access-tt6nl\") pod \"e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") " pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:27.810876 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:27.810845    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:28.079271 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:28.079244    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"]
Sep 17 00:52:28.080786 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:52:28.080759    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode884290d_21d0_4601_a82d_4b87ce391ccf.slice/crio-3835bb2e95e50a56e4a0a11ee4223577163f474e8108d9f0798419a65813452a WatchSource:0}: Error finding container 3835bb2e95e50a56e4a0a11ee4223577163f474e8108d9f0798419a65813452a: Status 404 returned error can't find the container with id 3835bb2e95e50a56e4a0a11ee4223577163f474e8108d9f0798419a65813452a
Sep 17 00:52:29.036435 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:29.036386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg" event={"ID":"e884290d-21d0-4601-a82d-4b87ce391ccf","Type":"ContainerStarted","Data":"26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf"}
Sep 17 00:52:29.036858 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:29.036444    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg" event={"ID":"e884290d-21d0-4601-a82d-4b87ce391ccf","Type":"ContainerStarted","Data":"3835bb2e95e50a56e4a0a11ee4223577163f474e8108d9f0798419a65813452a"}
Sep 17 00:52:29.054543 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:29.054482    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg" podStartSLOduration=2.054465894 podStartE2EDuration="2.054465894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:52:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:52:29.052095912 +0000 UTC m=+2549.578835411" watchObservedRunningTime="2026-09-17 00:52:29.054465894 +0000 UTC m=+2549.581205370"
Sep 17 00:52:29.414247 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:29.414212    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:29.414409 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:29.414268    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:29.426488 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:29.426458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:30.051536 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:30.051510    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:52:37.811297 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:37.811257    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:37.811698 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:37.811312    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:37.823666 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:37.823640    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:38.094370 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:38.094294    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:52:53.291618 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:53.291582    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"]
Sep 17 00:52:53.311722 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:53.311695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:52:54.649611 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:54.649570    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"]
Sep 17 00:52:54.668767 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:52:54.668726    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:53:08.311171 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.311126    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn" podUID="ab44ea21-9af3-4cdc-989b-30138b2c0fe5" containerName="main" containerID="cri-o://51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9" gracePeriod=45
Sep 17 00:53:08.555193 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.555168    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:53:08.669218 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669162    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tmp-dir\") pod \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") "
Sep 17 00:53:08.669324 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z849v\" (UniqueName: \"kubernetes.io/projected/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-kube-api-access-z849v\") pod \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") "
Sep 17 00:53:08.669324 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669249    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-dshm\") pod \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") "
Sep 17 00:53:08.669324 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-home\") pod \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") "
Sep 17 00:53:08.669324 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669306    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tls-certs\") pod \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") "
Sep 17 00:53:08.669533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669335    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-model-cache\") pod \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\" (UID: \"ab44ea21-9af3-4cdc-989b-30138b2c0fe5\") "
Sep 17 00:53:08.669533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669409    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ab44ea21-9af3-4cdc-989b-30138b2c0fe5" (UID: "ab44ea21-9af3-4cdc-989b-30138b2c0fe5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:08.669639 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669604    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-home" (OuterVolumeSpecName: "home") pod "ab44ea21-9af3-4cdc-989b-30138b2c0fe5" (UID: "ab44ea21-9af3-4cdc-989b-30138b2c0fe5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:08.669639 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669623    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-model-cache" (OuterVolumeSpecName: "model-cache") pod "ab44ea21-9af3-4cdc-989b-30138b2c0fe5" (UID: "ab44ea21-9af3-4cdc-989b-30138b2c0fe5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:08.669751 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669735    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-home\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:08.669787 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669756    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-model-cache\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:08.669787 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.669771    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tmp-dir\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:08.671395 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.671371    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-dshm" (OuterVolumeSpecName: "dshm") pod "ab44ea21-9af3-4cdc-989b-30138b2c0fe5" (UID: "ab44ea21-9af3-4cdc-989b-30138b2c0fe5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:08.671493 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.671399    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ab44ea21-9af3-4cdc-989b-30138b2c0fe5" (UID: "ab44ea21-9af3-4cdc-989b-30138b2c0fe5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:53:08.671493 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.671446    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-kube-api-access-z849v" (OuterVolumeSpecName: "kube-api-access-z849v") pod "ab44ea21-9af3-4cdc-989b-30138b2c0fe5" (UID: "ab44ea21-9af3-4cdc-989b-30138b2c0fe5"). InnerVolumeSpecName "kube-api-access-z849v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:53:08.771114 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.771085    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-dshm\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:08.771114 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.771112    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-tls-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:08.771258 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:08.771127    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z849v\" (UniqueName: \"kubernetes.io/projected/ab44ea21-9af3-4cdc-989b-30138b2c0fe5-kube-api-access-z849v\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:09.241845 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.241792    2565 generic.go:356] "Generic (PLEG): container finished" podID="ab44ea21-9af3-4cdc-989b-30138b2c0fe5" containerID="51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9" exitCode=0
Sep 17 00:53:09.241984 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.241863    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"
Sep 17 00:53:09.241984 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.241879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn" event={"ID":"ab44ea21-9af3-4cdc-989b-30138b2c0fe5","Type":"ContainerDied","Data":"51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9"}
Sep 17 00:53:09.241984 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.241936    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn" event={"ID":"ab44ea21-9af3-4cdc-989b-30138b2c0fe5","Type":"ContainerDied","Data":"cbb037b1069969689be91422ebee972422badc0a8cbe5d9c83be6848e0aec7d0"}
Sep 17 00:53:09.241984 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.241959    2565 scope.go:117] "RemoveContainer" containerID="51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9"
Sep 17 00:53:09.251244 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.251223    2565 scope.go:117] "RemoveContainer" containerID="51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9"
Sep 17 00:53:09.251537 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:53:09.251517    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9\": container with ID starting with 51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9 not found: ID does not exist" containerID="51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9"
Sep 17 00:53:09.251582 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.251546    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9"} err="failed to get container status \"51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9\": rpc error: code = NotFound desc = could not find container \"51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9\": container with ID starting with 51138dd6942a2539f0d2d9c67981aea6d7c093606bdf8382fab67a5595f805a9 not found: ID does not exist"
Sep 17 00:53:09.263906 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.263868    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"]
Sep 17 00:53:09.265603 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.265579    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-e86aa341-kserve-5f5654465f-pffdn"]
Sep 17 00:53:09.670069 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.670029    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg" podUID="e884290d-21d0-4601-a82d-4b87ce391ccf" containerName="main" containerID="cri-o://26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf" gracePeriod=45
Sep 17 00:53:09.915478 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.915459    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:53:09.926167 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:09.926115    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab44ea21-9af3-4cdc-989b-30138b2c0fe5" path="/var/lib/kubelet/pods/ab44ea21-9af3-4cdc-989b-30138b2c0fe5/volumes"
Sep 17 00:53:10.083192 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.083163    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt6nl\" (UniqueName: \"kubernetes.io/projected/e884290d-21d0-4601-a82d-4b87ce391ccf-kube-api-access-tt6nl\") pod \"e884290d-21d0-4601-a82d-4b87ce391ccf\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") "
Sep 17 00:53:10.083347 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.083212    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-home\") pod \"e884290d-21d0-4601-a82d-4b87ce391ccf\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") "
Sep 17 00:53:10.083347 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.083291    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-tmp-dir\") pod \"e884290d-21d0-4601-a82d-4b87ce391ccf\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") "
Sep 17 00:53:10.083347 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.083321    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e884290d-21d0-4601-a82d-4b87ce391ccf-tls-certs\") pod \"e884290d-21d0-4601-a82d-4b87ce391ccf\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") "
Sep 17 00:53:10.083513 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.083380    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-dshm\") pod \"e884290d-21d0-4601-a82d-4b87ce391ccf\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") "
Sep 17 00:53:10.083513 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.083413    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-model-cache\") pod \"e884290d-21d0-4601-a82d-4b87ce391ccf\" (UID: \"e884290d-21d0-4601-a82d-4b87ce391ccf\") "
Sep 17 00:53:10.083619 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.083559    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e884290d-21d0-4601-a82d-4b87ce391ccf" (UID: "e884290d-21d0-4601-a82d-4b87ce391ccf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:10.083619 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.083575    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-home" (OuterVolumeSpecName: "home") pod "e884290d-21d0-4601-a82d-4b87ce391ccf" (UID: "e884290d-21d0-4601-a82d-4b87ce391ccf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:10.083823 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.083782    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-model-cache" (OuterVolumeSpecName: "model-cache") pod "e884290d-21d0-4601-a82d-4b87ce391ccf" (UID: "e884290d-21d0-4601-a82d-4b87ce391ccf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:10.083823 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.083815    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-home\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:10.083965 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.083837    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-tmp-dir\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:10.085562 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.085540    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-dshm" (OuterVolumeSpecName: "dshm") pod "e884290d-21d0-4601-a82d-4b87ce391ccf" (UID: "e884290d-21d0-4601-a82d-4b87ce391ccf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:53:10.085857 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.085838    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e884290d-21d0-4601-a82d-4b87ce391ccf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e884290d-21d0-4601-a82d-4b87ce391ccf" (UID: "e884290d-21d0-4601-a82d-4b87ce391ccf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:53:10.085916 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.085890    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e884290d-21d0-4601-a82d-4b87ce391ccf-kube-api-access-tt6nl" (OuterVolumeSpecName: "kube-api-access-tt6nl") pod "e884290d-21d0-4601-a82d-4b87ce391ccf" (UID: "e884290d-21d0-4601-a82d-4b87ce391ccf"). InnerVolumeSpecName "kube-api-access-tt6nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:53:10.184748 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.184684    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e884290d-21d0-4601-a82d-4b87ce391ccf-tls-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:10.184748 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.184714    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-dshm\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:10.184748 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.184724    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e884290d-21d0-4601-a82d-4b87ce391ccf-model-cache\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:10.184748 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.184732    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt6nl\" (UniqueName: \"kubernetes.io/projected/e884290d-21d0-4601-a82d-4b87ce391ccf-kube-api-access-tt6nl\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:10.248569 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.248541    2565 generic.go:356] "Generic (PLEG): container finished" podID="e884290d-21d0-4601-a82d-4b87ce391ccf" containerID="26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf" exitCode=0
Sep 17 00:53:10.248695 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.248578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg" event={"ID":"e884290d-21d0-4601-a82d-4b87ce391ccf","Type":"ContainerDied","Data":"26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf"}
Sep 17 00:53:10.248695 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.248634    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg" event={"ID":"e884290d-21d0-4601-a82d-4b87ce391ccf","Type":"ContainerDied","Data":"3835bb2e95e50a56e4a0a11ee4223577163f474e8108d9f0798419a65813452a"}
Sep 17 00:53:10.248695 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.248599    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"
Sep 17 00:53:10.248889 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.248661    2565 scope.go:117] "RemoveContainer" containerID="26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf"
Sep 17 00:53:10.258297 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.258276    2565 scope.go:117] "RemoveContainer" containerID="26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf"
Sep 17 00:53:10.258591 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:53:10.258571    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf\": container with ID starting with 26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf not found: ID does not exist" containerID="26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf"
Sep 17 00:53:10.258661 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.258598    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf"} err="failed to get container status \"26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf\": rpc error: code = NotFound desc = could not find container \"26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf\": container with ID starting with 26e3e95656c8704fbb0617242f8c0f49b271d637f36e87dc389c6a8ba5a22bdf not found: ID does not exist"
Sep 17 00:53:10.271837 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.271796    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"]
Sep 17 00:53:10.274038 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:10.274018    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-e86aa341-kserve-6664cf4979-2zwwg"]
Sep 17 00:53:11.926102 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:11.926064    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e884290d-21d0-4601-a82d-4b87ce391ccf" path="/var/lib/kubelet/pods/e884290d-21d0-4601-a82d-4b87ce391ccf/volumes"
Sep 17 00:53:13.000646 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.000615    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"]
Sep 17 00:53:13.001177 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.001154    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e884290d-21d0-4601-a82d-4b87ce391ccf" containerName="main"
Sep 17 00:53:13.001274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.001180    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e884290d-21d0-4601-a82d-4b87ce391ccf" containerName="main"
Sep 17 00:53:13.001274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.001194    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab44ea21-9af3-4cdc-989b-30138b2c0fe5" containerName="main"
Sep 17 00:53:13.001274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.001203    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab44ea21-9af3-4cdc-989b-30138b2c0fe5" containerName="main"
Sep 17 00:53:13.001487 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.001332    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab44ea21-9af3-4cdc-989b-30138b2c0fe5" containerName="main"
Sep 17 00:53:13.001487 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.001347    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e884290d-21d0-4601-a82d-4b87ce391ccf" containerName="main"
Sep 17 00:53:13.005701 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.005679    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.008170 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.008149    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2nbqn\""
Sep 17 00:53:13.016060 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.016030    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"]
Sep 17 00:53:13.107571 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.107545    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f5tw\" (UniqueName: \"kubernetes.io/projected/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-kube-api-access-7f5tw\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.107699 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.107577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-maas-api-tls\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.107699 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.107623    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-openshift-service-ca\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.107833 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.107688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-metrics-certs\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.208827 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.208779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-openshift-service-ca\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.208951 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.208852    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-metrics-certs\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.208951 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.208929    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f5tw\" (UniqueName: \"kubernetes.io/projected/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-kube-api-access-7f5tw\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.209068 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.208957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-maas-api-tls\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.209435 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.209415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-openshift-service-ca\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.211283 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.211260    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-maas-api-tls\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.211379 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.211346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-metrics-certs\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.216130 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.216110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f5tw\" (UniqueName: \"kubernetes.io/projected/1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8-kube-api-access-7f5tw\") pod \"maas-api-6789c486f4-svrgm\" (UID: \"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8\") " pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.318569 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.318546    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:13.584188 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.584161    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"]
Sep 17 00:53:13.586775 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:53:13.586748    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9a368c_b9c4_4a32_89fa_9dc5c76d51a8.slice/crio-80b5e6ee7bd665942911efbdf87407adcc74f79a8a4f1b58c33c3cf648c062be WatchSource:0}: Error finding container 80b5e6ee7bd665942911efbdf87407adcc74f79a8a4f1b58c33c3cf648c062be: Status 404 returned error can't find the container with id 80b5e6ee7bd665942911efbdf87407adcc74f79a8a4f1b58c33c3cf648c062be
Sep 17 00:53:13.588613 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:13.588592    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:53:14.270097 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:14.270017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm" event={"ID":"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8","Type":"ContainerStarted","Data":"3f908628057b78f570c56a99344c364c0ea4e81bcd652b6468fddd1e35417f46"}
Sep 17 00:53:14.270097 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:14.270068    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm" event={"ID":"1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8","Type":"ContainerStarted","Data":"80b5e6ee7bd665942911efbdf87407adcc74f79a8a4f1b58c33c3cf648c062be"}
Sep 17 00:53:14.270477 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:14.270123    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:14.286612 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:14.286567    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm" podStartSLOduration=1.870538282 podStartE2EDuration="2.286552357s" totalImagesPullingTime="416.014075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:53:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:53:14.284822529 +0000 UTC m=+2594.811562012" watchObservedRunningTime="2026-09-17 00:53:14.286552357 +0000 UTC m=+2594.813291832"
Sep 17 00:53:20.279692 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:20.279661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6789c486f4-svrgm"
Sep 17 00:53:20.323672 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:20.323633    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"]
Sep 17 00:53:20.323925 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:20.323898    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck" podUID="7d969b1e-68ee-4344-9730-1de23e415232" containerName="maas-api" containerID="cri-o://057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36" gracePeriod=30
Sep 17 00:53:21.032344 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.032306    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck" podUID="7d969b1e-68ee-4344-9730-1de23e415232" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.34:8443/health\": dial tcp 10.134.0.34:8443: connect: connection refused"
Sep 17 00:53:21.566795 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.566772    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:53:21.574260 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.574240    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdrvt\" (UniqueName: \"kubernetes.io/projected/7d969b1e-68ee-4344-9730-1de23e415232-kube-api-access-qdrvt\") pod \"7d969b1e-68ee-4344-9730-1de23e415232\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") "
Sep 17 00:53:21.574351 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.574300    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-metrics-certs\") pod \"7d969b1e-68ee-4344-9730-1de23e415232\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") "
Sep 17 00:53:21.574351 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.574326    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d969b1e-68ee-4344-9730-1de23e415232-openshift-service-ca\") pod \"7d969b1e-68ee-4344-9730-1de23e415232\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") "
Sep 17 00:53:21.574351 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.574342    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-maas-api-tls\") pod \"7d969b1e-68ee-4344-9730-1de23e415232\" (UID: \"7d969b1e-68ee-4344-9730-1de23e415232\") "
Sep 17 00:53:21.574685 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.574656    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d969b1e-68ee-4344-9730-1de23e415232-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d969b1e-68ee-4344-9730-1de23e415232" (UID: "7d969b1e-68ee-4344-9730-1de23e415232"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:53:21.576170 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.576140    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d969b1e-68ee-4344-9730-1de23e415232-kube-api-access-qdrvt" (OuterVolumeSpecName: "kube-api-access-qdrvt") pod "7d969b1e-68ee-4344-9730-1de23e415232" (UID: "7d969b1e-68ee-4344-9730-1de23e415232"). InnerVolumeSpecName "kube-api-access-qdrvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:53:21.576351 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.576323    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7d969b1e-68ee-4344-9730-1de23e415232" (UID: "7d969b1e-68ee-4344-9730-1de23e415232"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:53:21.576433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.576376    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d969b1e-68ee-4344-9730-1de23e415232" (UID: "7d969b1e-68ee-4344-9730-1de23e415232"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:53:21.675067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.675009    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdrvt\" (UniqueName: \"kubernetes.io/projected/7d969b1e-68ee-4344-9730-1de23e415232-kube-api-access-qdrvt\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:21.675067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.675033    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-metrics-certs\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:21.675067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.675044    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d969b1e-68ee-4344-9730-1de23e415232-openshift-service-ca\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:21.675067 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:21.675052    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d969b1e-68ee-4344-9730-1de23e415232-maas-api-tls\") on node \"ip-10-0-138-211.ec2.internal\" DevicePath \"\""
Sep 17 00:53:22.310199 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:22.310161    2565 generic.go:356] "Generic (PLEG): container finished" podID="7d969b1e-68ee-4344-9730-1de23e415232" containerID="057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36" exitCode=0
Sep 17 00:53:22.310335 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:22.310202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck" event={"ID":"7d969b1e-68ee-4344-9730-1de23e415232","Type":"ContainerDied","Data":"057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36"}
Sep 17 00:53:22.310335 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:22.310216    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"
Sep 17 00:53:22.310335 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:22.310284    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck" event={"ID":"7d969b1e-68ee-4344-9730-1de23e415232","Type":"ContainerDied","Data":"3aa188634306a8f00b3f4954cb679816ef715b66b8ee1fd754bcc6459523624a"}
Sep 17 00:53:22.310335 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:22.310317    2565 scope.go:117] "RemoveContainer" containerID="057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36"
Sep 17 00:53:22.319519 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:22.319501    2565 scope.go:117] "RemoveContainer" containerID="057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36"
Sep 17 00:53:22.319821 ip-10-0-138-211 kubenswrapper[2565]: E0917 00:53:22.319787    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36\": container with ID starting with 057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36 not found: ID does not exist" containerID="057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36"
Sep 17 00:53:22.319897 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:22.319834    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36"} err="failed to get container status \"057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36\": rpc error: code = NotFound desc = could not find container \"057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36\": container with ID starting with 057a78000fc756b547cebef65f7dbf122311e4e8c4897f5a6d666e4233193f36 not found: ID does not exist"
Sep 17 00:53:22.326187 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:22.326164    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"]
Sep 17 00:53:22.327846 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:22.327825    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d747b4f9d-fs9ck"]
Sep 17 00:53:23.926932 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:23.926885    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d969b1e-68ee-4344-9730-1de23e415232" path="/var/lib/kubelet/pods/7d969b1e-68ee-4344-9730-1de23e415232/volumes"
Sep 17 00:53:28.063554 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:28.063516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:53:50.123198 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:50.123134    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-g7lgr_ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09/server/0.log"
Sep 17 00:53:50.262478 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:50.262432    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4rmbg_1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c/manager/0.log"
Sep 17 00:53:50.622798 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:50.622768    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc689bf9d-ptzxl_ebdfef02-db24-4fb2-af1e-690e0e6a1b93/copy-manifests/0.log"
Sep 17 00:53:50.640565 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:50.640528    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc689bf9d-ptzxl_ebdfef02-db24-4fb2-af1e-690e0e6a1b93/manager/0.log"
Sep 17 00:53:51.100426 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:51.100388    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6789c486f4-svrgm_1f9a368c-b9c4-4a32-89fa-9dc5c76d51a8/maas-api/0.log"
Sep 17 00:53:53.358371 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:53.358329    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p_4a09e5de-0646-46b3-81dd-2fd08a31973c/istio-proxy/0.log"
Sep 17 00:53:53.480054 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:53.480019    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wgc58_09135dbd-49be-474c-92cc-41d951f71081/discovery/0.log"
Sep 17 00:53:54.085385 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:54.085352    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-4wlhv_a125c8de-812e-4c55-88bb-43ef7857b91e/payload-processing/0.log"
Sep 17 00:53:54.205218 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:53:54.205187    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c7d59dc6d-jbgwm_d2521dc9-47dd-445a-a28d-d05c7a7eb9b6/router/0.log"
Sep 17 00:54:01.014244 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:01.014209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:54:01.110773 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:01.110742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:54:03.956618 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:03.956588    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kjjvd_345076c3-2bd1-4142-ae90-0fd15c7242f9/global-pull-secret-syncer/0.log"
Sep 17 00:54:04.007274 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:04.007241    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log"
Sep 17 00:54:04.115463 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:04.115432    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-211.ec2.internal_0bc175423b8a32cb6a5dcc25bbd2083d/haproxy/0.log"
Sep 17 00:54:04.269618 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:04.269521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:54:10.686645 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:10.686616    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4759f5dc-d80d-40b7-bedf-f8953959cc3f/alertmanager/0.log"
Sep 17 00:54:10.706593 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:10.706564    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4759f5dc-d80d-40b7-bedf-f8953959cc3f/config-reloader/0.log"
Sep 17 00:54:10.725488 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:10.725462    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4759f5dc-d80d-40b7-bedf-f8953959cc3f/kube-rbac-proxy-web/0.log"
Sep 17 00:54:10.750153 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:10.750118    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4759f5dc-d80d-40b7-bedf-f8953959cc3f/kube-rbac-proxy/0.log"
Sep 17 00:54:10.770496 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:10.770460    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4759f5dc-d80d-40b7-bedf-f8953959cc3f/kube-rbac-proxy-metric/0.log"
Sep 17 00:54:10.790063 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:10.790032    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4759f5dc-d80d-40b7-bedf-f8953959cc3f/prom-label-proxy/0.log"
Sep 17 00:54:10.817423 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:10.817391    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4759f5dc-d80d-40b7-bedf-f8953959cc3f/init-config-reloader/0.log"
Sep 17 00:54:10.959865 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:10.959774    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5d8b9644c8-265jf_d416e68b-2001-4338-8b9a-8cff5c3f55f9/metrics-server/0.log"
Sep 17 00:54:10.985244 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:10.985210    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-v5h77_99523fb9-10b2-40c6-9e29-6db4d2fc8544/monitoring-plugin/0.log"
Sep 17 00:54:11.129609 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:11.129578    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wsxnb_d5bac9f2-55e3-4ed0-a497-74cd8fca955a/node-exporter/0.log"
Sep 17 00:54:11.170202 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:11.170173    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wsxnb_d5bac9f2-55e3-4ed0-a497-74cd8fca955a/kube-rbac-proxy/0.log"
Sep 17 00:54:11.191006 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:11.190978    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wsxnb_d5bac9f2-55e3-4ed0-a497-74cd8fca955a/init-textfile/0.log"
Sep 17 00:54:11.579253 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:11.579217    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-xhsgs_962c83c1-cd83-44cc-b359-0b5bfe55d637/prometheus-operator/0.log"
Sep 17 00:54:11.594532 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:11.594505    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-xhsgs_962c83c1-cd83-44cc-b359-0b5bfe55d637/kube-rbac-proxy/0.log"
Sep 17 00:54:11.618703 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:11.618670    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-wvpk2_36b5fa3c-265f-476c-b8e0-0b16b4b18bee/prometheus-operator-admission-webhook/0.log"
Sep 17 00:54:13.901298 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:13.901254    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/2.log"
Sep 17 00:54:13.908399 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:13.908373    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-xxd5z_572e13ec-05ba-4339-8aaf-c728bbd2307a/console-operator/3.log"
Sep 17 00:54:14.321858 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.321820    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"]
Sep 17 00:54:14.322211 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.322197    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d969b1e-68ee-4344-9730-1de23e415232" containerName="maas-api"
Sep 17 00:54:14.322254 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.322213    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d969b1e-68ee-4344-9730-1de23e415232" containerName="maas-api"
Sep 17 00:54:14.322314 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.322304    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d969b1e-68ee-4344-9730-1de23e415232" containerName="maas-api"
Sep 17 00:54:14.325630 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.325608    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.328327 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.328301    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d74xj\"/\"openshift-service-ca.crt\""
Sep 17 00:54:14.328437 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.328328    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d74xj\"/\"kube-root-ca.crt\""
Sep 17 00:54:14.329474 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.329459    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d74xj\"/\"default-dockercfg-l5959\""
Sep 17 00:54:14.334935 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.334912    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"]
Sep 17 00:54:14.364042 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.364004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-lib-modules\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.364239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.364050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-podres\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.364239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.364113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-sys\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.364239 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.364218    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq2kl\" (UniqueName: \"kubernetes.io/projected/ebacd276-3808-4cde-8e58-f0b954f8daf6-kube-api-access-gq2kl\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.364400 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.364244    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-proc\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.456607 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.456577    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-544d5bbb5f-7fg4d_43cd91da-f9a8-4757-b338-cc87d0ead09a/console/0.log"
Sep 17 00:54:14.465523 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.465490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-sys\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.465696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.465544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq2kl\" (UniqueName: \"kubernetes.io/projected/ebacd276-3808-4cde-8e58-f0b954f8daf6-kube-api-access-gq2kl\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.465696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.465573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-proc\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.465696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.465597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-sys\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.465696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.465660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-lib-modules\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.465696 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.465662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-proc\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.465930 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.465704    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-podres\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.465930 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.465770    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-lib-modules\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.465930 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.465838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ebacd276-3808-4cde-8e58-f0b954f8daf6-podres\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.473061 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.473032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq2kl\" (UniqueName: \"kubernetes.io/projected/ebacd276-3808-4cde-8e58-f0b954f8daf6-kube-api-access-gq2kl\") pod \"perf-node-gather-daemonset-c5fkj\" (UID: \"ebacd276-3808-4cde-8e58-f0b954f8daf6\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.494957 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.494930    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-nbvl7_c1b149bf-8777-49fe-b455-fb14c36e47b0/download-server/0.log"
Sep 17 00:54:14.636627 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.636538    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:14.908051 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:14.908026    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"]
Sep 17 00:54:14.909758 ip-10-0-138-211 kubenswrapper[2565]: W0917 00:54:14.909728    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podebacd276_3808_4cde_8e58_f0b954f8daf6.slice/crio-bc557ace5128e7297233896f9c915fb044a53d7944e1394fe620d87b5a264ab5 WatchSource:0}: Error finding container bc557ace5128e7297233896f9c915fb044a53d7944e1394fe620d87b5a264ab5: Status 404 returned error can't find the container with id bc557ace5128e7297233896f9c915fb044a53d7944e1394fe620d87b5a264ab5
Sep 17 00:54:15.578479 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:15.578443    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj" event={"ID":"ebacd276-3808-4cde-8e58-f0b954f8daf6","Type":"ContainerStarted","Data":"639bcd05168a611a20f19aa9d7038b6b8e3a5ee434b5c1e06170cb51fa1d5791"}
Sep 17 00:54:15.578677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:15.578494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj" event={"ID":"ebacd276-3808-4cde-8e58-f0b954f8daf6","Type":"ContainerStarted","Data":"bc557ace5128e7297233896f9c915fb044a53d7944e1394fe620d87b5a264ab5"}
Sep 17 00:54:15.578677 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:15.578581    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:15.596527 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:15.596477    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj" podStartSLOduration=1.596461441 podStartE2EDuration="1.596461441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:54:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:54:15.594343158 +0000 UTC m=+2656.121082667" watchObservedRunningTime="2026-09-17 00:54:15.596461441 +0000 UTC m=+2656.123200917"
Sep 17 00:54:16.266033 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:16.266003    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cd46g_dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae/dns/0.log"
Sep 17 00:54:16.286116 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:16.286082    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cd46g_dab7c9b5-9bd4-45e5-a4d4-48ab0d4bf1ae/kube-rbac-proxy/0.log"
Sep 17 00:54:16.438884 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:16.438854    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m5sg5_56bd23f3-6be8-4b22-ad3c-ba0156a5f08e/dns-node-resolver/0.log"
Sep 17 00:54:16.969461 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:16.969430    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7bd75f8759-tq8ql_0a2a5ace-6c6a-4a18-9f2c-582583bc805b/registry/0.log"
Sep 17 00:54:17.034533 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:17.034500    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-whcmk_37dbbfd8-ffbf-4601-b41b-b23df76d380f/node-ca/0.log"
Sep 17 00:54:17.980471 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:17.980444    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p_4a09e5de-0646-46b3-81dd-2fd08a31973c/istio-proxy/0.log"
Sep 17 00:54:18.802449 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:18.802414    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wgc58_09135dbd-49be-474c-92cc-41d951f71081/discovery/0.log"
Sep 17 00:54:18.954820 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:18.954760    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-4wlhv_a125c8de-812e-4c55-88bb-43ef7857b91e/payload-processing/0.log"
Sep 17 00:54:18.980525 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:18.980498    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c7d59dc6d-jbgwm_d2521dc9-47dd-445a-a28d-d05c7a7eb9b6/router/0.log"
Sep 17 00:54:19.868893 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:19.868862    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rcljv_f492cc67-feac-490d-9c0a-60489a020da3/serve-healthcheck-canary/0.log"
Sep 17 00:54:20.447470 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:20.447437    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jkgf_1e9aaf50-6db2-424c-83a8-8660c6aeb9ce/kube-rbac-proxy/0.log"
Sep 17 00:54:20.465879 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:20.465855    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jkgf_1e9aaf50-6db2-424c-83a8-8660c6aeb9ce/exporter/0.log"
Sep 17 00:54:20.485392 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:20.485367    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7jkgf_1e9aaf50-6db2-424c-83a8-8660c6aeb9ce/extractor/0.log"
Sep 17 00:54:21.592946 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:21.592912    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-c5fkj"
Sep 17 00:54:22.857936 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:22.857903    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-g7lgr_ac7b4e3a-f89c-43d2-9a9e-c1f360ed2c09/server/0.log"
Sep 17 00:54:22.998400 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:22.998356    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4rmbg_1d7a5ca1-c396-4c76-a635-2bb3e7a2cf0c/manager/0.log"
Sep 17 00:54:23.195454 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:23.195366    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc689bf9d-ptzxl_ebdfef02-db24-4fb2-af1e-690e0e6a1b93/manager/0.log"
Sep 17 00:54:23.211721 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:23.211693    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc689bf9d-ptzxl_ebdfef02-db24-4fb2-af1e-690e0e6a1b93/copy-manifests/0.log"
Sep 17 00:54:24.299856 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:24.299822    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p_4a09e5de-0646-46b3-81dd-2fd08a31973c/istio-proxy/0.log"
Sep 17 00:54:24.442203 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:24.442171    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6685c7f5f5-ctzd5_9c251753-4643-41e1-9e4a-25019bea2975/manager/0.log"
Sep 17 00:54:25.110737 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:25.110701    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wgc58_09135dbd-49be-474c-92cc-41d951f71081/discovery/0.log"
Sep 17 00:54:25.246224 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:25.246189    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-4wlhv_a125c8de-812e-4c55-88bb-43ef7857b91e/payload-processing/0.log"
Sep 17 00:54:25.261578 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:25.261547    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c7d59dc6d-jbgwm_d2521dc9-47dd-445a-a28d-d05c7a7eb9b6/router/0.log"
Sep 17 00:54:26.759874 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:26.759782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:54:26.772277 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:26.772247    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-w4k9p_4a09e5de-0646-46b3-81dd-2fd08a31973c/istio-proxy/0.log"
Sep 17 00:54:26.812433 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:26.812401    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjln9_bef72613-f5cb-4857-8549-33e3692289b2/konnectivity-agent/0.log" limit=1024
Sep 17 00:54:27.617902 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:27.617863    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-wgc58_09135dbd-49be-474c-92cc-41d951f71081/discovery/0.log"
Sep 17 00:54:27.755035 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:27.755001    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-4wlhv_a125c8de-812e-4c55-88bb-43ef7857b91e/payload-processing/0.log"
Sep 17 00:54:27.773551 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:27.773526    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7c7d59dc6d-jbgwm_d2521dc9-47dd-445a-a28d-d05c7a7eb9b6/router/0.log"
Sep 17 00:54:29.993375 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:29.993337    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-qf5cs_7229633c-b031-453d-ab8e-9077fd3bbd59/kube-storage-version-migrator-operator/1.log"
Sep 17 00:54:29.995358 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:29.995325    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-qf5cs_7229633c-b031-453d-ab8e-9077fd3bbd59/kube-storage-version-migrator-operator/0.log"
Sep 17 00:54:31.083502 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:31.083475    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4c9q_9d5fad81-0837-4f67-85fd-c65c5d5a01bc/kube-multus-additional-cni-plugins/0.log"
Sep 17 00:54:31.102502 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:31.102474    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4c9q_9d5fad81-0837-4f67-85fd-c65c5d5a01bc/egress-router-binary-copy/0.log"
Sep 17 00:54:31.120777 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:31.120746    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4c9q_9d5fad81-0837-4f67-85fd-c65c5d5a01bc/cni-plugins/0.log"
Sep 17 00:54:31.139901 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:31.139870    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4c9q_9d5fad81-0837-4f67-85fd-c65c5d5a01bc/bond-cni-plugin/0.log"
Sep 17 00:54:31.159605 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:31.159582    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4c9q_9d5fad81-0837-4f67-85fd-c65c5d5a01bc/routeoverride-cni/0.log"
Sep 17 00:54:31.180072 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:31.180050    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4c9q_9d5fad81-0837-4f67-85fd-c65c5d5a01bc/whereabouts-cni-bincopy/0.log"
Sep 17 00:54:31.198914 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:31.198893    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-d4c9q_9d5fad81-0837-4f67-85fd-c65c5d5a01bc/whereabouts-cni/0.log"
Sep 17 00:54:31.483743 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:31.483663    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nsp6k_63dc5909-1a82-42ae-bd7d-e3be851bde86/kube-multus/0.log"
Sep 17 00:54:31.617648 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:31.617616    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w28gk_fa2489c7-1864-4abe-bc0f-4bfea881a246/network-metrics-daemon/0.log"
Sep 17 00:54:31.633264 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:31.633236    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w28gk_fa2489c7-1864-4abe-bc0f-4bfea881a246/kube-rbac-proxy/0.log"
Sep 17 00:54:32.466249 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:32.466208    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ljnh_13c90c3a-8f98-4f15-9341-01ac50730012/ovn-controller/0.log"
Sep 17 00:54:32.482334 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:32.482299    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ljnh_13c90c3a-8f98-4f15-9341-01ac50730012/ovn-acl-logging/0.log"
Sep 17 00:54:32.510168 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:32.510124    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ljnh_13c90c3a-8f98-4f15-9341-01ac50730012/kube-rbac-proxy-node/0.log"
Sep 17 00:54:32.533701 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:32.533668    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ljnh_13c90c3a-8f98-4f15-9341-01ac50730012/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 00:54:32.550655 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:32.550616    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ljnh_13c90c3a-8f98-4f15-9341-01ac50730012/northd/0.log"
Sep 17 00:54:32.572261 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:32.572224    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ljnh_13c90c3a-8f98-4f15-9341-01ac50730012/nbdb/0.log"
Sep 17 00:54:32.590724 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:32.590699    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ljnh_13c90c3a-8f98-4f15-9341-01ac50730012/sbdb/0.log"
Sep 17 00:54:32.681537 ip-10-0-138-211 kubenswrapper[2565]: I0917 00:54:32.681504    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6ljnh_13c90c3a-8f98-4f15-9341-01ac50730012/ovnkube-controller/0.log"